Every day, we are surrounded by billions of invisible bits transmitted by our phones, tablets, and laptops. Wireless communication is pervasive but hard to teach because radio waves (5G, WiFi, BLE) cannot be seen, and a sensory experience is key to learning. From a physics perspective, radio and light waves are similar, but our eyes only see light. Thus, we design a platform to teach the complex concept of wireless communication using light. With our platform, children can "see" how a device transmits information using a normal flashlight. Our design includes connections with robots, superheroes, and games to make a joyful learning experience. The platform was used by hundreds of school students at an international science fair. After a guided activity, 80% of the students reported understanding the basic idea of wireless communication and some students even identified advanced concepts, such as interference, playing on their own.@en

In the field of music technology, the ability to connect body movements with music generation has led to highly engaging applications. Many existing solutions use cameras or wearable devices to capture physical movements and translate them into commands for a music generation tool. While the camera-based systems are privacy-invasive and demand good lighting conditions, the wearable devices adversely impact the fluidity of movements. We propose WaveTune, a privacy-friendly and device-free interface for creating music beats through body gestures. Wavetune has the following components: (i) a millimeter-wave radar as the frontend sensor that captures body movements, (ii) a gesture recognition algorithm that performs gesture delimitation and identification in real-time, and (iii) a music generation component that maintains a seamless and pleasant experience. WaveTune also provides an option to continuously map random dynamic movements into musical parameters to encourage further interaction. We recruited 24 users to train and test WaveTune’s ability to map body gestures to musical commands. To the best of our knowledge, WaveTune is the first mmWave system that allows a layered composition of music beats.@en

Multiple-input multiple-output (MIMO) methods play a pivotal role in increasing the capacity of wireless communication systems, but they have not been analyzed systematically in the nascent area of passive communication with visible light (passive-VLC). The main challenge in passive-VLC is its low data rate. This limitation is caused by the slow switching speed of the most popular modulator used in the state-of-the-art: liquid crystal cells (LCs). Several studies use sophisticated modulation schemes with multiple LCs to increase the data rate. However, these efforts have only led to logarithmic improvements. A transmitter with a single LC can provide 1 kbps, and a transmitter with 64 LCs delivers 8 kbps: resulting in an efficiency of 125 bps per LC cell. Ideally, the capacity should increase linearly with the number of LCs.

We propose a general framework to achieve reliable MIMO communications with passive-VLC. Our approach, which has a theoretical and empirical foundation, has three desirable properties: (i) does not assume orthogonality of the individual channels (overcomes co-channel interference), (ii) can exploit multiple properties of light (polarization and color); and (iii) is agnostic to LC parameters (which some studies rely on). Our results show that a transmitter with 9 LCs increases its capacity almost linearly up to 9 channels, attaining 6.8 kbps (750 bps per LC) using the simplest modulation method in the SoA.@en

Over the past decade, visible light positioning has become increasingly important for precise localization systems, yet its widespread adoption is limited due to the necessity of modifying existing lighting systems. This paper presents HueLoc, a novel method that bypasses this issue by using inherent features of light, such as the dominant colours in white LED lights, and employs affordable, energy-efficient hue sensors for location services. We propose that by extracting the power at dominant wavelengths of LEDs, these can be uniquely identified using a specifically designed signature. The unique signatures can be used by mobile objects for spatial awareness and further localization using the proposed regression-based learning approach. Our experiments demonstrate that HueLoc attains a location-mapping accuracy of 100% and achieves decimeter-level localization precision with a moving object in uncontrolled lighting conditions. Moreover, these unique signatures can be combined with other RF-based technologies to enhance their localization accuracy. As an example, this paper details the integration of Bluetooth features with light signatures using a three-stage incremental learning approach.

@en

A recent advance in embedded Internet of Things (IoT) exploits ambient light for wireless communication. This new paradigm enables highly efficient links via simple light modulation, but the design space has a fundamental constraint: in most State of the Art (SoA) studies, the link can only follow the propagation direction of ambient light. Consider, for example, a swarm of drones and ground robots that want to communicate with sunlight. Drone-to-robot communication could be possible because sunlight travels downwards from the air (drone) to the ground (robot), allowing drones to modulate light to send information to robots beneath them. Robot-to-robot communication, however, is not possible because sunlight does not travel sideways (parallel to the ground). To allow ‘lateral communication’ with ambient light, we propose using Luminescent Solar Concentrators (LSC). These optical components receive ambient light on their surface and re-direct part of the spectra towards their edges. Considering this optical property of LSC, our work has three main contributions. First, we benchmark various optical properties of LSC to assess their performance for ambient light communication. Second, we combine LSC with liquid crystal (LC) shutters to form lateral links with ambient light. Third, we test our links indoors and outdoors with artificial and natural ambient light, by enhancing two robots with our LSC transceivers and showing that they can exchange basic commands and coordinate tasks by communicating only with sunlight.

@en

Consider an enclosed area, such as a room without windows. During the day, artificial light can provide illumination and communication thanks to advances in Visible Light Communication (VLC). Artificial lighting, however, has some drawbacks compared to using daylight in enclosed spaces. First, using sunlight consumes less power. Second, the use of natural light improves the health and comfort of the occupants. We propose a system, dubbed Sol-Fi, to provide joint illumination and communication in enclosed spaces using sunlight. Sol-Fi relies on two main components: commercial sunlight collectors and a novel transmitter to modulate ambient light. The sunlight collectors utilize optical fibers to guide natural light from open to enclosed spaces, and our transmitter modulates the incoming light providing two novel features. First, to analyze the pros and cons of the optical devices used in the literature for ambient light communication, Sol-Fi examines the properties of Liquid Crystals (LCs) and Digital Micro Mirror Devices (DMDs). Second, to investigate the trade-off between single- and multi-band communication, Sol-Fi proposes an optical design that can modulate the entire spectrum or divide it into different (individually modulated) bands. Our evaluation shows that, depending on the number of bands (single or dual) and the type of modulator (LC or DMD), Sol-Fi provides a data rate between 0.8 to 80 kbps, a range between 0.5 to 5 m, and a field-of-view between 30° to 60°.@en

A recent technology known as transparent screens is transforming windows into displays. These smart windows are present in buses, airports and offices. They can remain transparent, as a normal window, or display relevant information that overlays their panoramic views. In this paper, we propose transforming these windows not only into screens but also into wireless transmitters. To achieve this goal, we build upon the research area of screen-to-camera communication. In this area, videos are modified in a way that smartphone cameras can decode data out of them, while this data remains invisible to the viewers. A person sees a normal video, but the camera sees the video plus additional information. In this communication method, one of the biggest disadvantages is the traditional screens’ power consumption, more than 80% of which is used to generate light. To solve this, we employ novel transparent screens relying on ambient light to display pictures, hence eliminating the power source. However, this comes at the cost of a lower image quality, since they use variable and out-of-control environment light, instead of generating a constant and strong light by LED panels. Our work–dubbed PassiveCam – overcomes the challenge of creating the first screen-to-camera communication link using passive displays. This paper presents two main contributions. First, we analyze and modify existing screens and encoding methods to embed information reliably in ambient light. Second, we develop an Android App that optimizes the decoding process obtaining a real-time performance. Our evaluation, which considers a musical application, shows a Packet Success Rate (PSR) of close to 90%. In addition, our real-time application achieves response times of 530 ms and 1071 ms when the camera is static and when it is hand-held, respectively.@en

Sensing people with mmWave radars is gaining significant attention. This growing interest is due to two factors: radar monitoring provides more privacy than camera-based alternatives, and radio waves are not as easily blocked as light waves. Most mmWave studies, however, have three common characteristics. They are done indoors, without protecting the sensor (no casing), and the evaluation is performed for short periods of time. To assess the suitability of mmWave sensing in realistic outdoor scenarios, we deploy two nodes to track the flow of pedestrians over a period of three months. This longterm deployment provides three main contributions. First, we follow a detailed process to design a casing that can protect the sensors from harsh environmental conditions. Second, we install our nodes close to a set of cameras that were already deployed in the area. To compare the performance of both types of sensors, we propose a framework that considers the different coverage patterns of cameras and radars. Third, the time frame of our evaluation considers various types of weather, from sunny days to rainy and windy. Our results indicate that mmWave sensors need to be explored further outside the comfort zone of indoor spaces. To the best of our knowledge, this is the first long-term study assessing the reliability of radar sensors in the 60 GHz ISM band.@en

Cardiac patterns are being used to provide hard-to-forge biometric signatures in identification applications. However, this performance is obtained under controlled scenarios where cardiac signals maintain a relatively uniform pattern, facilitating the identification process. In this work, we analyze cardiac signals collected in more realistic (uncontrolled) scenarios and show that their high signal variability makes them harder to obtain stable and distinct features. When faced with these irregular signals, the state-of-the-art (SOTA) reduces its performance significantly. To solve these problems, we propose the CardioID framework¹ with two novel properties. First, we design an adaptive method that achieves stable and distinct features by tailoring the filtering process according to each user’s heart rate. Second, we show that users can have multiple cardiac morphologies, offering us a bigger pool of cardiac signals compared to the SOTA. Considering three uncontrolled datasets, our evaluation shows two main insights. First, while using a PPG sensor with healthy individuals, the SOTA’s balanced accuracy (BAC) reduces from 90–95% to 75–80%, while our method maintains a BAC above 90%. Second, under more challenging conditions (using smartphone cameras or monitoring unhealthy individuals), the SOTA’s BAC reduces to values between 65–75%, and our method increases the BAC to values between 75–85%.

@en

In this paper, we propose a new approach where drones attain accurate localization by fusing information from artificial lighting and their embedded inertial and barometer sensors. Our system is able to provide accurate drone localization without the use of radios, GPS or cameras. We evaluate our framework, dubbed Firefly, with a testbed consisting of four light beacons and a mini-drone. Our results show that Firefly allows locating the drone within a few decimeters of the actual position; and compared to two state-of-the-art positioning methods that rely solely on lighting information, Firefly can reduce the localization error by 50 % and 80%.. respectively.@en

We explore a new alternative for drones to gather information from sensors. Instead of using the traditional radio-frequency spectrum, whose broadcast nature makes it more difficult to poll specific objects, we utilize the light spectrum. In our system, the drone carries a light, and flies to an area that it is interested in polling. Only the sensor (tag) under the coverage of the light sends data back by backscattering the impinging light waves. Enabling this system poses two challenges. First, a reliable modulation method with light is required. The method must overcome noise dynamics introduced by the drone (mechanical oscillations), the object (backscattering effects) and the environment (interference from ambient light). Second, to facilitate the deployment of tags in pervasive applications, the design of the tag should be battery-less and have a small surface area. These requirements limit the amount of power available for reception, transmission and sensing, since the energy harvested by solar cells is proportional to their surface area. Regarding the first challenge, we show that the amplitude-based modulation methods used in state-of-the-art studies do not work in our scenario, and investigate instead a frequency-based approach. For the second challenge, we optimize the computation, reception and transmission of the tag to create a battery-less design that operates with frequency-modulated signals generated from light. We build a prototype for the drone and the tag, and test them under different lighting scenarios: dark, indoors, and outdoors with sunlight. The results show that, under standard indoor lighting, our system can attain a polling range of 1.1 m with a data rate of 120 bps, while the tag operates with small solar cells and consumes less than 1 mW.@en

In recent years, the number of wireless applications has increased significantly, resulting in the radio bands becoming expensive and prone to interference. There is a new research area aiming at mitigating these issues by creating communication links using ambient light. This area, called passive-VLC, not only exploits the visible light frequencies, but does so with low-power transmitters. All the previous work in passive-VLC, however, forget about individual wavelength bands of light, and do not exploit its wide spectrum, reducing the potential channel capacity. In this paper, we propose a novel method to transmit and decode data, using liquid crystal cells that modulate and consider the full spectrum, and put it to the test by prototyping a multi-symbol communication link. The main contribution of our work is to show that passive-VLC can move from spectrum-agnostic to spectrum-aware modulation. We explore this new domain by making use of a novel type of receiver (i.e., a spectrometer) and uncovering the advantages and caveats of this spectrum-aware approach.

@en

Visible Light Positioning (VLP) has been prevalent in providing high-precision localization systems in the past decade. However, the commercial availability or usage is still limited primarily due to the requirement of changing the existing lighting infrastructure. In this paper, we propose HueSense, an alternative technique to develop a passive VLP system by extracting light-emission intrinsic features, such as dominant colours present in the white LED light. The method can eliminate the need to change lighting-infrastructure, and only uses cheaper and power-efficient off-the-shelf hue sensors. Our experiments demonstrate that HueSense can achieve a location-mapping accuracy of 80.14% with a moving robot in uncontrolled lighting environments.@en

Solar cells are mainly used as power sources, but can be used for sensing as well. We propose a novel indoor system that exploits solar cells to track people by monitoring the changes in light intensity caused by their shadows and reflections as they walk by. Our framework has three main components. First, we develop a simulator based on a ray-tracing model to determine how the solar cells should be positioned in the tracking environment to maximize the signal to noise ratio. Next, we apply changepoint detection methods to convert the (noisy) solar cell signal into a binary detection signal. Our detection method uses a Bayesian approach, which allows our system to work well in various environments, with natural and artifical light. Finally, the binary output from multiple solar cells is fused to track multiple targets. The tracking engine is based on a particle filter implementation based on the probability hypothesis density filter. This approach allows us to perform tracking without knowing the actual number of targets in the environment. To evaluate our framework, we build small tags that consist of a solar cell, a micro-controller and a wireless module, and deploy them in a real apartment. Ours results show that our system allows solar cells to track people under different lighting conditions, during day and night.

@en

There is a growing interest in exploiting ambient light for wireless communication. This new research area has two key advantages: it utilizes a free portion of the spectrum and does not require modifications of the lighting infrastructure. Most existing designs, however, rely on a single type of optical surface at the transmitter: liquid crystal shutters (LCs). LCs have two inherent limitations, they cut the optical power in half, which affects the range; and they have slow time responses, which affects the data rate. We take a step back to provide a new perspective for ambient light communication with two novel contributions. First, we propose an optical model to understand the fundamental limits and opportunities of ambient light communication. Second, based on the insights of our analystical model, we build a novel platform, dubbed PhotoLink, that exploits a different type of optical surface: digital micro-mirror devices (DMDs). Considering the same scenario in terms of surface area and ambient light conditions, we benchmark the performance of PhotoLink using two types of receivers, one optimized for LCs and the other for DMDs. In both cases, PhotoLink outperforms the data rate of equivalent LC-transmitters by factors of 30 and 80: 30 kbps & 80 kbps vs. 1 kbps, while consuming less than 50 mW. Even when compared to a more sophisticated multi-cell LC platform, which has a surface area that is 500 times bigger than ours, PhotoLink's data rate is 10-fold: 80 kbps vs. 8 kbps. To the best of our knowledge this is the first work providing an optical model for ambient light communication and breaking the 10 kbps barrier for these types of links.

@en

To protect sensitive information on smartphones, state-of-the-art (SoA) studies exploit the built-in camera to capture PPG signals from fingertips as a hard-to-forge biometric. However, those studies do not provide a comprehensive analysis to optimize the camera parameters and finger pressure, leading to distorted and unstable PPG signals that degrade the authentication performance. To overcome these limitations, we propose the CamPressID framework. First, we analyze various camera parameters and optimize their configuration to obtain PPG signals with a high signal-to-noise ratio. Second, we investigate different finger pressures to identify the best pressure for every subject, in order to avoid signal distortion. To evaluate the performance of CamPressID, we collect a diverse dataset with 58 subjects. Our evaluation results show that CamPressID can improve the average balanced accuracy (BAC) by 10%. Moreover, the BAC reaches 90%, which is similar to the accuracy reported in the SoA using a dedicated PPG sensor for authentication.@en

Advances in Visible Light Communication are enabling novel Internet of Things applications. Going forward, we expect that LED-to-Camera links will enable a wide range of body-centric computing applications. Up until now, most LED-to-Camera studies have been following a deploy-and-test approach instead of a principled methodology. This ad-hoc design raises up two problems. First, we cannot compare fairly the various methods proposed in the literature because they use different types of LEDs and cameras. Second, and perhaps more importantly, we cannot identify the fundamental opportunities and limits of these novel links. To overcome these challenges, we propose a simple analytical model that estimates the range and data rate of LED-to-camera links prior to deployment. The model is built from first principles and requires only a limited set of parameters. To validate the accuracy of our model, we consider the two main transmission modes used in the literature: binary transmission and communication based on the rolling shutter effect. Our experimental evaluation confirms the predictions of the analytical model.

@en

Cardiac patterns are being used to obtain hard-to-forge biometric signatures and have led to high accuracy in state-of-the-art (SoA) identification applications. However, this performance is obtained under controlled scenarios where cardiac signals maintain a relatively uniform pattern, facilitating the identification process. In this work, we analyze cardiac signals collected in more realistic (uncontrolled) scenarios and show that their high signal variability (i.e., ir-regularity) makes it harder to obtain stable and distinct user features. Furthermore, SoA usually fails to identify specific groups of users, rendering existing identification methods futile in uncontrolled scenarios. To solve these problems, we propose a framework with three novel properties. First, we design an adaptive method that achieves stable and distinct features by tailoring the filtering spectrum to each user. Second, we show that users can have multiple cardiac morpholo-gies, offering us a much bigger pool of cardiac signals and users compared to SoA. Third, we overcome other distortion effects present in authentication applications with a multi-cluster approach and the Mahalanobis distance. Our evaluation shows that the average balanced accuracy (BAC) of SoA drops from above 90% in controlled scenarios to 75% in uncontrolled ones, while our method maintains an average BAC above 90% in uncontrolled scenarios.

@en

A recent development in wireless communication is the use of optical shutters and smartphone cameras to create optical links solely from ambient light. At the transmitter, a liquid crystal display (LCD) modulates ambient light by changing its level of transparency. At the receiver, a smartphone camera decodes the optical pattern. This LCD-To-camera link requires low-power levels at the transmitter, and it is easy to deploy because it does not require modifying the existing lighting infrastructure. The system, however, provides a low data rate, of just a few tens of bps. This occurs because the LCDs used in the state-of-The-Art are slow single-pixel transmitters. To overcome this limitation, we introduce a novel multi-pixel display. Our display is similar to a simple screen, but instead of using embedded LEDs to radiate information, it uses only the surrounding ambient light. We build a prototype, called SunBox, and evaluate it indoors and outdoors with both, artificial and natural ambient light. Our results show that SunBox can achieve a throughput between 2 kbps and 10 kbps using a low-end smartphone camera with just 30 FPS. To the best of our knowledge, this is the first screen-To-camera system that works solely with ambient light.

@en

Passive visible light communication (VLC) takes advantage of the pervasive nature of ambient light in our environment for wireless transmissions. The design of transmitters in passive VLC predominately uses liquid crystal displays (LCDs). While LCDs are an economical choice with low power consumption, they lack some key properties that are desirable for passive VLC. For example, LCDs absorb more than half of the incident light, leaving only a small portion to be used for communication. In addition, since the direction of ambient can change over time, the relative positions of the LCDs and receivers have to be changed constantly to maintain the correct alignment. To overcome these shortcomings, we propose the use of a novel transmitter with integrated optical fibres and digital micro-mirror devices (DMDs). DMDs are able to reflect up to 97% of the incident light, while the accompanying optical fibres aim to capture ambient light from various angles and guide them to the DMDs in a fixed direction. This design is a first step towards the goal of decoupling the direction of ambient light from the direction of the optical link, while achieving the same communication characteristics as LCDs with a much smaller device. We also design an App to allow users to easily interact with the system and our evaluation shows that the link can achieve a data rate of 1bps at a distance of 30cm.

@en