In this article, the classification of dynamic vulnerable road users (VRUs) using polarimetric automotive radar is considered. To this end, a signal processing pipeline for polarimetric automotive MIMO radar is proposed, including a method to enhance angular resolution by combining data from all polarimetric channels. The proposed signal processing pipeline is applied to measurement data of three different types of VRUs and a car, collected with a custom automotive polarimetric radar, developed in collaboration with Huber+Suhner AG. Several polarimetric features are estimated from the range-velocity signatures of the measured targets and are subsequently analyzed. A Bayesian classifier and a convolutional neural network (CNN) using these estimated polarimetric features are proposed and their performance is compared against their single-polarized counterparts. It is found that for the Bayesian classifier, a significant increase in classification performance is achieved, compared to the same classifier using single polarized information. For the CNN-based classifier, utilizing the distribution of polarimetric features of the target’s range-velocity signatures also increases classification performance, compared to its single-polarized version. This shows that polarimetric information is valuable for classification of VRUs and objects of interest in automotive radar.@en

This paper presents the first subject-specific head pose estimation approach using only one Frequency Modulated Continuous Wave (FMCW) radar data frame. Specifically, the proposed method incorporates a deep learning (DL) framework to estimate head pose rotation and orientation frame-by-frame by combining a Convolutional Neural Network operating on Range-Angle radar plots and a PeakConv network. The proposed method is validated with an in-house collected dataset, including annotated head movements that varied in roll, pitch, and yaw, and these were recorded in two different indoor environments. It is shown that the proposed model can estimate head poses with a relatively small error of approximately 6.7-14.4 degrees for all rotational axes and is capable of generalizing to unseen, new environments when trained in one scenario (e.g., lab) and tested in another (e.g., office), including in the cabin of a car.

@en

In this study, the problem of multipath in radar sensor networks for human activity recognition (HAR) has been examined. Traditionally considered as a source of additional clutter, the multipath is being investigated for its potential to be exploited through the creation of virtual radar nodes. These virtual nodes are conceptualized to observe targets from aspect angles that differ from those of physically existing radars. To realize this idea, an innovative processing pipeline is proposed that extracts information from multipath signals to improve HAR. The pipeline isolates and tracks the line-of-sight (LOS) and multipath components of a moving human target performing continuous sequences of activities observed by a network of three radar sensors. Furthermore, the method has been verified with experimental data consisting of six activities and 14 volunteers by comparing classification metrics with the use of a single radar as well as only the LOS components of the three radars in the network. A 12-layer convolutional neural network (CNN) classifier has been designed to operate on range-Doppler (RD) images derived from the LOS and multipath components, extracted by the proposed method. A substantial performance improvement using the leave-one-person-out (L1Po) test set is demonstrated in the order of +11% by exploiting a multiradar network with its LOS and multipath components.

@en

In this paper the problem of tracking multiple people in an indoor environment is formulated and analyzed with the usage of a Multiple Input Multiple Output (MIMO) Frequency Modulated Continuous Wave (FMCW) radar. The objective is to evaluate the performance of FMCW MIMO radar with relatively limited bandwidth for accurately tracking single and multiple individuals in various scenarios. Three different tracking approaches are compared and quantitatively analyzed with single and multi-target scenarios. As the angular resolution is significant for distinguishing multiple targets, the effect of the number of MIMO channels used is compared among different trackers. The performance is analyzed by metrics of distance error and cardinality error in track association/assignment.

@en

The application of distributed radar to human motion monitoring is considered. A novel sensor fusion method has been proposed that yields a two-dimensional map of reflection intensity and a vector field of reconstructed velocities in lieu of conventional Doppler spectrograms or radial velocity components. The method has been verified using experimental datasets in two case studies involving fall detection in sequences of activities, and arm motion discrimination for in-place activities. A true positive rate and precision of respectively 99.3 % and 93.0 % have been demonstrated for the fall detection task, and the output of the proposed method for arm motion characterisation indicates suitability for classification in future research.

@en

In this paper, we address the limitations of traditional constant false alarm rate (CFAR) target detectors in automotive radars, particularly in complex urban environments with multiple objects that appear as extended targets. We propose a data-driven radar target detector exploiting a highly efficient 2D CNN backbone inspired by the computer vision domain. Our approach is distinguished by a unique cross-sensor supervision pipeline, enabling it to learn exclusively from unlabeled synchronized radar and lidar data, thus^eliminating the need for costly manual object annotations. Using a novel large-scale, real-life multi-sensor dataset recorded in various driving scenarios, we demonstrate that the proposed detector generates dense, lidar-like point clouds, achieving a lower Chamfer distance to the reference lidar point clouds than CFAR detectors. Overall, it significantly outperforms CFAR baselines detection accuracy.

@en

This paper presents an approach based on Doppler beam sharpening (DBS) to enhance the resolution of multiple ‘dynamic’ targets in automotive driving scenarios. The ambiguity inherent to the forward-looking DBS and the coupling between azimuth and elevation angles are jointly addressed with the proposed method. Demonstrated experimental results show the feasibility of the proposed technique in automotive radar sensing.

@en

A feasibility study to detect the respiratory rate and heart rate of primates using non-invasive contactless radar sensors and a dedicated processing pipeline is performed. The proposed approach is validated using measurement data from an individual bonobo, simultaneously collected by two different types of radar sensors (pulsed Ultra Wide Band and FMCW, operating at different frequencies). The results show that it is feasible to infer both respiration and heart rate data from the radar sensors.

@en

Automatic target classification or recognition is a critical capability in noncooperative surveillance with radar in several defence and civilian applications. It is a well-established research field and numerous techniques exist for recognizing targets, including miniature unmanned air systems or drones (i.e., small, mini, micro, and nano platforms), from their radar signatures. These algorithms have notably benefited from advances in machine learning (e.g., deep neural networks) and are increasingly able to achieve remarkably high accuracies. Such classification results are often captured by standard, generic, object recognition metrics, and originate from testing on simulated or real radar measurements of drones under high signal to noise ratios. Hence, it is difficult to assess and benchmark the performance of different classifiers under realistic operational conditions. In this article, we first review the key challenges and considerations associated with the automatic classification of miniature drones from radar data. We then present a set of important performance measures, from an end-user perspective. These are relevant to typical drone surveillance system requirements and constraints. Selected examples from real radar observations are shown for illustration. We also outline here various emerging approaches and future directions that can produce more robust drone classifiers for radar.

@en

One of the key problems in automotive radar is its limited cross-range resolution, despite many approaches developed to address this. Conventional high-resolution algorithms in synthetic aperture radar (SAR) can provide good resolution imaging ability but suffer from high computational costs. In this paper, a computationally efficient high-resolution imaging algorithm is proposed, easing its potential implementation for higher throughput. The proposed approach is verified with experimental data of realistic driving scenarios.

@en

This paper focuses on the challenge of estimating the 2D instantaneous ego -motion of vehicles equipped with an automotive radar. To further improve our previous study based on the weighted least squares (wLSQ) method and purpose-designed neural networks (NNs), this work proposes a new network architecture that supports local and global feature extraction as well as point-wise dynamic feature channel mixing. Compared with our previous work, the proposed method provides better estimation accuracy, lighter network size, and faster runtime performance.

@en

This article focuses on the experimental validation of probing signals designed to enable radar operation in spectrally crowded environments using an S-band software defined radar (SDR). The tested waveforms ensure spectral coexistence between the sensing system and frequency-overlaid emitters, while optimizing radar performance. This is achieved through a bespoke notching of the radar signal spectrum to control the amount of interference injected by the radar in each shared frequency interval. In addition, some relevant features of the probing signal that influence radar performance are controlled via a similarity index, describing the maximum allowable distance between the spectrally notched waveform and a prescribed radar signal. In a first stage, the study is aimed at verifying whether the transmit and receive chains of the SDR system impair the spectral and temporal features of the designed waveforms. Subsequently, the tested signals are radiated into the environment to investigate their effectiveness to detect targets in the illuminated scene, as well as to ensure spectral coexistence in the presence of frequency-overlaid emitters. The results demonstrated that by exploiting the designed radar probing signals, the SDR system is capable of sharing spectrum with other radio frequency wireless systems while also allowing to detect both stationary and moving targets.

@en

In this paper, the problem of formulating effective processing pipelines for indoor human tracking is investigated, with the usage of a Multiple Input Multiple Output (MIMO) Frequency Modulated Continuous Wave (FMCW) radar. Specifically, two processing pipelines starting with detections on the Range-Azimuth (RA) maps and the Range-Doppler (RD) maps are formulated and compared, together with subsequent clustering and tracking algorithms and their relevant parameters. Experimental results are presented to validate and assess both pipelines, using a 24 GHz commercial radar platform with 250 MHz bandwidth and 15 virtual channels. Scenarios where 1 and 2 people move in an indoor environment are considered, and the influence of the number of virtual channels and detectors' parameters is discussed. The characteristics and limitations of both pipelines are presented, with the approach based on detections on RA maps showing in general more robust results.

@en

The effect of different time-frequency (TF) resolution values is analyzed in the context of Human Activity Recognition (HAR) using multiple radars distributed in a network. Specifically, different spectrograms computed with various Short-Time Fourier Transform (STFT) window lengths and Morse wavelet transform are compared as input representation to a Convolutional Neural Network (CNN), together with a coherent combination of multiple spectrograms. The study emphasizes the importance of selecting appropriate window sizes for TF analysis and for classification, balancing the observation time with the physical duration of the diverse activities, and also avoiding correlation between different data samples that may compromise the generalization ability of the method. The results employing this coherent sensor fusion demonstrate the efficacy of the investigated method, achieving an F1 score of 0.943 on a challenging public dataset containing 9 activities performed by 15 participants.

@en

Fall detection systems can play an important role in assuring safe independent living for vulnerable people. These sensors not only have to detect falls but also have to recognize uncritical, normal activities of daily living in order to differentiate them from falls. Radar sensors are very attractive for human activity recognition thanks to their contactless capabilities and lack of plain videos recorded. In this article, a novel approach to recognize single activities in a continuous stream of radar data is proposed, whereby the stream is divided into windows of fixed length and, then, multilabel classification is used to recognize all activities taking place in these time segments. While the initial feasibility of this approach was presented in an earlier contribution presented at the 2023 IEEE SENSORS conference, in this extended work, additional in-depth studies on critical parameters are performed. Specifically, multiple combinations of different radar data domains/representations (e.g., range-time maps, range-Doppler maps, and spectrograms) and different radar nodes in a network of five cooperating sensors are considered as inputs to two considered multilabel classification networks. In addition, a parametric study on the probability thresholds of the networks to assign labels to specific classes is also performed.

@en

A neural network (NN) based multi-frame classification approach is proposed to solve the problem of classification of tracked objects. Initially, a baseline tracker is implemented that uses the classification output of an object detection network for classification. Afterwards, two approaches for multi-frame classification are applied to perform classification of tracked objects. The first approach aggregates points from multiple frames and applies a single frame NN for classification, whereas the second approach uses bidirectional long short term memory (BiLSTM) layers to process points from multiple frames. Extensive experiments on the opensource 2D RadarScenes dataset showed a consistent increase in track performance when using either of the two techniques for multi-frame classification.@en

The problem of detection and localization of multiple people using a network of Ultra-Wide Band (UWB) radar nodes in the cabin of a vehicle is addressed in this paper. Specifically, an algorithm for decentralized vital signs detection is proposed, based on the analysis of a novel model for radar signatures of vital signs. Additionally, a centralized association processing block is used to fuse the detections from all radars in the network using a dedicated cost-matrix computation. The performance of the proposed processing pipeline is tested experimentally with a multistatic radar network, and a simulation framework is also developed to evaluate the performance in alternative topologies of the radar network beyond the experiments. It is shown that the detection and localization of humans within the car environment is possible with the proposed processing pipeline, with localization Root Mean Square Error.

@en

The design of bespoke adaptive detection schemes relying on the joint use of multistatic/polarimetric measurements requires a preliminary statistical inference on the clutter interference environment. This is of paramount importance to develop an analytic model for the received signal samples, which is mandatory for the synthesis of radar detectors. In this respect, the aim of this article is the development of suitable learning tools to study some important statistical features of the sea-clutter environment perceived at the nodes of a multistatic/polarimetric radar system. Precisely, the stationarity of the data in the slow-time domain is first assessed by resorting to generalized inner product (GIP) based statistics. Then, the possible presence of structural symmetries in the clutter covariance matrices is investigated. Finally, relationships between some statistical parameters characterizing the sea-clutter returns on the bistatic polarimetric channels are explored via specific sequential hypothesis testing. This research activity is complemented by the use of radar returns measured via the netted RADar (NetRAD), which collects simultaneously monostatic and bistatic polarimetric measurements. The results indicate that the analyzed data can be modeled as drawn from a stationary Gaussian process within the coherence time. In addition, the bistatic returns on the different polarimetric channels can be assumed statistically independent with speckle components possibly exhibiting proportional/equal covariance matrices depending on the transmit/receive polarization and bistatic geometry.

@en

The problem of 3D ego-motion velocity estimation using multichannel Frequency Modulated Continuous Wave (FM CW) radar sensors has been studied. Special attention is given to presence of moving targets in the scene. These targets are first distinguished by the difference between the measured Doppler, and the Doppler calculated with an initial rough estimation of the vehicle ego-velocity. Then, an iterative algorithm is proposed to reduce the influence of the moving targets in the ego-motion estimation procedure, thus improving the overall accuracy. The performance of the proposed algorithm is compared with state-of-the-art alternatives based on simulated data, and superior performance has been demonstrated.

@en