Next Article in Journal
Resonance Frequency of Optical Microbubble Resonators: Direct Measurements and Mitigation of Fluctuations
Next Article in Special Issue
Low-Rank Matrix Recovery Approach for Clutter Rejection in Real-Time IR-UWB Radar-Based Moving Target Detection
Previous Article in Journal
A Web Service Protocol Realizing Interoperable Internet of Things Tasking Capability
Previous Article in Special Issue
Through-Wall Multiple Targets Vital Signs Tracking Based on VMD Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Through Wall Radar Classification of Human Micro-Doppler Using Singular Value Decomposition Analysis

1
Department of Electronic and Electrical Engineering, University College London, London, WC1E 7JE, UK
2
Department of Security and Crime Science, University College London, London, WC1H 9EZ, UK
*
Author to whom correspondence should be addressed.
Sensors 2016, 16(9), 1401; https://doi.org/10.3390/s16091401
Submission received: 17 May 2016 / Revised: 29 July 2016 / Accepted: 9 August 2016 / Published: 31 August 2016
(This article belongs to the Special Issue Non-Contact Sensing)

Abstract

:
The ability to detect the presence as well as classify the activities of individuals behind visually obscuring structures is of significant benefit to police, security and emergency services in many situations. This paper presents the analysis from a series of experimental results generated using a through-the-wall (TTW) Frequency Modulated Continuous Wave (FMCW) C-Band radar system named Soprano. The objective of this analysis was to classify whether an individual was carrying an item in both hands or not using micro-Doppler information from a FMCW sensor. The radar was deployed at a standoff distance, of approximately 0.5 m, outside a residential building and used to detect multiple people walking within a room. Through the application of digital filtering, it was shown that significant suppression of the primary wall reflection is possible, significantly enhancing the target signal to clutter ratio. Singular Value Decomposition (SVD) signal processing techniques were then applied to the micro-Doppler signatures from different individuals. Features from the SVD information have been used to classify whether the person was carrying an item or walking free handed. Excellent performance of the classifier was achieved in this challenging scenario with accuracies up to 94%, suggesting that future through wall radar sensors may have the ability to reliably recognize many different types of activities in TTW scenarios using these techniques.

1. Introduction

There is a significant body of academic research which has attempted to apply radar detection and imaging techniques to scenarios that consist of an obscuring wall barrier, which is summarized effectively within [1,2,3]. Information obtained about the structural layout of a room, if a person is present or how many individuals are present is vital for police, military or civilian search and rescue teams [4]. In the domain of defence and security, a key challenge that exists is the ability not only to sense the presence of individuals within a room but to also classify their actions. This can be accomplished using a multitude of different techniques and types of sensors, each with their own advantages and disadvantages. Invasive positioning of optical sensors allows for observations to be made of a room, but requires physically penetrating the walls or the opening of the closed room which may be impractical in a short time frame or cause disruption that would alert the individuals within the room. The advantage of TTW radar is that it can sense targets within a room at a standoff distance without the need of physically placing the sensor within the room.
The challenge of TTW radar imagery has been researched using a combination of both innovative signal processing and hardware techniques. Hardware innovations in this area include active MIMO array systems [5] providing cross range information, ultra-wide band radars [6,7] for high range resolution, Synthetic Aperture Radar (SAR) imaging techniques [8] and passive WiFi radar [9]. The practical implications of using a MIMO radar for TTW imaging is discussed in [7]. This system was capable of real-time processing and high range and cross range resolution, although it was bulky in its design compared to other man‑portable solutions. These hardware innovations have been successful in gathering information within through wall scenarios, but often come with increased complexity and cost.
Previously developed signal processing techniques that have also been applied to TTW imaging include the MUSIC algorithm [10], compressed sensing [11], image alignment procedures [12] and spatial filtering [13]. The focus of these techniques is often on the maximization the signal-to-noise ratio (SNR) of the desired target or removal of the significant primary wall reflection. TTW human micro-Doppler signatures have been both simulated and analysed previously within [14,15,16,17]. In comparison with those publications, this article focuses on the application of classification of movements on real data obtained in a through wall configuration using human micro-Doppler signatures. The most significant effect of a TTW scenario on the detected signatures is the attenuation of the signals obtained due to the significant loss of signal when propagating through the wall. Other important effects to take into account include multipath and shadowing effects from other clutter items within the scene. Multipath issues are one of the most challenging problems and can result in missed detections or incorrect estimates of the number of targets. All of these problems contribute to a very challenging situation which is yet to be effectively solved.
The hardware system used for this research was a Frequency Modulated Continuous Wave (FMCW) radar which benefits from no minimum blind range, relative low-cost, good resistance to interference, and simple architecture suited to a compact design [18]. This type of radar system has been researched for many decades, with numerous variations on the engineering techniques applied to maximize the information obtained and reduce the effects of clutter and the reflections from the wall. Previous FMCW radar systems that have been used in TTW experiments include work published by ONERA [19,20] showing a UWB radar (1–5 GHz) measuring a person walking inside a residential building as well as evaluating the measured attenuations with respect to range and frequency. A specific application of an FMCW system was in the measurement of a human breathing through wall [21,22] achieved using an S-Band Self Injection Locked (SIL) architecture. The wall used for this case was, however, only a plywood barrier in comparison to a standard brick wall with air gaps.
The micro-Doppler effect is generated by the rotation or vibration of components of a target and presents itself as modulations on top of the main Doppler shift generated by the bulk translational motion of a target [23]. In the case of human micro-Doppler, the motion of the arms, legs and torso all contribute to a unique signature modulated on the main Doppler velocity generated by an individual moving forward. The study of human micro-Doppler is an active area of interest in radar research, with the main objective often being the extraction of additional information within the micro-Doppler signature for the radars’ advantage. Well defined models for human motion have been developed by V. Chen and applied to real data [23,24,25,26], these can accurately produce expected micro-Doppler contributions from different types of motions. In recent work it has been shown that optical sensors can also be used to develop human micro-Doppler modelling capabilities further through the use of a simple low cost optical sensor [27].
The additional information provided by the human micro-Doppler can be used to classify the types of motions individuals are making, from walking to boxing, or to classify different targets, for example animals, humans or vehicles [28], or for Automatic Target Recognition (ATR) [29]. Youngwook and Hao [28], showed seven different human motions could be successfully classified by appling a Support Vector Machine technique, although this was completed in a non-TTW scenario. If the information is maintained within the signal after propagating through a wall, then the same processing should, in theory, be possible, although with potential reductions in performance due to lower SNR and the additional multipath components.
The analysis of human micro-Doppler has also been performed using multistatic radar sensors, where a comparison was made between a simple model for human motion and the real multistatic micro-Doppler data [30]. In a multistatic scenario, classification methodologies have been applied in order to differentiate individuals walking free handed or while carrying a rifle‑like object [31,32]. This analysis used either empirical manually extracted features from the micro-Doppler signatures or an automated Singular Value Decomposition (SVD) feature extraction. The techniques applied within this work follow on from the SVD processing methodologies applied to the multistatic data [31], but are utilized in a TTW scenario, using a different radar sensor, with a different sensor architecture and alternative classification techniques. In the non-TTW configuration, classification results achieved by SVD processing were shown to have success rates of up to 95% with 25% training samples. SVD processing has previously been applied to through wall radar analysis but the focus has not been on using this information as part of classification processing. It was shown in [33] that SVD can be used as part of the detection process when using a TTW radar, although this work focused solely on the detection of a target using the SVD information, not the classification of the actions of a human target. SVD processing was also used for TTW radar in [34], but this was to mitigate clutter, not for detection or classification.
The rest of this paper is organized as follows. Section 2 presents the radar system and the experimental setup used for the data collection process. Section 3 explains the theory behind the SVD processing and the classifiers that have been applied to the data. Section 4 shows the results of these signal processing algorithms and compares the classification accuracy from the different cases measured. Finally, Section 5 concludes the paper with a summary of results that have been presented and defines potential future expansions on this research.

2. Radar System and Measurement Setup

The Soprano radar system was developed at University College London (UCL) in 2014. The radar uses a FMCW architecture operating at C-band with a central frequency of 5.8 GHz. This system was manufactured using commercial off‑the‑shelf (COTS) surface mount components on an in-house designed PCB [35,36]. A basic block diagram of the system design can be seen in Figure 1 along with the RF parameters in Table 1. The Direct Digital Synthesiser (DDS) chip used within the system is capable of a bandwidth of 200 MHz but is limited to 83.5 MHz to meet ISM bandwidth regulations in the UK. The system is capable of operating in monostatic or bistatic mode, using an over-the-air deramping (OTAD) technique unique to this radar [35]. However, for all the results presented here the system was only operated in a monostatic configuration.
Digitization of the output baseband signal was performed using a USB external audio card controlled using Matlab (Natick, MA, USA) on a standard laptop. This is possible due to the low output frequency of the deramped FMCW signal. An external sound card is a good candidate for an Analogue to Digital Converter (ADC) in this case as it is low cost, small, easy to setup, and the data can be read by most programming languages. The sound card has 24-bit dynamic range and is capable of measuring signals up to 98 kHz. As the exact start of a chirp period was challenging to sample, with the slow ADC used, a second channel of the audio card was used to sample the output from a pulse stretching device which elongates the instance of the beginning of the chirp to a duration that can be sampled by the audio card. Through the use of interpolation, it was then possible to break down the long string of data samples into individual chirps which were first windowed using a hanning window to reduce range side-lobes and then filtered using a high-pass Finite Impulse Response (FIR) filter across multiple chirps of data. The FIR filter was applied as part of the Moving Target Identification (MTI) processing on the data to enhance only moving targets within the scene. This data was then Fourier transformed in order to obtain range-time profiles which could be used to identify where a moving target was within the scene.
The experiments were performed at a UCL test site in Shenley, UK. The building used was a residential house with a brick wall that was approximately 33 cm thick, with a central air gap. The radar system was setup outside of the property with the antennas at a distance of 43 cm from the exterior wall. The room had a floor to ceiling height of approximately 2.4 m and no furniture was present within the area of interest. This represented a very challenging real world scenario for a through wall radar; features such as the chimney-breast, electrical wires, and pipes within the walls all contributed to a complex cluttered environment. The geometry of the building and radar location can be seen in Figure 2, along with an image of the Soprano radar deployment in Figure 3.

3. Theory

The application of SVD allows for the decomposition of the dimensionality of a matrix into fundamental components of the original signal, comparable to a form of compressed sensing. The assumptions made when performing SVD processing are that the signal of interest can be deconstructed into a linear combination of a few key components from a defined dictionary [37]. This methodology is applicable to micro-Doppler classification, as the spectrogram matrix is a suitable candidate for sparse representation due to only a few key features containing a significant proportion of the vital information. SVD signal processing enables a sparse representation of this data through subspace base analysis. The SVD as well as eigenvalue decomposition (EVD) processing techniques have been previously used for subspace estimation, despite their computationally demanding algorithms. Modifications to these techniques include sliding window adaptive implementations [38] and a K-SVD representation [39] of the model. For the analysis within this paper, a simple representation of the SVD model is used to analyse the real data produced by the radar in order to extract features to input into a classifier. The advantage of the SVD processing technique is that physical empirical features from the micro-Doppler signature, such as period and bandwidth, do not have to be manually extracted prior to classification, making the processing automated and easily repeatable.
This theorem is based on the concept that any matrix A is defined as,
A R m × n
When matrix A has rank of one, the matrix can be represented by,
A = u σ υ T
where uRm, υRn, and σ > 0. This can be expanded to when matrix A has an arbitrary rank of r, where the matrix can be represented by a sum or rank one matrices.
A = i = 1 r σ i u i υ i T
where r is the rank of the matrix, ui and υi values are all mutually orthogonal and the σi values are all positive and labelled as singular values of the matrix A.
It is the matrices υ and u that have been evaluated for each of the micro-Doppler datasets that are available. The σ values are only scaling values for the unity matrices u and v, and are, hence, not used as part of the classification process. Features from within these matrices are extracted in order to perform a classification process.
The classifiers that have been applied to the data are Discriminant Analysis (DA), which is a form of a Bayesian classifier, and Random Forest (RF) classifier types. The DA classifier is based on the assumption that the features’ vectors inputs are both Gaussian distributed and statistically independent. The two categories of DA classifiers that have been applied are linear and quadratic; for the linear case, the model has the same covariance matrix for each class, only the means vary, while for the quadratic case, both means and covariance of each class vary [40,41]. During the training process the mean and variance of these feature vectors are estimated as part of the classification process. Then, the posterior probability of each sample under test belonging to each class can be evaluated in order to assign the sample to a given class which gives the highest probability. This is achieved by minimizing the expected classification cost, which is defined in [42] as:
y ^ = arg   min y = 1 , . , K k = 1 K P ^ ( k | x ) C ( y | k )
where K is the number of classes, y is the predicted classification, P ^ ( k | x ) is the posterior probability of class k for observation x and C ( y | k ) is the cost of classifying an observation as y when its true class is k . The posterior probability is the product of the prior probability P ^ ( k ) , which has been assumed to be uniform across all classes within this work, and the multivariate normal density of the features which is defined as:
P ( x | k ) = 1 2 π | Σ k | e x p ( 1 2 ( x μ k ) T Σ k 1 ( x μ k ) )
With μk representing the mean and Σk representing the covariance. Using Equation (5) with the prior probability, it is possible to evaluate the posterior probability that observation x is from class k by using the Bayes rule shown below:
P ^ ( k | x ) = P ( x | k ) P ( k ) P ( x )
This is a component of Equation (4) that required minimization as part of the classification decision-making process.
The second type of classifier that was applied was the RF process [43,44], which is a supervised machine learning algorithm that uses a series of binary decisions configured in a tree form which allow for the categorization of a given input to a series of classes. A decision tree is formed by considering all possible split combinations which are available from all feature samples, and then the optimum splits are defined using an optimization criterion. A random component of the decision tree process is introduced by utilizing a random subset of the given data to construct a series of decision trees in an iterative way. The purpose of this randomization is to minimize the error in the classification process by testing the numerous different generated decision trees. The error that is being minimized is the Gini Diversity Index (GDI), which is defined as:
g ( n ) = 1 k p 2 ( k )
where g is the GDI, k is the possible classes and p is the fraction of classes with the correct classification that have reached a given node within a RF decision tree. An example RF tree using a three class problem (car, person, bike) and four features (x1, x2, x3, x4) can be seen in Figure 4. At each fork of the tree a decision is made on each sample based on a greater than or less than aspect of some of the selected features. At the leaf end of each branch the decision for each sample is indicated by the class. For example, if feature x3 is < 2.45 the sample will immediately be classified as a car by the first fork of the tree.

4. Data Analysis and Classification

The dataset generated by the Soprano radar system was created by a series of repeat measurements of four separate individuals (labelled A, B, C and D) walking within a closed room in a fixed pattern. The individuals walked up and down within the room directly parallel to the antenna‑pointing direction, following the longest wall in the room. The motion was completed with either no objects being carried or with a rucksack bag being held in both hands which weighed approximately 5 kg. This motion was repeated 93 times in total for all individuals. For each repeat measurement a single recording contained multiple passes of the person walking away and then towards the radar system over a 30 s period. An example Range Time Intensity (RTI) plot of a person walking backwards and forwards within the room can be seen within Figure 5; for this example, the person was walking free handed. The range values include the RF cabling lengths, hence, the target appears at a greater distance than the absolute straight-line distance from the antennas to the individual. The RTI shows that the person was detected within the scene, shown by the disturbance in the signatures at 2.5, 12 and 22.5 s close to the wall signature at 7 m. The RTI image is dominated by the very strong component from the wall reflection as well as the further down range sidelobes of this bright target. It is important to remove this component to enhance the dynamic range of the data dedicated only to moving targets within the scene and this was completed using a Moving Target Indicator (MTI) filter, defined in the previous section. A plot of an MTI processed dataset can be seen in Figure 6, using the same data as shown in Figure 5.
The effect of the MTI filter can be clearly seen in Figure 6, where the moving person target is clearly shown to increase and decrease in range as they walked back and forth within the room. The additional components at longer ranges (greater than 15 m) appear to follow the same slope as the main target and are considered to be generated by multipath due to the complex cluttered scene. The scene used for these experiments was particularly cluttered with lots of opportunity for multipath to be generated. Moreover, the external brick wall which consisted of an air cavity could have potentially contributed a significant amount of multipath, but this represents a real world scenario for the sensor.
The range data was then transformed into the Doppler domain using a Short Time Fourier Transform (STFT) technique. In order to complete this processing, the range bins the target was present within have been selected. A windowed short time FFT processing technique was then applied to these range bins, with a window length of 64 samples and a Hanning weighting. This resulted in a Doppler-time spectrogram that shows both the bulk Doppler component of the person’s velocity while walking away and towards the radar sensor, as well as the micro-Doppler components generated from swinging arms, legs, as well as the torso. Examples of micro-Doppler signatures from both RTI and MTI data can be seen in Figure 7 and Figure 8 for free handed walking and walking whilst carrying a bag in both hands, respectively.
The micro-Doppler data from the MTI signals was then systematically divided into sections of walking towards and walking away from the radar system, which over the full 30 s capture occurred multiple times. The MTI micro-Doppler result was used as it has the dominant zero frequency components removed, which does not contain information useful for motion characterization. The sectioning of the data was completed manually for this analysis, although it could be automated within further developed software. Each of these micro-Doppler sections have been analysed in order to evaluate the SVD components, for both the free handed and carrying case. For a real-time system this methodology would need to be streamlined by an automated computation method but for the offline processing that is being demonstrated within this work, an empirically manual selection was sufficient.
An example micro-Doppler section, the SVD u array and v array from a free handed motion can all be seen in Figure 9A–C respectively. The two SVD output matrices are very different in their appearance, they have been plotted as 10 × l o g 10 ( u ) and 10 × l o g 10 ( v ) to best visually demonstrate the dynamic range of the values obtained. The u matrix has strong components visible at the top and left hand edge, while maintaining a strong diagonal component throughout. The v matrix is more noise like, although at the left hand edge clear non-Gaussian features are visible; hence the feature extraction from this matrix has been isolated to only the first 10 columns of this matrix.
The evaluation of all the SVD matrices from each Doppler section away/towards was completed, and these matrices were then used to extract features that could be input into a classifier to evaluate how easily separable are the two different types of motion. The features that were extracted from the SVD profiles were as follows:
  • Sum of all the values within the first 100 rows within of the u matrix
  • Mean of the diagonal of the u matrix
  • Standard deviation of the diagonal of the u matrix
  • Standard deviation of the first ten columns of the u array
  • Standard deviation of the first ten columns of the v array
The numbering used here will continue through the remainder of the paper when referencing each individual feature. Example plots of four different paired combinations of the features listed above can be seen in Figure 10. This qualitatively demonstrates that some feature combinations are much more separable in the feature space than others. The feature pairs that were found to be more separable were features 3 vs. 2 and features 3 vs. 4, whereas features 1 vs. 4 were clearly the least separable.
These obtained features were then used as inputs to a given classifier. These feature have been selected as prior research [31], demonstrated that these values can be successfully used to classify different micro-Doppler motions in non-TTW scenarios. The total number of features extracted for all individuals was 1635 for the free hand walking case and 1470 for the bag carrying case, due to the reduced number of Doppler sections that could be extracted from the bag carrying case.
The first classifier that has been selected for this work was the DA classifier applied in two different variants: the diagonal-linear and diagonal-quadratic. The training stage of the classifier was applied using a randomly selected sub-section percentage of the full dataset features. The classifier was then tested on the remaining samples that were not used in the training process. In order to represent an average training success rate, this process was repeated using 100 Monte-Carlo simulations; all results shown are the average value from these repetitions. The classifier success rate was defined by the output confusion matrix, by summing all correctly indicated classes and dividing by the total number of events, putting no emphasis on either false positive or false negative errors. Different real world scenarios may require emphasis of either avoiding false positives or false negatives, but for this analysis they have been treated equally.
The results from applying the classifier to the separate data from persons A, B, C and D can be seen in Table 2. The training percentage was varied from 20% to 40% in steps of 5% as real classifiers are typically trained with percentages comparable to this. The linear-diagonal DA result was shown to be slightly more effective than the quadratic version averaged across training levels, but by only ~2%. The classifier performance for person C produced the best results, 14% or 16% better than the worst performing result for the linear and quadratic classifier, respectively. This clearly shows that the challenge of assessing if an individual is carrying an item will be strongly dependent on the person being observed; agreeing closely with prior research which has already shown that micro-Doppler signatures can vary significantly between different individuals [45].
The DA classifier was then applied to the joint dataset from all individuals to evaluate the overall performance (Figure 11). The results show a classification probability that is approximately an average of the individual results seen in Table 2. Within this result it is worth noting that there is little variation in the performance with increase in train set size, indicating that little additional benefit is gained from training with 20% to 40%. This shows that the previous classifier processing on the individual person data was still statistically significant and not significantly affected by the sample set size.
For comparison the RF classification process was applied to the same data from the four individuals independently, shown in Table 3. These results use all five features for each individual and can be compared directly to Table 2. The RF classifier is shown to be more effective than the DA method, with the greatest difference found for Person D, who showed a 25% increase in classification success rate. On average the RF was found to be 13% better than the DA across all individuals, which is very significant. The trend of classification success against training set size was found to have a greater gradient for the RF method on the joint data compared to the DA classifier. This shows that the RF methodology is more sensitive to the training set size but is able to achieve higher overall classification performance. It was found to benefit by 6% when training with 40% data in comparison to 20%.
The classifier results from the full dataset using features from all individuals is shown in Figure 12, which can be compared to the DA results in Figure 11. In this case, the RF classifier was tested using a range of input features from a single feature to all five features. The results shown are the highest percentage achieved by any combination of feature for the defined number of features allowed; the selected features are indicated in the legend. The increase in features used demonstrated diminishing returns or, in fact, reductions in success rates. It was found that higher success rates were achieved when using only three of the five potential features, for example, when training with 30% and 40%. This demonstrates that using more features is not necessarily the best way to approach optimizing this classification problem; effort should be placed on ensuring effective features are selected. On average the RF classifier was found to have 17% and 14% greater classification rate in comparison to the linear and quadratic DA classifiers, respectively. This is a significant difference and shows that SVD classification is possible in a TTW scenario, although the absolute level of success rate is far below an effective reliable solution that could be used in real world scenarios.
A final test was performed to investigate the effect that training data has on the RF classifier. The previous results show a clear difference in performance based on which individual’s actions are being classified. Therefore, analysis has been completed to evaluate how effective a classifier is when only data from a single person is used to train the classifier. The classifier was then tested on input features from the three remaining individuals. The results from this can be seen in Figure 13, where each different marker represent results from a classifier trained only on a specific individual. For this classification, all five features have been used. A significant reduction was found when compared to the five feature result in Figure 12, showing how person dependent the features extracted are. A focus of future analysis should be on isolating features that are as independent of individual as possible to ensure “blind” classification can be performed effectively on individuals that have not been used as part of the training process.

5. Conclusions

The experimental results shown have validated that the 5.8 GHz FMCW system Soprano is capable of detecting human targets through a real brick wall of a house. The MTI processing techniques allowed a significant improvement of SNR and micro-Doppler signatures and are thought to be vital to the pre-processing in order to successfully classify the motions. It was possible to analyse the individual human targets’ micro-Doppler signatures in this TTW configuration through the use of segmentation and feature extraction. The features were extracted using SVD analysis, which has been found to be suitable for TTW micro-Doppler characterization. Components of the SVD u and v matrices contained vital information regarding how the individual was moving during the measurements. The five SVD features were then successfully used as part of a classification process, by applying simple discriminate analysis and random forest algorithms with varying training set sizes and number of features. The DA and RF classifiers were shown to achieve successful classification rates of up 76% and 94% respectively. The performance of the random forest classifier was found to be more sensitive to training set size, whereas the discriminant analysis method showed little variation across training set sizes of 20% to 40%. The performance varied between each individual’s features, showing that these methods may be linked to how a person moves and for certain people it may be easier to differentiate between carrying and non-carrying situations. The performance of the RF classifier was also assessed when only trained on data from a single person while testing on features from the three other individuals. This was found to reduce the classifier performance by up to 25%, demonstrating how independent each person’s micro-Doppler signature is. These novel results show the potential of micro-Doppler SVD classification in a through wall scenario and confirm the significant potential this has for real-world scenarios. Future analysis will look to expand the overall available dataset to different geometries and wall thickness and to use more individuals to evaluate the resilience of this classification method to changes in these variables.

Acknowledgments

This work was funded by the EPSRC Impact Acceleration Account (IAA) award to UCL 2015-17 (Grant Reference EP/K503745/1). The authors are also grateful to EPSRC Bridging the Gap grant which funded the hardware, and the IET for the A F Harvey Prize 2013 awarded to Prof. Hugh Griffiths which partially funds this work. The authors would also like to thank Karl Woodbridge and Paul Brennan for their support.

Author Contributions

Matthew Ritchie was the lead author for this article and contributed to the experiments/analysis/classification work, Matthew Ash was lead developer for the hardware used and contributed to the experimental work presented, Qingchao Chen performed additional experimental analysis and classification and Kevin Chetty contributed to the experimental work and lead on acquiring the funding to enable this research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Amin, M.; Sarabandi, K. Special Issue on Remote Sensing of Building Interior. IEEE Trans. Geosci. Remote Sens. 2009, 47, 1267–1268. [Google Scholar]
  2. Baranoski, E.J. Through wall imaging: Historical perspective and future direction. IEEE ICASSP 2008 2008, 345, 5173–5176. [Google Scholar]
  3. Ferris, D.D.; Currie, N.C. Survey of current technologies for through-the-wall surveillance (TWS). Proc. SPIE 3577 Sens. C3I Inf. Train. Technol. Law Enforc. 1998, 3577, 62–72. [Google Scholar]
  4. Amin, M.G. Through-the-Wall Radar Imaging; CRC Press: Boca Raton, FL, USA, 2010. [Google Scholar]
  5. Savelyev, T.G.; Zhuge, X.; Yarovoy, A.G.; Ligthart, L.P.; Lerat, J.M.; Duchesne, L.; Fortuny-Guasch, J. Development of through-wall imaging radar with planar MIMO array. In Proceedings of the European Radar Conference (EuRAD), Manchester, UK, 12–14 October 2011; pp. 226–229.
  6. Martone, A.F.; Ranney, K.; Le, C. Noncoherent approach for through-the-wall moving target indication. IEEE Trans. Aerosp. Electron. Syst. 2014, 50, 193–206. [Google Scholar]
  7. Ralston, T.S.; Charvat, G.L.; Peabody, J.E. Real-time through-wall imaging using an ultrawideband multiple‑input multiple-output (MIMO) phased array radar system. In Proceedings of the 2010 IEEE International Symposium on Phased Array Systems and Technology (ARRAY), Waltham, MA, USA, 12–15 October 2010; pp. 551–558.
  8. Dehmollaian, M.; Thiel, M.; Sarabandi, K. Through-the-Wall Imaging Using Differential SAR. IEEE Trans. Geosci. Remote Sens. 2009, 47, 1289–1296. [Google Scholar]
  9. Chetty, K.; Smith, G.E.; Woodbridge, K. Through-the-wall sensing of personnel using passive bistatic wifi radar at standoff distances. IEEE Trans. Geosci. Remote Sens. 2012, 50, 1218–1226. [Google Scholar] [CrossRef]
  10. Yoon, Y.S.; Amin, M.G. High-Resolution Through-the-Wall Radar Imaging Using Beamspace MUSIC. IEEE Trans. Antennas Propag. 2008, 56, 1763–1774. [Google Scholar] [CrossRef]
  11. Leigsnering, M.; Debes, C.; Zoubir, A.M. Compressive sensing in through-the-wall radar imaging. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 22–27 May 2011; pp. 4008–4011.
  12. Smith, G.E.; Mobasseri, B.G. Robust Through-the-Wall Radar Image Classification Using a Target-Model Alignment Procedure. IEEE Trans. Image Process. 2012, 21, 754–767. [Google Scholar] [CrossRef] [PubMed]
  13. Yoon, Y.S.; Amin, M.G. Spatial filtering for wall-clutter mitigation in through-the-wall radar imaging. IEEE Trans. Geosci. Remote Sens. 2009, 47, 3192–3208. [Google Scholar] [CrossRef]
  14. Ram, S.S.; Christianson, C.; Kim, Y.; Ling, H. Simulation and analysis of human micro-Dopplers in through-wall environments. IEEE Trans. Geosci. Remote Sens. 2010, 48, 2015–2023. [Google Scholar] [CrossRef]
  15. Ram, S.S.; Ling, H. Through-wall tracking of human movers using joint doppler and array processing. IEEE Geosci. Remote Sens. Lett. 2008, 5, 537–541. [Google Scholar] [CrossRef]
  16. Kim, Y.; Ling, H. Through-Wall Human Tracking With Multiple Doppler Sensors Using an Artificial Neural Network. IEEE Trans. Antennas Propag. 2009, 57, 2116–2122. [Google Scholar] [CrossRef]
  17. Fairchild, D.P.; Narayanan, R.M. Classification of human motions using empirical mode decomposition of human micro-Doppler signatures. IET Radar, Sonar Navig. 2014, 8, 425–434. [Google Scholar] [CrossRef]
  18. Stove, A.G. Linear FMCW radar techniques. IEEE Proc. Radar Sonar Navig. 1992, 139, 343–350. [Google Scholar] [CrossRef]
  19. Maaref, N.; Millot, P.; Pichot, C.; Picon, O. FMCW ultra-wideband radar for through-the-wall detection of human beings. In Proceedings of the 2009 International Radar Conference, Bordeaux, France, 12 October 2009; pp. 1–5.
  20. Maaref, N.; Millot, P.; Pichot, C.; Picon, O. Ultra-wideband frequency modulated continuous wave synthetic aperture radar for through-the-wall localization. In Proceedings of the Microwave Conference EuMC 2009, Rome, Italy, 29 September–1 October 2009; pp. 1880–1883.
  21. Wang, F.K.; Horng, T.S.; Peng, K.C.; Jau, J.K.; Li, J.Y.; Chen, C.C. Seeing through walls with a self-injection-locked radar to detect hidden people. In Proceedings of the IEEE Microwave Symposium Digest (MTT), Montreal, QC, Canada, 17–22 June 2012; pp. 1–3.
  22. Wang, F.K.; Horng, T.S.; Peng, K.C.; Jau, J.K.; Li, J.Y.; Chen, C.C. Detection of concealed individuals based on their vital signs by using a see-through-wall imaging system with a self-injection-locked radar. IEEE Trans. Microw. Theory Tech. 2013, 61, 696–704. [Google Scholar] [CrossRef]
  23. Chen, V.C. Doppler Signatures of Radar Backscattering from Objects with Micro-Motions. IET Signal Process. 2008, 2, 291–300. [Google Scholar] [CrossRef]
  24. Chen, V.C.; Tahmoush, D.; Miceli, W.J. Radar Micro-Doppler Signatures: Processing and Applications; Institution of Engineering and Technology: London, UK, 2014. [Google Scholar]
  25. Chen, V.C.; Li, F.; Ho, S.S.; Wechsler, H. Micro-Doppler Effect in Radar: Phenomenon, Model, and Simulation Study. IEEE Trans. Aerosp. Electron. Syst. 2006, 42, 2–21. [Google Scholar] [CrossRef]
  26. Raj, R.G.; Chen, V.C.; Lipps, R. Analysis of Radar Human Gait Signatures. IET Signal Process. 2010, 4, 234–244. [Google Scholar] [CrossRef]
  27. Erol, B.; Gurbuz, S.Z. A kinect-based human micro-doppler simulator. IEEE Aerosp. Electron. Syst. Mag. 2015, 30, 6–17. [Google Scholar] [CrossRef]
  28. Youngwook, K.; Hao, L. Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine. IEEE Trans. Geosci. Remote Sens. 2009, 47, 1328–1337. [Google Scholar] [CrossRef]
  29. Perassoli, M.; Balleri, A.; Woodbridge, K. Measurements and analysis of multistatic and multimodal micro‑Doppler signatures for automatic target classification. In Proceedings of the IEEE Radar Conference, Cincinnati, OH, USA, 19–23 May 2014; pp. 324–328.
  30. Smith, G.E.; Woodbridge, K.; Baker, C.J.; Griffiths, H. Multistatic micro-Doppler radar signatures of personnel targets. IET Signal Process. 2010, 4, 224–233. [Google Scholar] [CrossRef]
  31. Fioranelli, F.; Ritchie, M.; Griffiths, H. Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features. IEEE Geosci. Remote Sens. Lett. 2015, 12, 1933–1937. [Google Scholar] [CrossRef]
  32. Fioranelli, F.; Ritchie, M.; Griffiths, H. Multistatic Human Micro-Doppler Classification of Armed/Unarmed Personnel. IET Radar Sonar Navig. 2015, 9, 857–865. [Google Scholar] [CrossRef]
  33. Li, X.; Liang, Q.; Lau, F.C. Sense-through-wall human detection using the UWB radar with sparse SVD. Phys. Commun. 2014, 13, 260–266. [Google Scholar] [CrossRef]
  34. Tivive, F.H.C.; Bouzerdoum, A. An improved SVD-based wall clutter mitigation method for through-the-wall radar imaging. In Proceedings of the Signal Processing Advances in Wireless Communications (SPAWC), Darmstadt, Germany, 16–19 June 2013; pp. 430–434.
  35. Ash, M.; Ritchie, M.; Chetty, K.; Brennan, P.V. A New Multistatic FMCW Radar Architecture by Over-the-Air Deramping. IEEE Sens. J. 2015, 15, 7045–7053. [Google Scholar] [CrossRef]
  36. Ash, M.; Ritchie, M.; Brennan, P.V.; Chetty, K. Over-the-air deramping for multi-static perimeter surveillance. In Proceedings of the IEEE International Radar Conference, Johannesburg, South Africa, 27–30 October 2015; pp. 61–65.
  37. Elad, M. Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing; Springer: New York, NY, USA, 2010. [Google Scholar]
  38. Badeau, R.; Richard, G.; David, B. Sliding window adaptive SVD algorithms. IEEE Trans. Signal Process. 2004, 52, 1–10. [Google Scholar] [CrossRef]
  39. Aharon, M.; Elad, M.; Bruckstein, A.M. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 2006, 54, 4311–4322. [Google Scholar] [CrossRef]
  40. Fisher, R.A. The use of multiple measurements in taxonomic problems. Ann. Hum. Genet. 1936, 7, 179–188. [Google Scholar] [CrossRef]
  41. Friedman, J.H.; Hastie, T.; Tibshirani, R. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed.; Springer: New York, NY, USA, 2009. [Google Scholar]
  42. Friedman, J.H. Regularized Discriminant Analysis. J. Am. Stat. Assoc. 1989, 84, 165–175. [Google Scholar] [CrossRef]
  43. Coppersmith, D.; Hong, S.J.; Hosking, J.R.M. Partitioning Nominal Attributes in Decision Trees. Data Min. Knowl. Discov. 1999, 3, 197–217. [Google Scholar] [CrossRef]
  44. Breiman, L.; Friedman, J.; Olshen, R.A.; Stone, C. Classification and Regression Trees; CRC Press: Boca Raton, FL, USA, 1984. [Google Scholar]
  45. Fioranelli, F.; Ritchie, M.; Grifftihs, H. Personnel Recognition Based on Multistatic Micro-Doppler and Singular Value Decomposition Features. IET Electron. Lett. 2015, 51, 2143–2145. [Google Scholar] [CrossRef]
Figure 1. Soprano radar block design.
Figure 1. Soprano radar block design.
Sensors 16 01401 g001
Figure 2. Geometry of the experimental setup showing individual walking up and down centrally within living room space and radar deployed at 43 cm distance.
Figure 2. Geometry of the experimental setup showing individual walking up and down centrally within living room space and radar deployed at 43 cm distance.
Sensors 16 01401 g002
Figure 3. Image of Soprano radar deployed outside of building.
Figure 3. Image of Soprano radar deployed outside of building.
Sensors 16 01401 g003
Figure 4. Random Forest Tree example.
Figure 4. Random Forest Tree example.
Sensors 16 01401 g004
Figure 5. Range Time Intensity (RTI) plot of individual walking with free hands measured through the wall.
Figure 5. Range Time Intensity (RTI) plot of individual walking with free hands measured through the wall.
Sensors 16 01401 g005
Figure 6. Moving Target Indicator (MTI) plot of individual walking with free hands measured through the wall.
Figure 6. Moving Target Indicator (MTI) plot of individual walking with free hands measured through the wall.
Sensors 16 01401 g006
Figure 7. Example Doppler-time spectrogram from a person walking free handed: (a) RTI micro-Doppler; (b) MTI micro-Doppler.
Figure 7. Example Doppler-time spectrogram from a person walking free handed: (a) RTI micro-Doppler; (b) MTI micro-Doppler.
Sensors 16 01401 g007
Figure 8. Example Doppler-time spectrogram from a person walking carrying a bag in both hands: (a) RTI micro-Doppler; (b) MTI micro-Doppler.
Figure 8. Example Doppler-time spectrogram from a person walking carrying a bag in both hands: (a) RTI micro-Doppler; (b) MTI micro-Doppler.
Sensors 16 01401 g008
Figure 9. (A) micro-Doppler section from free handed motion; (B) Singular Value Decomposition (SVD) u Array plotted as 10 × l o g 10 ( u ) from micro-Doppler section; (C) SVD v Array plotted as 10 × l o g 10 ( v ) from micro-Doppler section.
Figure 9. (A) micro-Doppler section from free handed motion; (B) Singular Value Decomposition (SVD) u Array plotted as 10 × l o g 10 ( u ) from micro-Doppler section; (C) SVD v Array plotted as 10 × l o g 10 ( v ) from micro-Doppler section.
Sensors 16 01401 g009
Figure 10. Four example plots of different features plotted against each other. The free hand motion features are shown as blue crosses, while the bag carrying features are shown as red circles.
Figure 10. Four example plots of different features plotted against each other. The free hand motion features are shown as blue crosses, while the bag carrying features are shown as red circles.
Sensors 16 01401 g010
Figure 11. All individuals Data DA Classifier: Classification accuracy plotted against percentage of training set size used.
Figure 11. All individuals Data DA Classifier: Classification accuracy plotted against percentage of training set size used.
Sensors 16 01401 g011
Figure 12. Data from all individuals: Random Forest Classification accuracy plotted against percentage of training set size used.
Figure 12. Data from all individuals: Random Forest Classification accuracy plotted against percentage of training set size used.
Sensors 16 01401 g012
Figure 13. Classification training on single person’s features and then tested on the remaining individuals.
Figure 13. Classification training on single person’s features and then tested on the remaining individuals.
Sensors 16 01401 g013
Table 1. Soprano radar parameters.
Table 1. Soprano radar parameters.
ParameterValue
Central Frequency5.8 GHz
Bandwidth83.5 MHz
Base-bandwidth125 kHz
Transmit Power13 dBm
Noise Figure2.5 dB
Antenna Beamwidth30° Azimuth 30° Elevation
Antenna Gain12 dBi
Table 2. Discriminant Analysis (DA) classifier results from each individual person.
Table 2. Discriminant Analysis (DA) classifier results from each individual person.
LinearQuadratic
Training %Training %
Person20253035402025303540
A59.760.960.663.662.158.658.058.159.161.3
B64.662.363.461.966.059.458.459.058.258.7
C76.275.377.076.376.174.475.775.275.374.3
D64.066.065.164.965.365.265.565.466.665.1
Table 3. Random Forest (RF) Classifier results from each individual person.
Table 3. Random Forest (RF) Classifier results from each individual person.
Random Forest
Training %
Person2025303540
A74.774.873.675.375.9
B63.465.464.162.765.4
C80.783.682.984.383.2
D87.893.492.691.292.3

Share and Cite

MDPI and ACS Style

Ritchie, M.; Ash, M.; Chen, Q.; Chetty, K. Through Wall Radar Classification of Human Micro-Doppler Using Singular Value Decomposition Analysis. Sensors 2016, 16, 1401. https://doi.org/10.3390/s16091401

AMA Style

Ritchie M, Ash M, Chen Q, Chetty K. Through Wall Radar Classification of Human Micro-Doppler Using Singular Value Decomposition Analysis. Sensors. 2016; 16(9):1401. https://doi.org/10.3390/s16091401

Chicago/Turabian Style

Ritchie, Matthew, Matthew Ash, Qingchao Chen, and Kevin Chetty. 2016. "Through Wall Radar Classification of Human Micro-Doppler Using Singular Value Decomposition Analysis" Sensors 16, no. 9: 1401. https://doi.org/10.3390/s16091401

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop