Next Article in Journal
The Campus as a Smart City: University of Málaga Environmental, Learning, and Research Approaches
Next Article in Special Issue
Measurement of the Chair Rise Performance of Older People Based on Force Plates and IMUs
Previous Article in Journal
Mechanical Behaviors Research and the Structural Design of a Bipolar Electrostatic Actuation Microbeam Resonator
Previous Article in Special Issue
Wearable Sensors System for an Improved Analysis of Freezing of Gait in Parkinson’s Disease Using Electromyography and Inertial Signals
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Multi-Path Compensation Method for Ranging in Wearable Ultrasonic Sensor Networks for Human Gait Analysis

by
Karalikkadan Ashhar
1,*,
Mohammad Omar Khyam
2 and
Cheong Boon Soh
1
1
School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
2
Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24060, USA
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(6), 1350; https://doi.org/10.3390/s19061350
Submission received: 15 February 2019 / Revised: 7 March 2019 / Accepted: 14 March 2019 / Published: 18 March 2019
(This article belongs to the Special Issue Wearable Sensors for Gait and Motion Analysis 2018)

Abstract

:
Gait analysis in unrestrained environments can be done with a single wearable ultrasonic sensor node on the lower limb and four fixed anchor nodes. The accuracy demanded by such systems is very high. Chirp signals can provide better ranging and localization performance in ultrasonic systems. However, we cannot neglect the multi-path effect in typical indoor environments for ultrasonic signals. The multi-path components closer to the line of sight component cannot be identified during correlation reception which leads to errors in the estimated range and which in turn affects the localization and tracking performance. We propose a novel method to reduce the multi-path effect in ultrasonic sensor networks in typical indoor environments. A gait analysis system with one mobile node attached to the lower limb was designed to test the performance of the proposed system during an indoor treadmill walking experiment. An optical motion capture system was used as a benchmark for the experiments. The proposed method gave better tracking accuracy compared to conventional coherent receivers. The static measurements gave 2.45 mm standard deviation compared to 10.45 mm using the classical approach. The RMSE between the ultrasonic gait analysis system and the reference system improved from 28.70 mm to 22.28 mm. The gait analysis system gave good performance for extraction of spatial and temporal parameters.

1. Introduction

Gait analysis is an important clinical tool to assess disorders due to neurovascular or musculoskeletal diseases and to study relations between gait and falls in the elderly population [1]. The gold standard system for human motion capture and gait analysis is an optical system with high-speed infrared cameras [2]. Optical motion tracking requires dedicated laboratories with controlled lighting conditions which makes this system unfit for unrestrained environments or a homely setup [3]. Non-traditional methods developed for human motion tracking include magnetic sensors [4], laser sensors [5,6], inertial measurement units [7,8], ultrawideband (UWB) ranging sensors [2,9], ultrasonic sensors [1,10] etc. Force sensing platforms or wearable force sensors can be used to the get ground reaction forces, the center of pressure and the joint moments [11]. Magnetic sensors are affected by the heterogeneity of the earth’s magnetic field and other ferromagnetic materials [12]. Laser sensors take a long time to take one sample of the whole scenario due to their scanning pattern [13]. Inertial sensors are affected by the drift during integration and fluctuating offset values and require sensor fusion to obtain accurate results [14]. UWB sensors demand high accuracy clock synchronization and high-cost ADCs to provide accurate ranging measurements [1]. Ultrasonic sensors can provide high accuracy time of flight (ToF) measurements without using expensive hardware as the wave travels much slower compared to electromagnetic waves and thus it can tolerate small errors in clock synchronization between the transmitting and receiving nodes [15]. A wireless portable and economic gait analysis system with only one ultrasonic marker attached to the lower limb was proposed by Qi et al. [14]. Here eight pulses of single tone frequency of 40 kHz were used for ranging. A net RMSE of 42.99 mm in 3-dimensional space was obtained compared to optical motion capture system [16]. A similar method was used for tracking both the lower limbs using spatial division multiple access in [10] where net RMSE for tracking each lower limb was less than 35 mm. In these methods, multipath components were removed by keeping an inhibit time after the reception. Time-of-Arrival (ToA) can be estimated in ranging sensors using different methods such as thresholding, cross-correlation with the originally transmitted signal or by comparing the phase of the received signal with the original. A phase-correlation method to improve the correlation performance was explained in [17], which requires higher SNR levels to provide satisfactory performance. The cross-correlation method is accurate and robust compared to other methods in a noisy environment [18]. As the noise increases, the performance of cross-correlation decreases if single-tone signals are used. Binary phase shift keying (BPSK) was used to code the transmitted signals in [19] to improve the cross-correlation performance. However, the performance degrades in time-varying fading channels [20]. A significant improvement in cross-correlation performance can be observed when linear frequency modulated signals are used [21,22]. A cross-correlation method with linear chirp signals can be used in the ultrasonic gait analysis system to improve the accuracy and robustness of the system in noisy environments [23]. The accuracy of cross-correlation increases with the bandwidth of the chirp signals [17]. Even though broadband ultrasonic sensors provide higher accuracy compared to narrowband ultrasonic sensors, these sensors come at a higher cost and operating voltage. Hence, we use narrowband piezoelectric transducers along with linear chirp signals for ranging in our experiments. In traditional correlation receivers, the time at which the peak of the correlation happens is used to estimate the ToF of the ultrasonic signal.
In a cluttered environment, the transmitted ultrasonic waves can travel in different paths to reach the receiver leading to multi-path interference. An earliest peak search method was implemented in [24] to remove multi-path interference, where the earliest peak of the correlation which is above the noise floor and which might not necessarily be the highest peak was considered as the correlation peak of the direct path. However, when the multi-path component lies closer to the line of sight (LOS) component so that the distance between the LOS and the Non-line of sight (NLOS) component is less than the range resolution of the signal, we cannot identify separate peaks in the correlation signal at the receiver. In this case, the peaks corresponding to LOS and the NLOS cannot be differentiated. A super-resolution technique based on MUSIC algorithm was implemented in [25,26,27]. The techniques based on MUSIC or matrix pencil [28] are computationally intensive as they involve the computation of each singular eigenvector and corresponding eigenvalue [27]. A phase-correlation method was implemented to get a sharp peak at the correlation output [17]. However, this method cannot be used in a noisy environment. Interpolation methods were used on the obtained correlation using narrowband chirp signals in [29,30] which cannot always provide accurate results and takes more time for analysis. In this paper a method to reduce the ranging errors caused by close multi-path interference is discussed.
We propose a novel multi-path compensation method for the ultrasonic indoor localization and gait analysis system. The contribution of this paper is the adaptation of the concept of half-peak detection from radio frequency systems [31] to indoor ultrasonic localization system and gait analysis and further extension of this idea. The idea of half-peak detection to reduce multi-path errors was never used in ultrasonic systems. We propose an earliest 1 m peak detection algorithm in ultrasonic localization system and use this for gait analysis. Initially, we do the simulation experiments followed by the ranging experiment and the gait analysis experiment with five healthy subjects and we compare the performance of the system with an optical motion tracking system.
The rest of the paper is organized as follows: Section 2 explains the proposed multi-path compensation method. Section 3 explains the simulations conducted and their results. Section 4 explains the setup used for the experiments with ultrasonic sensors and the gait analysis system. Results from the experiments, the performance of tracking and estimation of spatial and temporal parameters are mentioned in Section 5. Finally, conclusions from the work are explained in Section 6 with some suggestions for future work.

2. Proposed Method

In the proposed method, linear chirp signals are used for ranging. Chirp pulse compression is the process of transforming a long duration frequency modulated pulse into a narrow pulse with much higher amplitude. The pulse compression process can be considered as an application of matched filter system. Let g ( t ) be the impulse response of the transmitter coding filter. Then, the response of the matched filter at the receiver should be g * ( t ) , where g * ( ) represents the complex conjugate of g ( ) and the output of the matched filter receiver can be given as shown in Equation (1).
y ( t ) = g ( τ ) g * ( t τ ) d τ
In chirp compression process, consider g ( t ) as a linear chirp signal multiplied by a rectangular window function given by
g ( t ) = r e c t t T e 2 π j ( f 0 t + k t 2 / 2 )
From Equation (1), the output of chirp compression process, y ( t ) can be derived as
y ( t ) = T B × s i n ( π B t ) π B t × j e j 2 π ( f 0 t k t 2 / 2 )
where, T is the chirp duration, B is the chirp bandwidth and f 0 is the centre frequency. If we transmit a linear chirp signal with signal duration T seconds, the output, y ( t ) will be a waveform with sync characteristics with signal duration 2T seconds. In traditional ultrasonic ranging methods, the time at which the peak of y ( t ) happens is taken as an estimate of the ToF. The low cost, low power piezoelectric transducers comes with a narrow bandwidth around 40 kHz. We used MA40S4S/R transducers from MURATA Electronics which has a bandwidth of about 2 kHz. Hence, we selected the frequency range from 39 to 41 kHz. We selected linear chirp signals as they are robust in terms of Doppler sensitivity and frequency selective fading [32]. Non-linear chirp signals give better results when the time-bandwidth product is higher, which was 14 in our experiments. Also, non-linear chirps give higher side lobs in the presence of Doppler effect [33].
In the chirp compression process, the range resolution of an ultrasonic ranging sensor is the minimum separation of two targets ranging using the same signal that can be identified as separate targets from the received signals. The range resolution of the ultrasonic ranging in ideal case with a chirp signal multiplied by rectangular window function can be given by v / δ f , where v is the speed of sound and δ f is the bandwidth of chirp. In this study, we consider linear chirp signal from 39–41 kHz, thus δ f = 2 kHz and the range resolution was found to be 172 mm when the speed of sound was 345.3 m/s. If the extra path length of the multi-path component lies within 172 mm, which is quite likely to happen in a multi-path environment, there might not be two separate peaks and the resultant peak can be shifted in the time axis. The earliest peak detection algorithm explained in [24] fails here, leading to errors in the measured value. Let T p be the position of the peak value of correlation signal mentioned in Equation (1) and P 0 be the peak value. In a close multi-path environment, the position of the peak will be shifted to T p + X . Where X represents the error. Now, instead of taking P 0 to calculate the ToF, we propose to take P 0 m crossing point to the left of earliest peak instead of the actual peak of the absolute value of the correlation waveform to calculate the ToF. The earliest 1 m th peak will be less affected by the close multi-path components as the multi-path components travel a higher distance than the LOS path and hence appears time-shifted in the cross-correlation of the received signal with the originally transmitted signal. Since the correlation output at the receiver is sync signal with the chances of corruption by the multi-path components higher at the descending part of the main peak as shown in Figure 1, the chances of shift in time domain at the earliest 1 m peak point (ascending part of the main peak) will be less. In this work, the value of m is chosen out of 2, 3 and 4 by conducting simulations with 10,000 iterations with different multi-path components each time. However, P 0 m should be kept at a safe margin above the channel noise floor. We selected the value of m as 2, 3 and 4 for simulation experiments keeping m = 1 for conventional method and the best value was chosen for implementation in the proposed gait analysis system. The pictorial representation of the proposed method is shown in Figure 1. Since we are removing any constant offset which is present in the range measurement, we are concerned only about the relative distance between two range measurements of the same transmitter. Even though the existence of a close multi-path shifts the time at which the correlation peak happens, the earliest 1 m × peak point will be less affected compared to the actual peak. The chirp signals can be multiplied with various kinds of window functions to increase the sensitivity and to reduce the amplitude of side lobes in the signal [34]. We test the performance of three different window functions (rectangular, hamming and hann) along with the proposed method. Let S ( t ) be the transmitted chirp signal multiplied by the window function, W ( t ) given by Equation (4).
S ( t ) = W ( t ) × e x p j 2 π f s t + 1 2 ( f e f s ) t 2 + ϕ
where, f s , f e and ϕ represents the starting frequency, the ending frequency and the initial phase respectively. The received signal without any multi-path components can be represented as
S ^ ( t ) = A 0 ( h ( t ) * S ( t ) )
where, A 0 , h ( t ) and * represents the amplitude after path loss, channel impulse response and the convolution operator respectively. Considering M multi-path components, the correlation of received signal can be given by Equation (6).
C ( t ) = S ^ ( t ) S ( t ) + ( m = 1 M A m S ^ ( t τ m ) + n ( t ) ) S ( t )
where, ⋆, n ( t ) , A m and τ m represents the correlation operator, channel noise, the amplitude and the extra path travelled by the multi-path components respectively. In Equation (6), the actual ToA information from LOS path is embedded in the first term. The second term in Equation (6) is the multi-path noise. Our hypothesis is that the earliest point at which the value of C ( t ) crosses 1 m (where, m > 1 ) of the peak of C ( t ) will be less affected by the multi-path components (the second term in Equation (6)) in time axis compared to the peak of C ( t ) . This is because the multi-path components appear at a later time compared to the LOS path.

Doppler Compensation in the Received Signal

Moving sensor nodes emitting ultrasonic waves create Doppler effect and this alters the actual range measurements. A Doppler compensation method with linear up- and down-chirp signals was explained in [23]. Even though linear chirp signals show higher Doppler-tolerance, range-Doppler coupling leads to an error which is proportional to the moving velocity. For down-chirp signals, the error due to Doppler effect will be the same in magnitude with different polarity to that of up-chirp signals. In our experiments, in each ranging cycle of 40 ms, ranging with up-chirp was conducted in the initial 20 ms and with down-chirp in the next 20 ms duration. The chirp duration was selected as 7 ms as we allocated 20 ms for up-chirp and 20 ms for down-chirp and out of 20 ms, 13 ms time was provided between two signals so that the echo will die out completely. Let R 1 , R 2 and R 0 be the range estimated from the up-chirp, down-chirp and the actual range respectively. Then,
R 1 = R 0 + R ˙ × f 0 T / B R 2 = R 0 R ˙ × f 0 T / B R 0 = ( R 1 + R 2 ) / 2
where R ˙ represents the Doppler velocity of the moving target.

3. Simulation Results

A customized ranging environment with one transmitter and one receiver was simulated in Matlab to test the performance of the multi-path compensation technique. The amplitude of signal after attenuation in air was modeled as A = A 0 e γ × δ d , where A 0 and δ d are the originally transmitted amplitude and the distance traveled through the medium respectively. The value of attenuation constant, γ was selected as 0.17 Np/m. The ranging was done with a chirp signal with linearly increasing frequency from 39 to 41 kHz in 7 ms. In order to test the performance of other non-linear chirp signals, a simulation was conducted to find the performance of linear, logarithmic and quadratic chirp signals to estimate the Doppler-velocity using the method explained in Section 2.1 with 1000 iterations. The results show that the performance of the linear chirp was better than the logarithmic and quadratic chirp signals. A close multi-path component (NLOS1) with a reflection coefficient of 0.9 was provided at random positions so that the difference between the LOS and the NLOS was less than the range resolution which is 172 mm in this case. The relative distance between two LOS values which were set to 1000 mm and 2000 mm respectively was calculated to find the improvement in ranging accuracy using our proposed method and the classical peak detection method. A Monte Carlo simulation with 10,000 iterations was done to estimate the distance at each position with different multi-path reflections. We selected the time index at which the cross-correlation of the received signal with the original signal crosses 1 m of its earliest peak value for the first time as an estimate for the LOS path. The plots of the correlation waveform from the LOS, NLOS and the combined signal with m = 2, 3 and 4 points marked are shown in Figure 1.
The results obtained when the transmitted signals are multiplied by three different kinds of window functions are as shown in Table 1, where, I av , I max , D av and D max represent the average improvement, maximum improvement, average degradation, and maximum degradation in absolute error compared to peak detection respectively. Out of 10,000 iterations, N ( I ) and N ( D ) are the number of cases with improvement and degradation respectively and the ratio of average improvement to average degradation was calculated as R = I av / D av . In order to find the changes in the ratio, R as the value of m changes, we repeated the same simulation experiment with 10,000 iterations and a rectangular window function with 10 dB channel SNR for each value of m increasing from 1 to 4 in steps of 0.1 and the plot of R against m was shown in Figure 2. It can be observed that R slightly decreases after m = 1.9 as the value of m increases. We can also observe a sudden increase in R as m changes from 1 to 1.1.
We found that the “hann” and “hamming” windows showed better results in terms of the ratio, R for m = 3 and 4. This can be explained by lower side lobs obtained for the correlation output y(t). With the attenuated side lobs, the time shift by the multi-path component in the 1 m peak also decreases thus resulting in better R values. However, it should be noted that as the value of m increases, the estimate is getting closer to the noise floor and chances of errors and D max also increase. Hence, optimum value of m depends on the peak value of cross correlation and noise power. It can also be observed that the maximum degradation of the accuracy is higher for “hann” and “hamming” windows.
The plot of average improvement and average degradation in the absolute error while ranging with linear chirp signals multiplied with rectangular window and a channel with 10 dB SNR is shown in Figure 3.
The Empirical Cumulative Distribution Function (ECDF) for the errors in range estimation from the proposed method and the conventional peak detection method was calculated for rectangular window function and m = 2 and plotted in Figure 4. The plot shows that the proposed method outperforms the conventional peak detection method in a high multi-path environment. Thus, we selected m = 2 and a rectangular window function at the transmitter side for our tests using ultrasonic sensors for further analysis.

4. Materials and Methods

Initially, we conduct ranging experiments with one static transmitter and receiver in an indoor environment followed by the gait analysis experiment with four fixed receivers and one mobile node. Murata MA40S4S and MA40S4R ultrasonic transducers are used for ranging with chirp signals. These sensors have a narrow bandwidth with 40 kHz center frequency. The transmitter node was designed on an STM32F4-discovery development board which has a form factor, 66 mm × 97 mm. However, in the future, this system can be printed on a flexible wearable band to make it easier and unobtrusive to use. The mobile node was powered by an 11.1v Li-Po battery and a 5v voltage regulator. So the driving voltage of the ultrasonic transmitter was 11.1v. No wired connections were limiting the movement of the subject as we used wireless clock synchronization between the mobile node and the anchor nodes using 2.4 GHz wireless modules. The attachment of the mobile node to the lower limb is as shown in the Figure 5. The chirp signals were stored in the memory of the development board and are sent periodically to the transmitters through digital to analog converters and a driver IC (SN754410) using direct memory access. At the receiver side, we used a bandpass filter, an amplifier and a data acquisition board. ADCs with the same resolution (which was 125 kilo-samples/s in our experiments) can replace the data acquisition board in the future.
The power consumption of the mobile node is important in wireless sensors nodes as the mobile nodes are battery powered. Here the main part of power consumption comes from the memory access and the driving of ultrasonic transducers. We used STM32F4-discovery board to develop the sensor node and SN754410 as the driver for MA40S4S transmitter. Murata MA40S4S transmitters have 120 dB Sound Pressure Level (SPL) at 40 kHz (where, 0 dB = 0.02 mPa). An 11.1v battery and IC-SN754410 drove these transmitters. At ambient temperature, the absolute maximum continuous power dissipation in the driver IC is 2.075 W from the datasheet. The power dissipation in the development board assuming dynamic run mode at 180 MHz clock frequency is 0.22 W. The total power consumption is 2.295 W. Hence, the total energy required for one ranging cycle is 0.0918 J. Here we neglected the power consumption in the voltage regulators. In the future, custom designed circuits can greatly reduce the power consumption.
An optical motion capture system with six high-speed infrared cameras were used as the reference for the experiments. The reference system was calibrated for static and dynamic conditions and the accuracy was found to be 0.36 ± 17 mm. Reflective markers were used for this system.

4.1. Ultrasonic Ranging Experiment

For ranging experiment we used both up-chirp and down-chirp and the average value was calculated using the proposed half peak method (m = 2) and classical peak detection method. The transmitted signals were multiplied by rectangular window functions. Measurements were taken with ten different positions of the transducers each for a low multi-path environment and a high multi-path environment. In the low multi-path environment, the transducers were placed about 750 mm above the ground with a line of sight and without any obstacles in the vicinity. In the high multi-path environment, three obstacles with flat surface were introduced near the transmission path to reflect the ultrasonic waves.

4.2. Gait Analysis System

A wireless gait analysis system was designed to test the proposed method. An ultrasonic mobile node was attached to the left lower limb of the subject as shown in Figure 5. For spherical localization, four static anchor nodes at the corners of a 250 × 200 mm rectangle were mounted on a vertical board and kept parallel to the sagittal plane at about 1000 mm from the treadmill as shown in Figure 6. The reflective markers of the motion capture system were attached beside the ultrasonic transmitters and the receivers and the offsets between the markers and ultrasonic transducers were adjusted during the post-processing. Five healthy subjects (four males and one female) with age in between 24 to 31 were recruited for the gait analysis study. Each subject was asked to do a treadmill walk for one minute for each walking speed of 1, 2 and 3 kph with both the ultrasonic mobile node and the camera marker attached to one lower limb. All participants gave their informed consent for inclusion before they participated in the study.
Doppler shift affects the performance of the system. We took the average of range estimated from linearly increasing and decreasing chirp signals to offset these errors as explained in Section 2.1 [23]. Each ranging cycle consists of two ranging each with 20 ms duration, first one with an up-chirp from 39 to 41 kHz in 7 ms and second one with a down-chirp from 41 to 39 kHz in 7 ms. A separation of 13 ms was thus provided between any transmitted signals. Thus the total update rate of the system was about 25 Hz. Both half peak detection method m = 2 and classical peak detection method were implemented for all the range measured from all the four ultrasonic anchor nodes in the gait analysis system. The state space equation for calculating the x, y and z coordinates from the measured distances is shown in the Equation (8).
X i = A X i 1 + q i 1 Y i = g ( X i ) + r i
where, A and g ( X i ) are the state transition matrix and the non-linear output function given by Equation (9).
A = I T × I 0 T , g ( X i ) = ( x i x 1 ) 2 + ( y i y 1 ) 2 + ( z i z 1 ) 2 ( x i x 2 ) 2 + ( y i y 2 ) 2 + ( z i z 2 ) 2 ( x i x 3 ) 2 + ( y i y 3 ) 2 + ( z i z 3 ) 2 ( x i x 4 ) 2 + ( y i y 4 ) 2 + ( z i z 4 ) 2
Here, I is a 3 × 3 diagonal matrix and x 1 , 2 , 3 , 4 , y 1 , 2 , 3 , 4 and z 1 , 2 , 3 , 4 represents the coordinates of the anchor nodes. The process noise and the measurement noise are given by q i and r i respectively which are designed as Gaussian function with noise co-variances Q and R respectively. Here, R = d i a g ( e 2 , e 2 , e 2 , e 2 ) and e was set to 5 mm in our system. The state matrix, X i = [ x i y i z i x i ˙ y i ˙ z i ˙ ] T and measurement matrix, Y i = [ d 1 , i d 2 , i d 3 , i d 4 , i ] T where x i , y i , z i , x i ˙ , y i ˙ and z i ˙ represents the three dimensional coordinates and the velocities along the directions and d 1 , i , d 2 , i , d 3 , i and d 4 , i represents the measured distances from each anchor nodes at ith instance. An Unscented Kalman Filter (UKF) [35] along with an Unscented Raunch-Tung Striebel smoother [36] was implemented to obtain the three dimensional trajectory from the measured distances and the state space equation explained in Equation (8). All the trajectories were low pass filtered using a butter-worth filter with cut off frequency 10 Hz. The reader can refer [23] for further details of the filters applied.

4.3. Estimation of Gait Parameters

We estimated the spatial and temporal gait parameters from the 3D coordinates of one lower limb. The estimation of some gait parameters from the x and z coordinates of a single gait cycle is as shown in the Figure 7. The peaks in the x-coordinate can be assumed as the heel-strikes and the troughs in the x-coordinate can be assumed as the toe-off points [16]. The following parameters were extracted:

4.3.1. Stride Time (ST)

Stride Time is defined as the time taken from one heel-strike to the next heel-strike of the same foot and is given by the time between two minimum points of the x-coordinate.
S T ( i ) = T i m e ( m i n i + 1 ( x ) ) T i m e ( m i n i ( x ) )

4.3.2. Stride Length (SL)

Stride length is defined as the distance covered in one stride and can be estimated as twice the difference between the maximum and the minimum point of x-coordinate.
S ( i ) = m a x i ( x ) m i n i ( x ) S L ( i ) = 2 × S ( i )

4.3.3. Swing Time (SW)

Time taken from the toe off to next heel strike is defined as swing time.
S W ( i ) = T i m e ( m a x i ( x ) ) T i m e ( m i n i ( x ) )

4.3.4. Stance Time (STT)

Time taken from the heel strike to next toe off is defined as stance time.
S T T ( i ) = T i m e ( m i n i + 1 ( x ) ) T i m e ( m a x i ( x ) )

4.3.5. Maximum Foot Clearance (MFC)

The foot elevation during swing phase is termed as foot clearance. Maximum foot clearance is the difference between the maximum and the minimum points of z-coordinate during one cycle.
M F C ( i ) = m a x i ( z ) m i n i ( z )

5. Results and Discussion

Static measurements were taken with one transmitter and one receiver placed at 10 different positions each for a high multi-path and relatively low multi-path environments. The first measurement was subtracted from the remaining nine measurements to obtain the differential distances. The differential distance calculated from the proposed and the classical peak detection method was compared to the camera distance measurements to obtain the mean error. The standard deviation of distance calculated at each static position was also calculated. The results are provided in Table 2.
It can be observed that the we were able to get consistent and considerable improvement in the tracking accuracy using the proposed method. In both high and low multi-path conditions, the average standard deviation for static measurements decreased considerably from 10.44 mm in classical method to 2.45 mm in the proposed method. Figure 8 shows the static measurement reading obtained from the classical peak detection and the proposed half-peak detection methods after removing the offset between the measurements. It is evident that the proposed method provides stable measurements readings compared to the classical method.
The mean error and standard deviation of error (STD Error) and root mean square error (RMSE) between the ultrasonic system and the camera system are provided in Table 3. Any temporal delay between the foot trajectory from the ultrasonic system and the the camera system was removed before analysis. The net RMSE from the proposed method was found to be 22.28 mm compared to 28.70 mm from the classical peak detection method

Comparison of Estimated Gait Parameters

To quantify the performance of the proposed system with respect to the reference system, the mean, the standard deviation and the RMSE between the parameters from both the systems during treadmill walk with walking speed 3 kph are calculated and listed in Table 4. The proposed system gave good results for estimation of stance time, swing time and maximum foot clearance. However, our system slightly over-estimated the stride length consistently for all the subjects. This can be solved by removing the constant offset value from all the measurements. A Wilcoxon rank sum test was conducted to test the hypothesis that the gait parameters estimated from the ultrasonic and camera system came from a continuous distribution with equal medians for each subject. The tests failed to reject the null hypothesis with p > 0.05 for all subjects. In the case of stride length, the constant trend was removed before testing the hypothesis.

6. Conclusions

A new method of multi-path tolerant ultrasonic ranging and localization was proposed. The simulation experiments with earliest 1 m value detection shows that m = 3 and 4 performed better in terms of ratio, R, when the transmitted wave is multiplied by a “hann” or a “hamming” window. However, the maximum value of degradation increased for these window functions and m values. We implemented the half peak detection method with m = 2 and a rectangular window function on chirp signals and ultrasonic transducers. The proposed half-peak detection was found to perform better than the classical peak detection for coherent receiver in ultrasonic ranging system with static transducers as well as the localization system for gait analysis with one moving transmitter. The gait analysis system with one ultrasonic marker attached to one lower limb was found to give better results with net RMSE 22.28 mm for the proposed method compared to 28.70 mm for the classical method. The system gave good results for the estimation of spatial and temporal parameters from the proposed system. In future, the effects of SNR and different values of m on the ranging performance can be studied. The use of multiple sensors to increase the capture volume or use of cone-reflector to make the ultrasonic signals omni-directional [37] are also potential research opportunities in the future.

Author Contributions

This work was completed with contribution from all three authors. C.B.S. proposed the research idea with regular feedbacks of suggestions and supervision. M.O.K. helped in the conceptualization of the project. K.A. conducted the simulation studies, worked on the associated collection of data with laboratory experiments and original draft preparation. All authors did edit, review and improve the manuscript.

Funding

NTU Research Scholarship partially funded this research.

Acknowledgments

We acknowledge and thank all the subjects participated in the gait experiments and the lab technician of motion analysis laboratory.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
LOSLine of Sight
NLOSNon-Line of Sight
RMSERoot Mean Square Error
UKFUnscented Kalman Filter
ToFTime of Flight
UWBUltrawideband
ADCAnalog to Digital Converter
MUSICMultiple Signal Classification

References

  1. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S. Ambulatory measurement of three-dimensional foot displacement during treadmill walking using wearable wireless ultrasonic sensor network. IEEE J. Biomed. Health Inform. 2015, 19, 446–452. [Google Scholar] [CrossRef] [PubMed]
  2. Shaban, H.A.; El-Nasr, M.A.; Buehrer, R.M. Toward a highly accurate ambulatory system for clinical gait analysis via UWB radios. IEEE Trans. Inf. Technol. Biomed. 2010, 14, 284–291. [Google Scholar] [CrossRef]
  3. Bamberg, S.J.M.; Benbasat, A.Y.; Scarborough, D.M.; Krebs, D.E.; Paradiso, J.A. Gait analysis using a shoe-integrated wireless sensor system. IEEE Trans. Inf. Technol. Biomed. 2008, 12, 413–423. [Google Scholar] [CrossRef] [PubMed]
  4. Van den Noort, J.C.; Ferrari, A.; Cutti, A.G.; Becher, J.G.; Harlaar, J. Gait analysis in children with cerebral palsy via inertial and magnetic sensors. Med. Biol. Eng. Comput. 2013, 51, 377–386. [Google Scholar] [CrossRef] [PubMed]
  5. Pallejà, T.; Teixidó, M.; Tresanchez, M.; Palacín, J. Measuring gait using a ground laser range sensor. Sensors 2009, 9, 9133–9146. [Google Scholar] [CrossRef] [PubMed]
  6. Phan Ba, R.; Pierard, S.; Moonen, G.; Van Droogenbroeck, M.; Belachew, S. Detection and quantification of efficiency and quality of gait impairment in multiple sclerosis through foot path analysis. Mult. Scler. J. 2012, 18, 110. [Google Scholar]
  7. Peruzzi, A.; Della Croce, U.; Cereatti, A. Estimation of stride length in level walking using an inertial measurement unit attached to the foot: A validation of the zero velocity assumption during stance. J. Biomech. 2011, 44, 1991–1994. [Google Scholar] [CrossRef] [PubMed]
  8. Seel, T.; Raisch, J.; Schauer, T. IMU-based joint angle measurement for gait analysis. Sensors 2014, 14, 6891–6909. [Google Scholar] [CrossRef]
  9. Ashhar, K.; Soh, C.B.; Kong, K.H. Wireless Ultrawideband Sensor Network for Gait Analysis in Rehabilitation Clinics. In Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan, 7–10 October 2018; pp. 1524–1529. [Google Scholar]
  10. Ashhar, K.; Soh, C.B.; Kong, K.H. A wearable ultrasonic sensor network for analysis of bilateral gait symmetry. In Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea, 14 September 2017; pp. 4455–4458. [Google Scholar]
  11. Zheng, H.; Black, N.D.; Harris, N.D. Position-sensing technologies for movement analysis in stroke rehabilitation. Med. Biol. Eng. Comput. 2005, 43, 413–420. [Google Scholar] [CrossRef]
  12. Raab, F.H.; Blood, E.B.; Steiner, T.O.; Jones, H.R. Magnetic position and orientation tracking system. IEEE Trans. Aerosp. Electron. Syst. 1979, 709–718. [Google Scholar] [CrossRef]
  13. Abadia, M.F.; Sillero-Quintana, M.; Calvo, P.A.M. Applying Topographic Techniques to Modelling the Human Shape in Motion. In Proceedings of the Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007), Chongqing, China, 10–12 December 2007; pp. 169–172. [Google Scholar]
  14. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Thomas, R. Assessment of foot trajectory for human gait phase detection using wireless ultrasonic sensor network. IEEE Trans. Neural Syst. Rehabil. Eng. 2016, 24, 88–97. [Google Scholar] [CrossRef]
  15. Khyam, M.O.; Alam, M.J.; Lambert, A.J.; Benson, C.R.; Pickering, M.R. High precision ultrasonic positioning using a robust optimization approach. In Proceedings of the 2013 18th International Conference on Digital Signal Processing (DSP), Fira, Greece, 1–3 July 2013; pp. 1–6. [Google Scholar]
  16. Qi, Y. Wearable Human Motion Tracking and Analysis System Based on Wireless Sensor Network. Ph.D. Thesis, School of Electrical and Electronic Engineering, Nanyang Technological University, Hong Kong, China, 2015. [Google Scholar]
  17. Khyam, M.O.; Ge, S.S.; Li, X.; Pickering, M.R. Highly accurate time-of-flight measurement technique based on phase-correlation for ultrasonic ranging. IEEE Sens. J. 2017, 17, 434–443. [Google Scholar] [CrossRef]
  18. Queiros, R.; Alegria, F.C.; Girao, P.S.; Serra, A.C. Cross-correlation and sine-fitting techniques for high-resolution ultrasonic ranging. IEEE Trans. Instrum. Meas. 2010, 59, 3227–3236. [Google Scholar] [CrossRef]
  19. Piontek, H.; Seyffer, M.; Kaiser, J. Improving the accuracy of ultrasound-based localisation systems. Pers. Ubiquitous Comput. 2007, 11, 439–449. [Google Scholar] [CrossRef]
  20. Khyam, M.O.; Noor-A-Rahim, M.; Li, X.; Ritz, C.; Guan, Y.L.; Ge, S.S. Design of Chirp Waveforms for Multiple-Access Ultrasonic Indoor Positioning. IEEE Sens. J. 2018, 18, 6375–6390. [Google Scholar] [CrossRef]
  21. Salemian, S.; Keivani, H.; Mahdiyar, O. Comparison of radar pulse compression techniques. In Proceedings of the 2005 IEEE International Symposium on Microwave, Antenna, Propagation and EMC Technologies for Wireless Communications, Beijing, China, 8–12 August 2005; Volume 2, pp. 1076–1079. [Google Scholar]
  22. Atkins, P.; Collins, T.; Foote, K. Transmit-signal design and processing strategies for sonar target phase measurement. IEEE J. Sel. Top. Signal Process. 2007, 1, 91–104. [Google Scholar] [CrossRef]
  23. Ashhar, K.; Khyam, M.; Soh, C.; Kong, K. A Doppler-Tolerant Ultrasonic Multiple Access Localization System for Human Gait Analysis. Sensors 2018, 18, 2447. [Google Scholar] [CrossRef]
  24. Saad, M.M.; Bleakley, C.J.; Dobson, S. Robust high-accuracy ultrasonic range measurement system. IEEE Trans. Instrum. Meas. 2011, 60, 3334–3341. [Google Scholar] [CrossRef]
  25. Farrokhi, H. TOA estimation using MUSIC super-resolution techniques for an indoor audible chirp ranging system. In Proceedings of the 2007 IEEE International Conference on Signal Processing and Communications, Dubai, UAE, 24–27 November 2007; pp. 987–990. [Google Scholar]
  26. Yamada, H.; Ohmiya, M.; Ogawa, Y.; Itoh, K. Superresolution techniques for time-domain measurements with a network analyzer. IEEE Trans. Antennas Propag. 1991, 39, 177–183. [Google Scholar] [CrossRef]
  27. Hasan, M.A.; Azimi-Sadjadi, M.R.; Dobeck, G.J. Separation of multiple time delays using new spectral estimation schemes. IEEE Trans. Signal Process. 1998, 46, 1580–1590. [Google Scholar] [CrossRef] [Green Version]
  28. Hua, Y.; Sarkar, T.K. On SVD for estimating generalized eigenvalues of singular matrix pencil in noise. In Proceedings of the IEEE International Sympoisum on Circuits and Systems, Singapore, 11–14 June 1991; pp. 2780–2783. [Google Scholar]
  29. De Angelis, A.; Moschitta, A.; Carbone, P.; Calderini, M.; Neri, S.; Borgna, R.; Peppucci, M. Design and characterization of a portable ultrasonic indoor 3-D positioning system. IEEE Trans. Instrum. Meas. 2015, 64, 2616–2625. [Google Scholar] [CrossRef]
  30. Marioli, D.; Narduzzi, C.; Offelli, C.; Petri, D.; Sardini, E.; Taroni, A. Digital time-of-flight measurement for ultrasonic sensors. IEEE Trans. Instrum. Meas. 1992, 41, 93–97. [Google Scholar] [CrossRef] [Green Version]
  31. Huang, Y. A Study of RF-Over-Fibre Based Active RFID Indoor Location System. Ph.D. Thesis, UCL (University College London), London, UK, 2011. [Google Scholar]
  32. Virolainen, T.; Eskelinen, J.; Hæggström, E. Frequency domain low time-bandwidth product chirp synthesis for pulse compression side lobe reduction. In Proceedings of the 2009 IEEE International Ultrasonics Symposium, Rome, Italy, 20–23 September 2009; pp. 1526–1528. [Google Scholar] [CrossRef]
  33. Misaridis, T.; Jensen, J.A. Use of modulated excitation signals in medical ultrasound. Part I: Basic concepts and expected benefits. IEEE Transa. Ultrasonics Ferroelectr. Freq. Control 2005, 52, 177–191. [Google Scholar] [CrossRef]
  34. Gan, T.; Hutchins, D.; Billson, D.; Schindel, D. The use of broadband acoustic transducers and pulse-compression techniques for air-coupled ultrasonic imaging. Ultrasonics 2001, 39, 181–194. [Google Scholar] [CrossRef]
  35. Julier, S.J.; Uhlmann, J.K. New extension of the Kalman filter to nonlinear systems. In Proceedings of the Signal processing, sensor fusion, and target recognition VI. International Society for Optics and Photonics, Orlando, FL, USA, 28 July 1997; Volume 3068, pp. 182–194. [Google Scholar]
  36. Särkkä, S. Unscented Rauch–Tung–Striebel Smoother. IEEE Trans. Autom. Control 2008, 53, 845–849. [Google Scholar] [CrossRef]
  37. Wang, C.; Xiao, L. Sensor localization under limited measurement capabilities. IEEE Netw. 2007, 21, 16–23. [Google Scholar] [CrossRef]
Figure 1. The envelope of correlation for LOS, one NLOS component (NLOS1) and the combined waveform.
Figure 1. The envelope of correlation for LOS, one NLOS component (NLOS1) and the combined waveform.
Sensors 19 01350 g001
Figure 2. The plot showing variation of R as the value of m increases for a rectangular window function.
Figure 2. The plot showing variation of R as the value of m increases for a rectangular window function.
Sensors 19 01350 g002
Figure 3. The plot showing average improvement and degradation in absolute error with the proposed method as the value of m changes.
Figure 3. The plot showing average improvement and degradation in absolute error with the proposed method as the value of m changes.
Sensors 19 01350 g003
Figure 4. The Empirical CDF calculated for ranging error using half peak detection method and conventional peak detection method.
Figure 4. The Empirical CDF calculated for ranging error using half peak detection method and conventional peak detection method.
Sensors 19 01350 g004
Figure 5. The mobile node and camera marker attached to left lower limb.
Figure 5. The mobile node and camera marker attached to left lower limb.
Sensors 19 01350 g005
Figure 6. The anchor nodes attached on a vertical board along with the anchor nodes.
Figure 6. The anchor nodes attached on a vertical board along with the anchor nodes.
Sensors 19 01350 g006
Figure 7. Estimation of gait parameters from a single gait cycle.
Figure 7. Estimation of gait parameters from a single gait cycle.
Sensors 19 01350 g007
Figure 8. The static measurements obtained from the ultrasonic system using the classical and the proposed methods.
Figure 8. The static measurements obtained from the ultrasonic system using the classical and the proposed methods.
Sensors 19 01350 g008
Table 1. Comparison of improvement and degradation of tracking performance of the system with earliest 1/m peak detection.
Table 1. Comparison of improvement and degradation of tracking performance of the system with earliest 1/m peak detection.
Windowm I av (mm) D av (mm) I max (mm) D max (mm)N(I)N(D)R
Rectangular214.88.455.835.9689730461.76
316.810.163.444.1682631171.66
418.212.468.355.2661433361.47
Hann221.610.9104.8116.5712928261.98
324.612.2119.3253.7713528252.01
426.514.2118.6446712528421.87
Hamming222.21097.969.6736526032.22
325.911.3120129.6730026602.29
427.712.4117.9253.8731026542.24
Table 2. Comparison of mean error in differential distance ( M E ) calculated from the proposed and the classical methods and the standard deviation in the static measurement using up-chirp ( S u ) and down-chirp ( S d ).
Table 2. Comparison of mean error in differential distance ( M E ) calculated from the proposed and the classical methods and the standard deviation in the static measurement using up-chirp ( S u ) and down-chirp ( S d ).
MethodHigh Multi-Path (mm)Low Multipath (mm)
ME S u S d ME S u S d
Proposed26.632.662.617.702.272.26
Classical44.1010.3410.4122.2410.6810.32
Table 3. Comparison of error in estimated coordinates from proposed and classical methods.
Table 3. Comparison of error in estimated coordinates from proposed and classical methods.
MethodProposed Method (mm)Classical Method (mm)
Coordinatexyzxyz
Mean Error−0.94−0.050.61−0.970.240.19
STD Error15.928.0912.7118.969.6818.04
RMSE16.048.1412.9219.329.7918.40
Table 4. Comparison of mean and standard deviation (STD) of gait parameters estimated from the ultrasonic system and the reference camera system.
Table 4. Comparison of mean and standard deviation (STD) of gait parameters estimated from the ultrasonic system and the reference camera system.
Subject12345
Stride Length (mm)CameraMean995.74898.761003.621204.28932.1
STD68.9593.12135.36160.69125.93
UltrasoundMean1083.44969.011069.371303.941016.46
STD71.67107.43144.05173.94143.88
RMSE88.6875.8369.99102.4791.13
Stance Time (ms)CameraMean802.08648.93720.27835.92645.72
STD35.3459.9877.7944.8335.44
UltrasoundMean798.12642.95714.64833.9631.98
STD36.5263.9784.0640.2738.86
RMSE16.415.7915.1910.6119.33
Swing Time (ms)CameraMean521.46402.78459.91483.33431.76
STD13.1921.5725.2926.8219.03
UltrasoundMean525408.76465.76484.48445.04
STD16.7723.4925.7432.0219.88
RMSE15.6515.4516.7812.9517.27
Max. Foot Clearance (mm)CameraMean140.24107.49125.63130.61146.2
STD6.0510.8710.829.8914.11
UltrasoundMean143.55103.56121.11143.56135.36
STD9.4213.715.2913.6716.94
RMSE9.1210.4211.5816.4715.19

Share and Cite

MDPI and ACS Style

Ashhar, K.; Khyam, M.O.; Soh, C.B. A Multi-Path Compensation Method for Ranging in Wearable Ultrasonic Sensor Networks for Human Gait Analysis. Sensors 2019, 19, 1350. https://doi.org/10.3390/s19061350

AMA Style

Ashhar K, Khyam MO, Soh CB. A Multi-Path Compensation Method for Ranging in Wearable Ultrasonic Sensor Networks for Human Gait Analysis. Sensors. 2019; 19(6):1350. https://doi.org/10.3390/s19061350

Chicago/Turabian Style

Ashhar, Karalikkadan, Mohammad Omar Khyam, and Cheong Boon Soh. 2019. "A Multi-Path Compensation Method for Ranging in Wearable Ultrasonic Sensor Networks for Human Gait Analysis" Sensors 19, no. 6: 1350. https://doi.org/10.3390/s19061350

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop