Next Article in Journal
The RADARSAT Constellation Mission Core Applications: First Results
Previous Article in Journal
A Novel Method of Monitoring Surface Subsidence Law Based on Probability Integral Model Combined with Active and Passive Remote Sensing Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Robust GNSS/PDR Integration Scheme with GRU-Based Zero-Velocity Detection for Mass-Pedestrians

1
Electronic Information School, Wuhan University, No. 129 Luoyu Road, Wuhan 430079, China
2
GNSS Research Center, Wuhan University, No. 129 Luoyu Road, Wuhan 430079, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(2), 300; https://doi.org/10.3390/rs14020300
Submission received: 5 December 2021 / Revised: 3 January 2022 / Accepted: 4 January 2022 / Published: 10 January 2022
(This article belongs to the Topic GNSS Measurement Technique in Aerial Navigation)

Abstract

:
Aiming at the problem of high-precision positioning of mass-pedestrians with low-cost sensors, a robust single-antenna Global Navigation Satellite System (GNSS)/Pedestrian Dead Reckoning (PDR) integration scheme is proposed with Gate Recurrent Unit (GRU)-based zero-velocity detector. Based on the foot-mounted pedestrian navigation system, the error state extended Kalman filter (EKF) framework is used to fuse GNSS position, zero-velocity state, barometer elevation, and other information. The main algorithms include improved carrier phase smoothing pseudo-range GNSS single-point positioning, GRU-based zero-velocity detection, and adaptive fusion algorithm of GNSS and PDR. Finally, the scheme was tested. The root mean square error (RMSE) of the horizontal error in the open and complex environments is lower than 1 m and 1.5 m respectively. In the indoor elevation experiment where the elevation difference of upstairs and downstairs exceeds 25 m, the elevation error is lower than 1 m. This result can provide technical reference for the accurate and continuous acquisition of public pedestrian location information.

Graphical Abstract

1. Introduction

The joint application of low-cost inertial sensors, miniature global navigation satellite system (GNSS) receivers, and barometers has been one of the research hotspots in the field of navigation in the past decade [1,2,3]. Accurate and continuous pedestrian location information is widely used in professional applications such as armed police duty, field walking, pipeline maintenance, etc. The satellite navigation system can provide users with good location services in an open outdoor environment [4,5]. However, the system cannot work well in some scenarios where GNSS signals are unavailable [6,7]. Other information sources such as wireless local area networks (WLAN) [8], ultra-wideband (UWB) [9], radio frequency identification (RFID) [10], etc., can directly provide location information. However, there is a problem of signal occlusion in indoor scenarios. Generally, WiFi positioning and UWB positioning require extensive installation of signal receiving devices during the actual operation. Whether fingerprint positioning or trilateral measurement, WiFi positioning cannot be separated from offline surveying and mapping, limiting its application mode. Cameras [11] and radar [12] can improve the robustness of the system, however, these sensors only work effectively when there are enough features in the environment, which limits their application.
Some solutions such as multi-source information fusion have been proposed around the demand for continuous and reliable pedestrian navigation. Zhu et al. proposed a novel pedestrian navigation system (PNS) integrating RTK/Pseudolite/LAHDE/IMU, which uses manmade landmarks deployed at the entrance of the corridor to determine whether pedestrians are in an indoor corridor. If pedestrians do not follow a route with landmarks, the error will accumulate quickly [13]. Xin et al. presented a joint positioning scheme combining Bluetooth and inertial navigation systems, which provides meter-level positioning services without additional facilities [14]. Cavallo et al. introduced a solution which uses global position system (GPS) and Bluetooth to assist pedestrian trajectory calculation. This solution can continuously provide reliable positioning results for pedestrians in indoor or outdoor environments [15]. In [16], Polak et al. extended the power level measurement by using multiple anchors and multiple radio channels and focuses on the employing of machine learning methods to improve localization accuracy in an indoor environment under different conditions. In [17], Sun et al. integrated ultra-wideband technology and PDR to solve the problem of accumulated errors in inertial navigation systems. Compared with traditional methods, the positioning accuracy has been effectively improved.
As pedestrian movement patterns are complex, providing high-precision positioning in a complex environment is difficult by using a single navigation technology. With the continuous development of micro electro mechanical system (MEMS) technology, many sensor modules can be highly integrated into a small, low-power module, which provides natural advantages for public pedestrian navigation [18]. Magnetometer-assisted pedestrian navigation has long been widely studied [19,20]. To make magnetometer information play an active role in the system, the soft and hard magnetic effects must be calibrated, and the geomagnetic interference must be modeled and compensated [21,22]. Although the pedestrian navigation system based on inertial measurement units (IMU) can continuously provide positioning information, the positioning accuracy will quickly accumulate over time [23]. Mining pedestrian motion constraint information is of great significance for improving the performance of low-cost sensors. Pedestrians have natural zero-velocity information constraints during walking. Therefore, a zero-velocity update (ZUPT) algorithm can be widely used to suppress error accumulation [24]. In the zero-velocity phase of a gait cycle, the ZUPT algorithm combined with the extended Kalman filter (EKF) can effectively improve the positioning accuracy [25,26].
For this reason, various gait detection schemes have been proposed [27,28,29,30,31,32,33]. Skog et al. used the output of IMU to offer a zero-velocity detection method based on a general likelihood ratio test (GLRT) [27]. Experiments show that this method achieves good results at a slow walking speed. Wang et al. proposed an adaptive stance-phase detection method based on inertial sensor, which deals with the measurement fluctuations in swing and stance phases differently and performs well in the presence of measurement fluctuations [28]. Liu et al. adjusted the threshold of zero-velocity detection dynamically according to the output of the accelerometer [29]. In [30], Wang et al. designed an algorithm to adjust the length of the window without changing the threshold. These methods do not clearly explain the connection with the existing zero-velocity detection methods based on maximum likelihood detection. In recent years, many researchers have proposed some detection methods based on artificial intelligence (hidden Markov model (HMM) [31], support vector machine (SVM) [32], long short term memory (LSTM) [33]) without threshold of zero-velocity detection in the pedestrian navigation system. Compared with traditional zero-velocity detection methods, these methods do not need to set specific thresholds. Although these methods require a lot of data to train the model and have a high computational cost, they are more robust than the traditional methods.
Although the traditional zero-velocity detection method can detect the zero-velocity state of pedestrians, it is hard to set the threshold of zero-velocity detection appropriately. The GNSS/SINS integrated navigation system can provide reliable positioning results in outdoor open environment, but it is not available in an indoor environment as the GNSS signal is interrupted. In this article, a robust single-frequency GNSS/PDR pedestrian navigation system is proposed. The error state Kalman filter is used to fuse GNSS positioning information, zero-velocity state, barometer elevation, and other information. The zero-velocity detector based on GRU can accurately detect the motion state of pedestrians. The adaptive robustness algorithm and lever arm model are used to make the system more robust. Experiments show that the proposed algorithm can obtain reliable positioning results in complex environments.
The rest of this article is arranged as follows. The second section presents the GNSS/PDR integration scheme architecture. In the third section, the main algorithms of the scheme are introduced, including improved carrier phase smoothing pseudo-range GNSS single-point positioning algorithm, GRU-based zero-velocity gait detection, and adaptive fusion algorithm of GNSS and PDR. The fourth section introduces the experiment results and analysis. The conclusion of this paper is given in the fifth section.

2. GNSS/PDR Integration Scheme Architecture

A robust integration scheme for single-frequency single-antenna GNSS/PDR in complex environments is proposed. It is designed to provide reliable, continuous, and accurate positioning results for low-cost mass pedestrian positioning in complex environments. Algorithmically, this integration scheme uses the error state EKF as the algorithm framework, considering the gait characteristics of pedestrian walking, and fusing GNSS position, barometer height, and other information. From the point of view of program realization, the high efficiency of calculation, the scalability of code, and modular programming are evaluated. The code structure is clear, which is convenient for developers to maintain, update, and collaborate. The scheme is mainly composed of the following five parts:
  • Single-frequency data quality analysis, preprocessing, etc.
  • Improve carrier phase smoothing GNSS single point positioning.
  • GRU-based zero-velocity detector.
  • Adaptive GNSS/PDR fusion positioning.
  • Error analysis and visualization of positioning results.
The data fusion strategy flowchart is shown in Figure 1. Because of the unpredictability of pedestrian motion patterns and low sensor accuracy, the foot-mounted pedestrian navigation system is used as the basis, and the error state Kalman filter is used as the data fusion framework to deeply explore the performance of MEMS sensors. Motion constraint information is used to improve the positioning capability of the system. Figure 1 shows the single-frequency GNSS/PDR positioning algorithm. It mainly includes four parts: (1) GNSS positioning algorithm, (2) PDR algorithm, (3) GNSS/PDR positioning algorithm, (4) GRU-based gait detection algorithm.
The overall architecture of the scheme is shown in Figure 2. The three sub-modules included are named INS module, GNSS module, and PNS module. INS module implements algorithms related to INS, GNSS module implements algorithms related to GNSS, and PNS module implements integrated navigation, self-adaptation, and result in display. Each sub-module contains its basic function and main algorithm.

3. Fusion Method of GNSS and ZUPT-Aided PDR

The algorithm flow chart is shown in Figure 1. This section shows the GNSS data preprocessing strategy, single-frequency single-antenna positioning algorithm, GRU-based zero-velocity detection, and GNSS/PDR integrated navigation algorithm.

3.1. GNSS Data Preprocessing Strategy and Single-Frequency GNSS Positioning Algorithm

Evaluating the data quality of observations from low-cost GNSS modules can provide a basis for the preprocessing of observations. The satellite visibility, carrier-to-noise ratio ( C / N 0 ), and pseudo-range noise are quantitatively evaluated and analyzed based on measured data. The number of visible satellites will directly affect the number of redundant observations in the data preprocessing. The C / N 0 is an essential indicator of the quality of the received observations. The GNSS/PDR integration scheme uses a variety of strategies to preprocess GNSS data, including detecting cycle slips and removing it, and for the problem that observations are prone to gross errors when the observations are at a low signal-to-noise ratio. Eliminate satellites below the threshold to avoid introducing abnormal observation information.
Hatch filtering is a standard processing method of traditional single-frequency carrier smoothing pseudo-range [34]. The traditional single-frequency hatch filter algorithm is prone to the problems of divergence of smoothing results and decreased accuracy due to the influence of ionospheric delay changes. In [35], Chebir et al. proposed a method based on applying specific transformations to the GNSS signals received in unfavorable environment, which can effectively receive and process GNSS signals in unfavorable environment. In [36], Park used a moving window algorithm to improve the original single-frequency smoothing pseudo-range algorithm. There are two forms of single-frequency smoothing, and the corresponding smoothing between epochs can be defined as:
ρ ˆ ( t k ) = 1 k ρ ( t k ) + ( 1 1 k ) [ ρ ˆ ( t k 1 ) + δ ϕ ( t k , t k 1 ) ] , k 1
ρ ˆ ( t k ) = { 1 k ρ ( t k ) + ( 1 1 k ) [ ρ ˆ ( t k 1 ) + δ ϕ ( t k , t k 1 ) ] , 1 k M 1 M ρ ( t k ) + ( 1 1 M ) [ ρ ˆ ( t k 1 ) + δ ϕ ( t k , t k 1 ) ] , k > M
where ρ ( t ) and ϕ ( t ) are the distances of the observed pseudo-range and carrier phase, respectively, and M is the length of the filter, which is determined according to the smoothing time T and the observation sampling τ . δ ϕ ( t k , t k 1 ) is the difference operator.

3.2. GRU-Based Zero-Velocity Detection

Recurrent neural network (RNN) is now widely used in time series-based forecasting tasks (pedestrian trajectory prediction [37], vehicle trajectory prediction [38], etc.). GRU is a special RNN with the ability to learn long-term dependency.
The structure of the GRU is shown in Figure 3, which is composed of an update gate ( Γ u ) and a reset gate ( Γ r ). The larger the value of the update gate, the more the state information of the previous moment is brought in. The reset gate controls how much information is conveyed to the current candidate set ( c ˜ < t > ). The smaller the reset gate is, the less information is passed to the previous state. The detailed update formula is as follows:
Γ r = σ ( W r [ c < t 1 > , x < t > ] + b r )
Γ u = σ ( W u [ c < t 1 > , x < t > ] + b u )  
c ˜ < t > = t a n h ( W c [ Γ r c < t 1 > , x < t > ] + b c )
c < t > = Γ u c ˜ < t > + ( Ι Γ u ) c < t 1 >
where represents the relative position of the objects before and after multiplication. σ represents the sigmoid activation of the following objects. c < t 1 > represents the activation value of the previous time step. W c ,     W u ,   W r   correspond to the weight matrix of each gate respectively. b r , b z , b h are the bias vectors of reset gate, update gate, and hidden unit respectively.
GRU-based zero-velocity detectors need to collect IMU data from different objects to train the model. Currently, there is no standard method to generate labels. Some existing techniques (manual, pressure sensor, high-precision sports state capture system) are proposed to produce reliable zero-velocity information. In this paper, the results of RTK/INS combination are used as reference trajectories, adjust the threshold of the GLRT detector to produce the smallest RMSE, and use the zero-velocity state by the GLRT detector with an optimal threshold as a label.
The structure of the zero-velocity detector is shown in Figure 4, which is mainly composed of three GRU layers, two drop layers, and one fully connected layer (FC). Each layer of GRU has 100 neurons. To avoid overfitting, the drop layer is set to 0.2. The FC layer uses a sigmoid function as the activation function to map the model output to within (0, 1). It is assumed that current state is zero-velocity when the model output is greater than 0.8, otherwise, current state is non-zero-velocity. During the training process, 50 consecutive IMU data (specific force, angular velocity) constitute one sample, and a data set consisting of 300,000 samples is used to train this model. Each sample has an individual label which represents the zero-velocity state corresponding to the last time step. The Adam optimizer [39] is used to optimize the model with 100 iterations. The loss function of the model is defined as follows:
Loss = 1 N i N y i log ( p i ) + ( 1 y i ) log ( 1 p i )
where N represents the total number of training samples and p i represents the label output of the i-th sample.

3.3. Robust EKF Design for GNSS/PDR Integration

The error state EKF is used as the data fusion framework. The 15-dimensional error state vector is summarized as follows:
δ x = [ δ p δ v δ φ   δ b g   δ b a ]  
where δ p , δ v , δ φ , δ b g , δ b a are all three-dimensional vectors and denote position, velocity, attitude, gyroscope bias, and accelerometer bias. The discrete-time error model of INS can be defined in matrix form as:
δ x k , k 1 = F k , k 1 δ x k + G k , k 1 W k 1  
where F k , k 1 is the state transition matrix, G k , k 1 is process noise-driven matrix, and W k 1 is process noise, which is assumed to be Gaussian white noise with zero mean; the state transition and noise gain matrices can be written as:
F = [ I 3 0 3 0 3 0 3 C b n Δ t Δ t ( C b n f b ) × I 3 0 3 C b n Δ t 0 3 0 3 Δ t I 3 I 3 0 3 0 3 0 3 0 3 0 3 B g 0 3 0 3 0 3 0 3 0 3 B a ]
b g = I 3 + Δ t diag ( 1 τ g )
b a = I 3 + Δ t diag ( 1 τ a )
G = [ 0 3 0 3 0 3 0 3 C b n Δ t 0 3 0 3 0 3 0 3 C b n Δ t 0 3 0 3 0 3 0 3 I 3 Δ t 0 3 0 3 0 3 0 3 I 3 Δ t ]  
where ( · ) × represents the skew-symmetric matrix of a vector. I p and 0 p denote p × p identity matrix and zero matrices respectively. The bias errors of gyros and accelerometers can be expressed as first-order Gauss–Markov processes with the correlation time τ g , τ a .
When the observations (including the GNSS positioning results, the relative height difference of the barometer, and the zero-velocity information) are available, the measurement equation is constructed:
δ z k = H k δ x ˆ k , k 1  
GNSS positioning is the main factor that determines the absolute positioning accuracy of the system and suppresses the error of the inertial sensor. At the same time, the lever arm error cannot be ignored, and the position observation equation is:
δ z r = r ˆ ins n r ˆ gnss n  
Use the barometer elevation change as the observation equation to update the elevation:
δ z h = ( H baro k H baro k 0 ) ( H ins k H ins k 0 )  
where H baro k and H baro k 0 is the barometer elevation of the current epoch and the previous epoch, respectively. H ins k and H ins k 0 is the elevation of the INS recursive of the current epoch and the previous epoch, respectively.
ZUPT is an effective means to control the accumulation of velocity errors. When the GRU recurrent neural network is used to detect that it is in a static state, the zero-velocity observation model is constructed:
δ z v = v ˆ ins n [ 0 0 0 ] T  

3.4. Lever Correction

When carrying out the walking experiment, the IMU is fixed on the surface of the shoe, and the GNSS receiver antenna is set on the top of the head. The lever arm is constantly changing and cannot be ignored. It is not recommended to put the lever arm in the state vector as a parameter to be estimated, which not only increases the complexity of the calculation but also there is no way to evaluate whether the estimated value of the lever arm is correct. In the zero-velocity interval, the distance between the GNSS antenna and the IMU measurement center in the horizontal direction is much lower than the position error of GNSS single-point positioning result. The lever length in the vertical direction is equal to the height of the human subject. In the non-zero-velocity interval, it is modeled as a pendulum, as shown in Figure 5. A lever arm is expressed as:
lever   arm = [ l 2 × sin θ 0 l 1 + l 2 × cos θ ]
In the above Figure 5, l 1 represents the height from the top of the head to the waist, l 2 is the length of the legs, which can be accurately known, and θ is an unknown parameter, which can be obtained by solving the essential trigonometric function.
The error caused by the inaccurate lever arm modeling can be equivalent to the GNSS single-point positioning error, which can be effectively compensated by an adaptive filter.

3.5. Adaptive Kalman Filter

The GNSS outliers appear in the harsh environment due to the poor GNSS observation quality. However, the standard Kalman filter cannot solve this problem, which increases the positioning error of the GNSS/INS integrated system. Innovation-based adaptive estimation (IAE) filter is a popular filter to reduce the influence of outliers, which is adopted in this paper.
By calculating the average value of the covariance of the innovation vector of the previous N epochs, the estimate of the covariance of the innovation vector at current epoch and the estimation of the observation vector covariance matrix can be obtained:
Σ ˆ V _ k = 1 N Σ j = 0 N V _ k j V _ k j T
Σ ˆ k = Σ ˆ V _ k F k Σ X _ k F k T
where Σ ˆ V _ k denotes the covariance matrix of the state one-step prediction vector, and V k denotes the innovation vector. This calculates the ratio of the trace of Σ ˆ k to the trace of preset observation vector covariance matrix Σ k . When the position result of GNSS is an outlier, this ratio will be greater than 1. The greater one between this ratio and one is taken as the adaptive factor:
The adaptive factor is used to expand the covariance matrix of the observation vector at the current epoch, which reduces the influence of GNSS outliers and increases the position accuracy of the GNSS/INS integrated system.
The paper studies the single-frequency single-system single-antenna pseudo-range single-point positioning assisted foot-mounted micro-inertial pedestrian navigation method. When carrying out the walking experiment, the MTi-G-710 is fixed on the shoe surface, the GNSS antenna is fixed on the top of the head, and the collected data is used to test the accuracy of carrier phase smoothing pseudo-range SPP positioning and the effect of SPP/SINS combination.

4. Results

MTi-G-710 produced by the Dutch company Xsens is selected as the experimental device, which integrates a three-axis gyroscope, a three-axis accelerometer, and a barometer. The performance parameters of the gyroscope and accelerometer are shown in Table 1. The experimental GNSS module is the mosaic-X5 produced by Septentrio, Belgium, which is used to track all visible supporting satellites at the same time. The sampling rate of the IMU was set to 100. The data of the experiment is available for download here: https://github.com/laotouyu123/data_set.git, accessed on 6 November 2021.

4.1. GRU-Based Zero-Velocity Detection Algorithm Performance Verification

In order to verify the performance and generalization ability of the GRU-based zero-velocity detection method, ten experimenters carried out walking experiments on the same path at three walking speeds: slow, normal, and fast. The zero-velocity detection result of one of the experimenters is shown in Figure 6.
As shown in Figure 6, the GLRT method can effectively detect the zero-velocity most of the time. However, some incorrect zero-velocity results are detected by GLRT when the feet of the experimenter are moving, which will decrease the positioning precision of the PDR algorithm. The GRU method can detect the zero-velocity correctly all the time as the red curve shows in Figure 6, which guarantees the availability of zero-velocity information.
In order to verify the performance of the GRU-based zero-velocity detection method, a close-loop experiment is carried out, in which an experimenter walked 10 times along a rectangular trajectory. The trajectories obtained by two zero-velocity detect methods are shown in Figure 7. It can be seen from Figure 7 that the GLRT method obtained larger position error in the end point because of the incorrect zero-velocity information.
The closed-loop errors of all trajectories obtained by the GLRT method and the GRU method are listed in Table 2. The minimum average closed-loop position error of the traditional GLRT zero-velocity detection method is 1.42 m, while the average closed-loop position error of the proposed method is 0.89 m, which means the proposed method performs better than the traditional algorithm.

4.2. The Proposed Algorithm Performance Verification under Open Environment

To verify the proposed algorithm performance under open environment, a data set (249 s in total) was collected under an open environment at Youyi Square, Faculty of Informatics, Wuhan University, Wuhan. The experimenter walks along the edge of Youyi Square during the experiment.
In the Kalman filter algorithm for pedestrian positioning, the relevant parameters are set as follows: initial speed error is 0.01 m / s , the initial position error is 0.01   m , the initial value of acceleration offset is 0.03 m / s 2 , the initial value of gyroscope offset is 0.3 ° / s , accelerometer noise is δ a = 0.5 m / s 2 , gyro noise is δ g = 1 ° / s , accelerometer bias driving noise δ b a = 10 4 m / s 2 , gyroscope bias driving noise δ b g = 10 5 rad / s .
Compare the positioning result of the following four schemes: Scheme 1, use the GLRT method to detect the zero-velocity interval; Scheme 2, use the GRU method to detect the zero-velocity interval; Scheme 3, the proposed algorithm; Scheme 4, RTK. The trajectories of these schemes are shown in Figure 8.
Under the open environment, RTK’s positioning error is small, so the RTK position result of Scheme 4 can be used as a reference truth value. The statistical results of three schemes are shown in Table 3. It can be seen that the RMSE and maximum errors of Scheme 3 are more minor than those of the other two methods. The RMSE of these three schemes are 1.643 m, 1.042 m, and 0.543 m respectively. The maximum errors of the three schemes are 2.631 m, 2.54 m, and 1.03 m respectively. Compared with Schemes 1 and 2, RMSE of the proposed scheme are decreased by 67% and 48% respectively. In terms of maximum errors, compared with other two schemes, the maximum errors of the proposed scheme are decreased by 61% and 59% respectively. In order to more clearly reflect the performance of the proposed scheme, the Cumulative Distribution Function (CDF) of the horizontal error is shown in Figure 9. It can be seen from Figure 9 that 99% of the horizontal error of the proposed scheme is smaller than 1 m, while that of the other two schemes is 33% and 63%.

4.3. The Proposed Algorithm Performance Verification under Complex Environment

To verify the proposed algorithm performance under complex environment, a data set was collected in the playground of the Faculty of Information Science of Wuhan University, Wuhan. The experimenter walked along the outermost periphery of the playground. There are many interferences in the trajectory, including trees and houses. The experiment environment is shown in Figure 10.
The C / N 0 of the satellite signal is shown in Figure 11. Due to the unsatisfactory observation environment, the number of satellites is maintained at about 8. However, the loss of satellite signal occurred frequently; the carrier-to-noise ratio of a few satellites is lower than 30 dB-Hz most of the time, such as G29 and G15. The position and position covariance results calculated by the carrier smoothing pseudo-range SPP are used in the measurement update of the EKF in the proposed scheme, and the adaptive algorithm is used for quality control.
Eighteen key positions of the trajectory are selected as reference points; their position coordinate is accurately determined. Five schemes are compared. Scheme 1: use GLRT method to detect the zero-velocity interval; Scheme 2: use GRU method to detect the zero-velocity interval; Scheme 3: GNSS/PDR without adaptive algorithm; Scheme 4: the proposed algorithm; Scheme 5: RTK solution provided by mosaic-X5. The trajectories of these five schemes are shown in Figure 12.
As shown in Figure 13, although the position environment is complex, the horizontal error of RTK is lower than 0.5 m at all of the reference points. Because of the high precision of RTK, the trajectory of RTK is taken as the reference trajectory. In Figure 13, we randomly select 18 points in the test path to test the accuracy of the algorithm. The proposed algorithm obtained lower position error than Schemes 1–3 at most of the reference points, noting that when the INS obtained a large error, the adaptive algorithm may increase the position error of the GNSS/PDR algorithm, such as the position error at reference point 4. However, in most cases, GNSS has larger position error than INS due to environmental interference; the adaptive algorithm can effectively decrease the position error when GNSS obtained larger error, such as the position error at reference points 6, 7, and 8. The position error of Schemes 1–4 is shown in Table 4. It can be seen from Table 4 that the RMSE of the four schemes are 6.08 m, 3.21 m, 1.79 m, and 1.37 m respectively and the maximum errors of the four schemes are 11.48 m, 6.02 m, 4.98 m, and 2.79 m respectively. Compared with the other three schemes, RMSE of the proposed scheme are decreased by 77%, 57%, and 23% respectively and the maximum errors of the proposed scheme are decreased by 75%, 53%, and 43% respectively. CDF of the horizontal error are shown Figure 14. It can be seen from Figure 14 that 99% of the horizontal error of the proposed scheme is smaller than 2.71 m. For several algorithms used to compare with the proposed scheme, some algorithms do not integrate GNSS position information, so the result obtained will be better than the proposed algorithm, but due to the characteristics of inertial navigation, the accuracy of these algorithms will diverge over time. Generally speaking, the accuracy of the proposed algorithm is better than other algorithms.

4.4. Indoor Elevation Performance Verification of the Proposed Algorithm

An indoor staircase environment is carried out to verify the elevation performance of the proposed algorithm. The proposed algorithm will not execute GNSS measurement update as there is no GNSS signal in the indoor environment. The experimental site is shown in Figure 15 in this experiment; the experimenter went upstairs from the fifth floor to the twelfth floor, then went downstairs to the fifth floor. The height difference of each floor has been determined in advance by multiple measuring and only counts the elevation error when the experimenter falls on each floor of the staircase. Three schemes are compared. Scheme 1: use ZUPT to judge elevation; Scheme 2: use the barometer to judge elevation; Scheme 3: ZUPT/ barometer fusion algorithm. The test result is shown in Figure 16.
It can be seen from Figure 16 that the barometer can basically reflect the elevation, but the robustness is not enough, and there are many burrs. ZUPT has no large burrs, but the error diverges with time. The result of the adaptive combination of the PDR and barometer can reflect the elevation well without large error. As shown in Table 5, RMSE of these three schemes are 1.62 m, 1.25 m, and 0.96 m, respectively. The maximum errors of these schemes are 3.3 m, 1.95 m, and 1.28 m, respectively. Compared with other two schemes, RMSE of the proposed scheme are decreased by 41% and 24%, respectively, and the maximum errors of the proposed scheme are decreased by 61% and 34%, respectively.

5. Conclusions

A single-frequency single-antenna GNSS/PDR robust integration scheme is proposed, which provides continuous and accurate pedestrian navigation by fusing GNSS and MEMS sensors. Key technologies of the proposed scheme are discussed, including improved carrier phase smoothing pseudo-range GNSS single-point positioning, GRU-based zero-velocity detection, and adaptive fusion algorithm of GNSS and PDR. Kinematic experiments in outdoor open environments and complex environments show that the proposed scheme can combine the advantages of GNSS and INS, achieving pedestrian navigation position error lower than 1.5 m. The proposed GRU-based zero-velocity detection model can only detect ordinary motion patterns. However, due to the limitation of the data set, this model cannot detect the zero-velocity state in complex motion mode. In the future, we will study the zero-velocity detection model under complex motion mode. In summary, this integrated scheme promotes the realization of high-precision positioning of public pedestrians in an urban environment, and it provides technical reference for accurate and continuous acquisition of public pedestrian location information.

Author Contributions

Conceptualization, J.J. and D.X.; methodology, J.J., D.X. and J.W.; software, D.X.; validation, J.J. and D.X.; formal analysis, J.J. and D.X.; investigation, J.J. and D.X.; resources, J.J. and D.X.; writing—original draft preparation, J.J. and D.X.; writing—review and editing, J.J., D.X., P.Y., Y.T., J.W., C.Z. and J.L.; visualization, J.W.; supervision, J.W. and D.X.; project administration, P.Y.; funding acquisition, J.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China (2018YFB0505200 and 2018YFB0505201), the Fundamental Research Funds for the Central Universities (2042018kf0253).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

Thank you very much for the equipment support of Jinguang Jiang’s research group, for his driving experiment for this research, and for the technical support of Fangning Zhang, Peihui Xie, Yanan Tang, Jiaji Wu, and Chao Zhang.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Han, H.; Wang, J. Robust GPS/BDS/INS tightly coupled integration with atmospheric constraints for long-range kinematic positioning. GPS Solut. 2017, 21, 1285–1299. [Google Scholar] [CrossRef]
  2. Kim, Y.; Hwang, Y.; Choi, S.; Lee, J. Height estimation scheme of low-cost pedestrian dead-reckoning system using Kalman Filter and walk condition estimation algorithm. In Proceedings of the 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Wollongong, NSW, Australia, 9–12 July 2013; pp. 1492–1497. [Google Scholar]
  3. Chiang, K.-W.; Chang, H.-W.; Li, Y.-H.; Tsai, G.-J.; Tseng, C.-L.; Tien, Y.-C.; Hsu, P.-C. Assessment for INS/GNSS/Odometer/Barometer Integration in Loosely-Coupled and Tightly-Coupled Scheme in a GNSS-Degraded Environment. IEEE Sens. J. 2020, 20, 3057–3069. [Google Scholar] [CrossRef]
  4. Yan, P.H.; Jiang, J.G.; Zhang, F.N.; Xie, D.P.; Wu, J.J.; Zhang, C.; Tang, Y.A.; Liu, J.N. An Improved Adaptive Kalman Filter for a Single Frequency GNSS/MEMS-IMU/Odometer Integrated Navigation Module. Remote Sens. 2021, 13, 4317. [Google Scholar] [CrossRef]
  5. Yan, P.H.; Jiang, J.G.; Tang, Y.A.; Zhang, F.N.; Xie, D.P.; Wu, J.J.; Liu, J.H.; Liu, J.N. Dynamic Adaptive Low Power Adjustment Scheme for Single-Frequency GNSS/MEMS-IMU/Odometer Integrated Navigation in the Complex Urban Environment. Remote Sens. 2021, 13, 3236. [Google Scholar] [CrossRef]
  6. Pulido Herrera, E.; Kaufmann, H.; Secue, J.; Quirós, R.; Fabregat, G. Improving data fusion in personal positioning systems for outdoor environments. Inf. Fusion 2013, 14, 45–56. [Google Scholar] [CrossRef]
  7. Noureldin, A.; El-Shafie, A.; Bayoumi, M. GPS/INS integration utilizing dynamic neural networks for vehicular navigation. Inf. Fusion 2011, 12, 48–57. [Google Scholar] [CrossRef]
  8. Cao, H.J.; Wang, Y.J.; Bi, J.X. Smartphones: 3D Indoor Localization Using Wi-Fi RTT. IEEE Commun. Lett. 2021, 25, 1201–1205. [Google Scholar] [CrossRef]
  9. Tian, Q.; Wang, K.I.K.; Salcic, Z. A Low-Cost INS and UWB Fusion Pedestrian Tracking System. IEEE Sens. J. 2019, 19, 3733–3740. [Google Scholar] [CrossRef]
  10. Seco, F.; Jiménez, A.R. Smartphone-based cooperative indoor localization with RFID technology. Sensors 2018, 18, 266. [Google Scholar] [CrossRef] [Green Version]
  11. Santos, D.; Gonçalves, P. Attitude Determination of Multirotor Aerial Vehicles Using Camera Vector Measurements. J. Intell. Robot. Syst. 2016, 86, 1–11. [Google Scholar] [CrossRef]
  12. Ward, N. Development and testing of a radar target enhancer for navigation buoys. J. Navig. 1995, 48, 70–76. [Google Scholar] [CrossRef]
  13. Zhu, R.W.; Wang, Y.; Cao, H.; Yu, B.; Gan, X.; Huang, L.; Zhang, H.; Li, S.; Jia, H.; Chen, J. RTK/Pseudolite/LAHDE/IMU-PDR Integrated Pedestrian Navigation System for Urban and Indoor Environments. Sensor 2020, 20, 1791. [Google Scholar] [CrossRef] [Green Version]
  14. Xin, L.; Jian, W.; Liu, C. A Bluetooth/PDR Integration Algorithm for an Indoor Positioning System. Sensors 2015, 15, 24862–24885. [Google Scholar]
  15. Cavallo, F.; Sabatini, A.M.; Genovese, V. A step toward GPS/INS personal navigation systems: Real-time assessment of gait by foot inertial sensing. In Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada, 2–6 August 2005; pp. 1187–1191. [Google Scholar]
  16. Polak, L.; Rozum, S.; Slanina, M.; Bravenec, T.; Fryza, T.; Pikrakis, A. Received Signal Strength Fingerprinting-Based Indoor Location Estimation Employing Machine Learning. Sensors 2021, 21, 4605. [Google Scholar] [CrossRef]
  17. Sun, B.; Fan, Q.; Wu, Y.; Sun, Y. Foot-mounted pedestrian navigation technology based on tightly coupled PDR/UWB. Transducer Microsyst. Technol. 2017, 36, 43–47, 50. [Google Scholar]
  18. Brigante, C.; Abbate, N.; Basile, A.; Faulisi, A.C.; Sessa, S. Towards Miniaturization of a MEMS-Based Wearable Motion Capture System. IEEE Trans. Ind. Electron. 2011, 58, 3234–3241. [Google Scholar] [CrossRef]
  19. Qiu, S.; Wang, Z.; Zhao, H.; Qin, K.; Li, Z.; Hu, H. Inertial/magnetic sensors based pedestrian dead reckoning by means of multi-sensor fusion. Inf. Fusion 2017, 39, 108–119. [Google Scholar] [CrossRef] [Green Version]
  20. Shi, L.-F.; Zhao, Y.-L.; Liu, G.-X.; Chen, S.; Wang, Y.; Shi, Y.-F. A Robust Pedestrian Dead Reckoning System Using Low-Cost Magnetic and Inertial Sensors. IEEE Trans. Instrum. Meas. 2019, 68, 2996–3003. [Google Scholar] [CrossRef]
  21. Wu, Z.; Hu, X.; Wu, M.; Cao, J. Constrained total least-squares calibration of three-axis magnetometer for vehicular applications. Meas. Sci. Technol. 2013, 24. [Google Scholar] [CrossRef]
  22. Springmann, J.C.; Cutler, J.W. Attitude-Independent Magnetometer Calibration with Time-Varying Bias. J. Guid. Control Dyn. 2011, 35, 1080–1088. [Google Scholar] [CrossRef]
  23. Deng, Z.; Sun, M.; Wang, B.; Fu, M. Analysis and Calibration of the Nonorthogonal Angle in Dual-Axis Rotational INS. IEEE Trans. Ind. Electron. 2017, 64, 4762–4771. [Google Scholar] [CrossRef]
  24. Wang, Y.; Shkel, A.M. Adaptive Threshold for Zero-Velocity Detector in ZUPT-Aided Pedestrian Inertial Navigation. IEEE Sens. Lett. 2019, 3. [Google Scholar] [CrossRef]
  25. Foxlin, E. Pedestrian Tracking with Shoe-Mounted Inertial Sensors. IEEE Comput. Graph. Appl. 2005, 25, 38–46. [Google Scholar] [CrossRef] [PubMed]
  26. Woyano, F.; Lee, S.; Park, S. Evaluation and comparison of performance analysis of indoor inertial navigation system based on foot mounted IMU. In Proceedings of the 2016 18th International Conference on Advanced Communication Technology (ICACT), Phoenix Park, PyeongChang, Korea, 31 January–3 February 2016; pp. 792–798. [Google Scholar]
  27. Skog, I.H.; Nilsson, P.; Rantakokko, J.-O. Zero-Velocity Detection—An Algorithm Evaluation. IEEE Trans. Bio-Med. Eng. 2010, 57, 2657–2666. [Google Scholar] [CrossRef]
  28. Wang, Z.; Zhao, H.; Qiu, S.; Gao, Q. Stance-Phase Detection for ZUPT-Aided Foot-Mounted Pedestrian Navigation System. IEEE/ASME Trans. Mechatron. 2015, 20, 3170–3181. [Google Scholar] [CrossRef]
  29. Liu, H.f.; Ren, W.; Zhang, T.; Gong, J.; Liang, J.M.; Liu, B.; Shi, J.W.; Huang, Z. An adaptive selection algorithm of threshold value in zero velocity updating for personal navigation system. In Proceedings of the 33rd Chinese Control Conference, Nanjing, China, 28–30 July 2014; pp. 1035–1038. [Google Scholar]
  30. Wang, Q.; Guo, Z.; Sun, Z.; Cui, X.; Liu, K. Research on the Forward and Reverse Calculation Based on the Adaptive Zero-Velocity Interval Adjustment for the Foot-Mounted Inertial Pedestrian-Positioning System. Sensors 2018, 18, 1642. [Google Scholar] [CrossRef] [Green Version]
  31. Callmer, J.; Törnqvist, D.; Gustafsson, F. Probabilistic stand still detection using foot mounted IMU. In Proceedings of the 2010 13th International Conference on Information Fusion, Edinburgh, UK, 26–29 July 2010; pp. 1–7. [Google Scholar]
  32. Wagstaff, B.; Peretroukhin, V.; Kelly, J. Improving foot-mounted inertial navigation through real-time motion classification. In Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan, 18–21 September 2017; pp. 1–8. [Google Scholar]
  33. Wagstaff, B.; Kelly, J. LSTM-Based Zero-Velocity Detection for Robust Inertial Navigation. In Proceedings of the 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Nantes, France, 24–27 September 2018; pp. 1–8. [Google Scholar]
  34. Guo, R.; Hu, X.; Chang, Z.; Cao, Y.; Wang, A.; Wu, X.; Dong, E. Comparison between CNMC and hatch filter & its precision analysis for BDS precise relative positioning. Sci. Sin. Phys. Mech. Astron. 2015, 45, 079508. [Google Scholar] [CrossRef]
  35. Chebir, S.; Aidel, S.; Rouabah, K.; Attia, S.; Flissi, M. GNSS Signals Acquisition and Tracking in Unfavorable Environment. Radioengineering 2018, 27, 557–571. [Google Scholar] [CrossRef]
  36. Park, B.; Sohn, K.; Kee, C. Optimal Hatch Filter with an Adaptive Smoothing Window Width. J. Navig. 2008, 61, 435–454. [Google Scholar] [CrossRef]
  37. Fernando, T.; Denman, S.; Sridharan, S.; Fookes, C. Soft plus Hardwired attention: An LSTM framework for human trajectory prediction and abnormal event detection. Neural Netw. 2018, 108, 466–478. [Google Scholar] [CrossRef] [Green Version]
  38. Zheng, Z.; Chen, W.; Wu, X.; Chen, P.; Liu, J. LSTM network: A deep learning approach for short-term traffic forecast. IET Intell. Transp. Syst. 2017, 11, 68–75. [Google Scholar]
  39. Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
Figure 1. The data fusion strategy flowchart.
Figure 1. The data fusion strategy flowchart.
Remotesensing 14 00300 g001
Figure 2. The overall architecture of the scheme.
Figure 2. The overall architecture of the scheme.
Remotesensing 14 00300 g002
Figure 3. GRU block architecture.
Figure 3. GRU block architecture.
Remotesensing 14 00300 g003
Figure 4. The structure of zero-velocity detection based on GRU.
Figure 4. The structure of zero-velocity detection based on GRU.
Remotesensing 14 00300 g004
Figure 5. Lever arm model.
Figure 5. Lever arm model.
Remotesensing 14 00300 g005
Figure 6. Zero−velocity detection result.
Figure 6. Zero−velocity detection result.
Remotesensing 14 00300 g006
Figure 7. Trajectories obtained by different zero−velocity detection methods.
Figure 7. Trajectories obtained by different zero−velocity detection methods.
Remotesensing 14 00300 g007
Figure 8. 2D positioning trajectories by different methods.
Figure 8. 2D positioning trajectories by different methods.
Remotesensing 14 00300 g008
Figure 9. Cumulative distribution function by different methods.
Figure 9. Cumulative distribution function by different methods.
Remotesensing 14 00300 g009
Figure 10. The experiment environment.
Figure 10. The experiment environment.
Remotesensing 14 00300 g010
Figure 11. Carrier-to-noise ratio of satellite signal.
Figure 11. Carrier-to-noise ratio of satellite signal.
Remotesensing 14 00300 g011
Figure 12. 2D positioning trajectories by different schemes.
Figure 12. 2D positioning trajectories by different schemes.
Remotesensing 14 00300 g012
Figure 13. Horizontal error statistics of different schemes.
Figure 13. Horizontal error statistics of different schemes.
Remotesensing 14 00300 g013
Figure 14. CDF of horizontal error obtained by different schemes.
Figure 14. CDF of horizontal error obtained by different schemes.
Remotesensing 14 00300 g014
Figure 15. Experimental site e of indoor experiment.
Figure 15. Experimental site e of indoor experiment.
Remotesensing 14 00300 g015
Figure 16. Height comparison of different methods.
Figure 16. Height comparison of different methods.
Remotesensing 14 00300 g016
Table 1. Specifications of inertial sensors.
Table 1. Specifications of inertial sensors.
ParametersGyroscopeAccelerometer
Full Scale 625 ° / s 18   g
Bias stability 10 ° / h 40   ug
Noise density 0.01 ° / s / Hz 80 μ g / Hz
g-sensitivity 0.003 ° / s / g -
Non-orthogonal error 0.05 ° 0.05 °
Non-linearity 0.01 % 0.01 %
All parameters in the table are typical values at 25   .
Table 2. Closed loop position error (m) obtained by different zero-velocity detection methods.
Table 2. Closed loop position error (m) obtained by different zero-velocity detection methods.
IndexGLRTGRU
γ ( 10 , 000 ) γ ( 15 , 000 ) γ ( 20 , 000 ) γ ( 25 , 000 ) γ ( 30 , 000 )
Max3.983.760.593.733.821.77
Min0.980.040.430.430.250.11
Mean 2.281.771.441.421.910.89
Table 3. Position error (m) obtained by different schemes.
Table 3. Position error (m) obtained by different schemes.
Maximum ErrorRMSE
Scheme 12.631.63
Scheme 2 2.541.04
Scheme 31.030.54
Table 4. Horizontal position error (m) obtained by different schemes.
Table 4. Horizontal position error (m) obtained by different schemes.
Maximum ErrorRMSE
Scheme 111.486.08
Scheme 26.023.21
Scheme 34.981.79
Scheme 42.791.37
Table 5. Elevation error (m) obtained by different schemes.
Table 5. Elevation error (m) obtained by different schemes.
MAXRMSE
Scheme 13.31.62
Scheme 21.951.25
Scheme 31.280.96
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xie, D.; Jiang, J.; Wu, J.; Yan, P.; Tang, Y.; Zhang, C.; Liu, J. A Robust GNSS/PDR Integration Scheme with GRU-Based Zero-Velocity Detection for Mass-Pedestrians. Remote Sens. 2022, 14, 300. https://doi.org/10.3390/rs14020300

AMA Style

Xie D, Jiang J, Wu J, Yan P, Tang Y, Zhang C, Liu J. A Robust GNSS/PDR Integration Scheme with GRU-Based Zero-Velocity Detection for Mass-Pedestrians. Remote Sensing. 2022; 14(2):300. https://doi.org/10.3390/rs14020300

Chicago/Turabian Style

Xie, Dongpeng, Jinguang Jiang, Jiaji Wu, Peihui Yan, Yanan Tang, Chao Zhang, and Jingnan Liu. 2022. "A Robust GNSS/PDR Integration Scheme with GRU-Based Zero-Velocity Detection for Mass-Pedestrians" Remote Sensing 14, no. 2: 300. https://doi.org/10.3390/rs14020300

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop