Next Article in Journal
MapCleaner: Efficiently Removing Moving Objects from Point Cloud Maps in Autonomous Driving Scenarios
Next Article in Special Issue
A Robust Nonlinear Filter Strategy Based on Maximum Correntropy Criterion for Multi-GNSS and Dual-Frequency RTK
Previous Article in Journal
Orbit Predictions for Space Object Tracked by Ground-Based Optical and SLR Stations
Previous Article in Special Issue
LIDAR-Inertial Real-Time State Estimator with Rod-Shaped and Planar Feature
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Method for AI-Assisted INS/GNSS Navigation System Based on CNN-GRU and CKF during GNSS Outage

State Key Laboratory of Modern Optical Instrumentation, Zhejiang University, Hangzhou 310027, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(18), 4494; https://doi.org/10.3390/rs14184494
Submission received: 31 July 2022 / Revised: 2 September 2022 / Accepted: 6 September 2022 / Published: 9 September 2022

Abstract

:
In the fields of positioning and navigation, the integrated inertial navigation system (INS)/global navigation satellite systems (GNSS) are frequently employed. Currently, high-precision INS typically utilizes fiber optic gyroscopes (FOGs) and quartz flexural accelerometers (QFAs) rather than MEMS sensors. But when GNSS signals are not available, the errors of high-precision INS also disperse rapidly, similar to MEMS-INS when GNSS signals would be unavailable for a long time, leading to a serious degradation of the navigation accuracy. This paper presents a new AI-assisted method for the integrated high-precision INS/GNSS navigation system. The position increments during GNSS outage are predicted by the convolutional neural network-gated recurrent unit (CNN-GRU). In the process, the CNN is utilized to quickly extract the multi-dimensional sequence features, and GRU is used to model the time series. In addition, a new real-time training strategy is proposed for practical application scenarios, where the duration of the GNSS outage time and the motion state information of the vehicle are taken into account in the training strategy. The real road test results verify that the proposed algorithm has the advantages of high prediction accuracy and high training efficiency.

1. Introduction

Global Navigation Satellite systems (GNSS) can provide accurate position and velocity information in outdoor environments, and its errors do not accumulate over time [1]. The disadvantages are that it can only provide less accuracy attitude information, the output frequency is low (1–20 Hz), and it is vulnerable to environmental interference. In contrast, the Inertial Navigation System (INS) is less dependent on the environment, and relies entirely on the angular velocity and acceleration information that is measured by the Inertial Measurement Unit (IMU), which can provide high-frequency navigation information [2,3]. But the position error will disperse over time due to the integral acquisition of positional information, resulting large errors in navigation results. Therefore, combining the respective advantages of GNSS and INS to obtain the navigation results with high accuracy, high interference immunity, and high frequency is a hot topic of research in the field of navigation at present [4,5].
The Kalman filter (KF) and its upgrade variants are the most widely utilized algorithms for INS and GNSS information fusion [6,7]. The traditional Kalman filter algorithm can only be applied to linear systems, but most of the information in real navigation systems are nonlinear. Bucy et al. [8] proposed the extended Kalman filter (EKF), which linearizes the nonlinear function around the current estimate, and truncates the first-order linearization of the Taylor expansion of the nonlinear function. The remaining higher-order terms are ignored, and their performance depends on the degree of local nonlinearity. The unscented Kalman filter (UKF) was proposed to further improve the performance under nonlinear systems by making the nonlinear system equations applicable to linear assumptions through lossless transformations [9,10]. By approximating the posterior probability density of the state with a series of deterministic samples, the problem of the EKF accuracy dispersion under a highly nonlinear system is avoided. But the UKF has low accuracy in the high-dimensional case, the cubature Kalman filter (CKF) that is based on the spherical radial volume criterion is applied to data fusion, which can effectively approximate the Gaussian density function with higher accuracy, convenient parameter selection, and good convergence effect [11,12,13]. In order to improve the fusion accuracy in complex measurement environments, robust Kalman algorithms have also started to attract the attention of researchers [14,15]. To solve the problem of error model that is caused by measurement anomalies, Chen et al. [16] proposed a new cardinal maximum correlation entropy Kalman filter, which uses the robust maximum correlation entropy criterion (MCC) as the optimality criterion to solve the state estimation problem under outlier interference by maximizing the correlation entropy between states and measurements. Yun et al. [17] proposed a variational Bayesian-based state estimation algorithm to improve the CKF accuracy under dynamic model mismatch and outlier disturbance.
When the GNSS signals are unavailable, KF operates in predictive mode and corrects INS measurements according to the system error model. At this time, the accuracy of data fusion that relies only on the KF is not effective and navigation performance deteriorates rapidly. To improve the integrated navigation accuracy during GNSS outage, machine learning has started to be applied to integrated navigation systems. Ning et al. [18] proposed an optimal radial basis function (RBF)-based neural network that can improve the overall positioning accuracy during short-term GNSS signal outages. Hang et al. [19] proposed a new hybrid intelligence algorithm combining a discrete gray predictor (DGP) and a multilayer perceptron (MLP) neural network that provides pseudo-GPS positions during GNSS failures and uses GNSS position information from the last few moments to predict positions for future moments. Compared with traditional artificial neural networks, recurrent neural networks are more advantageous in combined navigation systems and can make full use of historical information [20,21,22]. Liu et al. [23] proposed a multi-channel long-short term memory (LSTM) network to predict the increments of vehicle position, which reduces the navigation error in case of GNSS outages by an order of magnitude. In practical applications, a large amount of historical data before the GNSS outage needs to be trained when the GNSS outage occurs, so the training efficiency of neural networks also has high requirements. Tang et al. [24] proposed a hybrid algorithm that was based on the gated recurrent unit (GRU) and adaptive Kalman filter (AKF), and the experimental results showed that GRU outperformed LSTM in terms of prediction accuracy and training efficiency. Zhi et al. [25] proposed a convolutional neural network-long short-term memory (CNN-LSTM) model, which uses convolutional neural network (CNN) to quickly extract the features of the input and LSTM network to output the pseudo-GPS signal, further improving the training efficiency. However, most of the current articles use the offline simulation, assuming that the GNSS failure time is known and do not consider the time that is required to train the model online. Al Bitar et al. [26] proposed a novel real-time training strategy for regular training on the past one minute data, with the disadvantage that only short historical data are used and the accuracy is poor when the time of GNSS outage is long.
To overcome the shortcomings of the traditional methods, our paper proposes a new AI-assisted method for the integrated high-precision INS/GNSS navigation system. The method consists of two parts: first, CKF is used to provide more accurate neural network training samples. Then, by building a CNN-GRU network to predict the position increments during GNSS outage, the CNN is utilized to quickly extract the multi-dimensional sequence features, and GRU is used to model the time series. In addition, a new real-time training strategy is proposed for practical application scenarios, where the duration of the GNSS outage time and the motion state information of the vehicle are taken into account in the training strategy. The experiments verify that the proposed algorithm has the advantages of high prediction accuracy and high training efficiency.
The rest of the paper is organized as follows: Section 2 introduces the INS error propagation model and the integrated navigation model that is based on CKF, Section 3 introduces the proposed CNN-GRU network, Section 4 performs the road test and result analysis, and the conclusion is presented in Section 5.

2. Mathematical Integrated System Model

The INS and GNSS are loosely coupled as shown in Figure 1. The INS and GNSS can complete position and velocity independently. Then, the position and velocity errors of INS are estimated using CKF, and these errors are used to correct the navigation output of INS and achieve the correction of gyro and accelerometer drift, thus reducing the impact of INS errors. In this section, we derive the error propagation model of INS, and then introduce the integrated navigation model that is based on CKF.

2.1. The Error Propagation Model

By integrating the angular velocity that is measured by gyro, the attitude direction of the inertial component can be obtained. By using the directional cosine matrix of the attitude direction, the specific force components of the accelerometer observations along each axis of the carrier system can be converted to the navigation coordinate system, the velocity and position can be calculated.
In the process of attitude calculation, the navigation coordinate system that is obtained is regarded as the real navigation coordinate system. In practice, due to the interference of various factors, the calculated navigation coordinate system will have deviations compared to the real navigation coordinate system, and the attitude error equation can be expressed as:
ϕ ˙ = ϕ × ω i n n + δ ω i n n δ ω i b n ,
where δ ω i n n = δ ω i e n + δ ω e n n is the angular velocity error in the navigation coordinate system, δ ω i e n is the angular velocity error of the Earth’s rotation, δ ω e n n is the rotation error of the navigation system, δ ω i b n = C b n δ ω i b b = C b n [ ( δ K G + δ G ) ω i b b + ε b ] is the gyro measurement error, ε b is the gyro drift error, and δ K G and δ G are the gyro scale factor error and non-orthogonal installation error, which can be expressed as:
δ K G = diag ( [ δ K G x δ K G y δ K G z ] ) δ G = [ 0 δ G z δ G y δ G z 0 δ G x δ G y δ G x 0 ]
Both calibration residuals and installation errors can be considered as constants, while random drift can be expressed as a cumulative model of random constants and a first-order Markov model. In the presence of attitude error and specific force measurement error, the velocity differential error can be expressed as:
δ v ˙ n = f s f n × ϕ + ( 2 δ ω i e n + δ ω e n n ) × v n ( 2 ω i e n + ω e n n ) × δ v n + δ f s f n + δ g n
where δ f s f n is the accelerometer measurement error, which can be expressed as the cumulative model of accelerometer zero deviation and white noise.
δ g n = [ 0 β 3 ( sin 2 L · δ h + 2 h cos 2 L · δ L ) [ g e sin 2 L ( β 4 β 1 cos 2 L ) δ L β 2 δ h ] ]
where β is the gravity flattening, β 1 = 2.32718 × 10 5 s 2 , β 2 = 3.08 × 10 6 s 2 , β 3 = 8.08 × 10 9 s 2 .
The position error is [27]:
{ δ L ˙ = 1 R M + h δ v N v N ( R M + h ) 2 δ h δ λ ˙ = sec L R N + h δ v E + v E sec L tan L R N + h δ L v E sec L ( R N + h ) 2 δ h δ h ˙ = δ v U ,

2.2. The Integrated Navigation Model Based on CKF

In the integrated navigation system, the CKF estimation is adopted to estimate the system state vector which is a 15 array vector:
X = [ φ e   φ n   φ u   δ V e   δ V n   δ V u   δ L   δ λ   δ h   x   y   z   ε x   ε y   ε z ] T
where φ e , φ n , and φ u denote the attitude error angles of the INS in the east, north, and zenith directions. δ V e , δ V n , and δ V u denote the velocity error of INS in the three directions. δ L , δ λ , and δ h denote the latitude error, longitude error, and altitude error. x , y , and z   are the accelerometer bias vectors, and ε x , ε y , and ε z are the gyro bias vectors.
The equation of state and measurement equation of the system can be expressed as:
{ X ˙ = F X + G W Z = H X + V
where F is the system state transfer matrix, which consists of the INS system error. G is the system noise matrix. Z is the measurement vector, which is set to the position error vector and velocity error vector of INS and GNSS. H is the observation matrix. W is the process noise vector. V denotes the measured noise vector.
The CKF is based on the 3rd order volume rule and is suitable for high-dimensional filtering problems. The computation consists of two steps: the time update and measurement update phase, as shown in Algorithm 1.
Algorithm 1: Cubature Kalman Filter.
Require: x ^ k 1 k 1 , P k 1 k 1 , Q k 1 , R k
for i = 1 , , N do
x k 1 i = S k 1 k 1 ξ i + x ^ k 1 k 1
w k 1 i = 1 / N
end for
Prediction phase:
x ^ k k 1 = i = 1 N w k 1 i f ( x k 1 i )
P k k 1 = i = 1 N w k 1 i ( f ( x k 1 i ) x ^ k k 1 ) ( f ( x k 1 i ) x ^ k k 1 ) T + Q k 1
for i = 1 , , N do
x k k 1 i = S k k 1 ξ i + x ^ k k 1
w k k 1 i = 1 / N
end for
Update phase:
z ^ k k 1 = i = 1 N w k k 1 i   h ( x k k 1 i )
P k k 1 z z = i = 1 N w k k 1 i (   h ( x k k 1 i ) z ^ k k 1 ) ( h ( x k k 1 i ) z ^ k k 1 ) T + R k
P k k 1 x z = i = 1 N w k k 1 i ( x k k 1 i x ^ k k 1 ) ( h ( x k k 1 i ) z ^ k k 1 ) T

3. CNN-GRU

The overall architecture of our method is shown in Figure 2. In this paper, we use a loosely coupled integrated navigation scheme that is based on the combination of CKF and CNN-GRU. The CKF module provides highly accurate position, velocity, attitude, and IMU error information. The inputs and outputs of the network are shown in Figure 2, where W I and F I are the angular velocity and specific force that are provided by the IMU, A I N S and V I N S are the attitude and velocity information that is calculated by the INS. The outputs of the network are the position increments δ P output by the CKF module, which are integrated as the pseudo-GNSS position information. When the GNSS signals are available, the CNN-GRU module operates in learning mode. When the GNSS signals become unavailable, the CNN-GRU module operates in prediction mode, and the pseudo-GNSS position increments are predicted to ensure navigation accuracy. Specifically, three operating modes are included: learning mode when the GNSS signals are available, prediction mode and learning mode during GNSS short-term outage, and prediction mode during GNSS long-term outage. When the GNSS signals are available, the length of each learning sample is 2 min and the learning interval is controlled in 1 min. The reason for choosing – min is that most GNSS interruption scenarios last less than 2 min, and the purpose of the learning interval is to reset the CKF filter. When the GNSS signals are unavailable, the model that was trained in the previous phase is used for prediction, while the previous historical data are used for training the new fine model, and the model is switched to the new fine model to improve the prediction accuracy when the GNSS signals that are interrupted exceed 2 min. In order to ensure that the training of historical data can be completed within 2 min, we consider the differences of the model under different motion states of the vehicle and reduce the length of the training data. The decision is done using the vehicle motion state according to the output data of INS, which are zero speed, zero angular speed, zero lateral speed, and zero vertical speed, and stop saving data when a period of continuous motion state exceeds five minutes, thus improving the training efficiency.
The CNN-GRU networks consist of a one-dimensional version of CNN, GRU, and a fully connected layer. Since the inputs involve multiple sensors and the coupling of multidimensional motion information, the intake features need to be extracted more accurately, so the CNN is used to quickly extract features from the sensor sequences. Since the vehicle motion and IMU sensor errors are time-dependent, the GRU is adopted to extract deeper hidden information from the sensor history data. Finally, a fully connected layer is used to obtain the final navigation information.
The structure of CNN is shown in Figure 3. CNN is one of the common network models in the field of deep learning, which is a multi-layer feedforward neural network with high generalization ability and robustness by local connectivity, weight sharing, and pooling operation [28]. The pooling layer is used to compress the high-dimensional features of the input after processing in the convolutional layer to reduce the parameter matrix dimension, which reduces the computational workload by reducing the parameters of the network. The fully connected layer can combine all of the local features into global features.
The GRU neural network is an improvement on the LSTM neural network. The LSTM neural network provides a new solution to the short-term memory problem and solves the problem of gradient disappearance and gradient explosion when the RNN exists to handle longer sequences. The GRU is simplified for the same estimation accuracy and higher training efficiency compared to the LSTM. The GRU model consists of two gates: the update gate and the reset gate. The update gate determines how much information from the previous state is brought into the current state. The larger the update gate is, the more the previous state is brought into the current state. The reset gate determines how the new input information is combined with the previous memory. The smaller the reset gate is, the more information about the previous state is ignored. The schematic diagram of GRU is shown in Figure 4.
GRU undertakes the most important task of sequence analysis, and the time-dependent nature of GRU makes training more difficult. Therefore, the core parameters are the size and structure of the GRU network. The hyperparameters that have the greatest impact on the performance include the number of GRU layers, the number of neurons, and the step size. Too many neurons lead to an overfitting phenomenon and degradation of the generalization performance, while insufficient number of neurons cannot fully extract the relationship between the input and output sequences, and too many GRU layers also lead to instability of the model. Considering the prediction accuracy and computation time, the number of GRU layers, the number of neurons, and the step size are set to 2, 48, and 2, respectively. The training time of the network increases with the above three hyperparameters. Two layers of GRU are sufficient to extract the hidden information, and too many layers can lead to overfitting.

4. Experiment Results

The road experiments were carried out on a vehicle platform using an INS/GNSS system, as shown in Figure 5. The INS system uses high-precision fiber optic gyroscope and quartz flexible accelerometer that was developed by our group. The GNSS receiver is Ublox NEO-M8T. The sampling frequency of the INS is set to 400 Hz, and the sampling frequency of the GNSS is 10 Hz. RTK GNSS provides the ground truth values. The specific parameters are shown in Table 1. Two typical road experiments were carried out. After the initial alignment, the INS/GNSS was started in a loosely coupled integrated navigation mode. The experimental locations were in Zhejiang Province, China:
(1)
Experiment 1: Urban roads as shown in Figure 6: the duration of the experiment is 1 h, and the road conditions include straight lines, turns, and lane changes. There were three segments of simulated GNSS signals interruptions that were introduced, and the signal interruption durations were 60 s, 180 s, and 300 s, respectively.
(2)
Experiment 2: Expressway including tunnels as shown in Figure 7: the duration of the experiment is 1 h, the road conditions are mainly long straight lines, and the driving trajectory contains multiple tunnels of different lengths to verify the performance of the proposed method in the case of real GNSS signals outage scenarios.
In order to verify the performance of the CNN-GRU-CKF that is proposed in our paper, we selected two typical road experiments, Experiment 1 focuses on urban roads, simulating GNSS interruptions by artificially turning off GNSS, while RTK is still working normally and can provide the ground truth of the position for verifying the algorithm accuracy. The GNSS signals interruption duration is 1 min, 3 min, and 5 min, respectively. In order to better reflect the effectivity of the algorithm, the trajectory containing the turn is deliberately chosen. When the GNSS signals are unavailable, the position information that is obtained by CNN-GRU prediction is used instead of the true GNSS information, and the measurement update process of CKF is carried out. Meanwhile, the performance of pure INS, MLP, and GRU is compared.
Due to the short GNSS outage time in the first period, the INS that is based on high precision fiber optic gyro shows high accuracy, as shown in Figure 8 and Figure 9, the position errors in the east and north direction during the 60 s GNSS outage are within 2 m. The horizontal direction error of 60 s outage is shown in Figure 10. It can be seen that when the horizontal error is at its maximum, its east and north errors are not necessarily the maximum. Due to the high accuracy of INS, the overall horizontal error is within 2 m, and the difference between the accuracy of different algorithms is not significant, and the turning point of error dispersion mainly occurs at the vehicle corners. The trajectories during this period are shown in the Figure 11, and it can be seen that the position errors are mainly generated at the corners. The maximum position errors are shown in Table 2. The proposed method in our paper reduces the maximum position error in the east direction by 58.61%, 67.05%, and 63.35% compared to pure INS, MLP, and GRU, respectively. The maximum position error in the north direction is similar, increasing by 4.44% and 12.74% compared to pure INS and GRU, reducing by 46.34% compared to MLP, and the maximum position in the horizontal direction error is reduced by 16.86%, 45.29%, and 35.34% compared to pure INS, MLP, and GRU, respectively. It can be seen that the accuracy of the RNN is significantly better than that of the MLP.
Figure 12 and Figure 13 show the position errors of the different algorithms in the east and north directions during the 120 s GNSS outage. It can be seen that the north position error of the pure INS has started to decrease. The horizontal direction error of 180 s outage is shown in Figure 14, and it can be seen that as the GNSS outage time increases to 3 min, the accuracy of the pure INS starts to dissipate, and the MLP method does not perform well, starting to dissipate from around 100 s. The trajectories during this period are shown in Figure 15. The maximum position errors are shown in Table 3. Compared to the pure INS, MLP, and GRU, the proposed method in this paper reduces the maximum position errors in the east direction by 92.00%, 89.95%, and 81.10%, in the north direction by 37.39%, 80.45%, and 56.96%, and in the horizontal direction by 86.66%, 86.08%, and 72.18%.
Since the GNSS outage time reached 300 s, the model was switched to the fine model when the GNSS outage time increase to more than two minutes. Figure 16 and Figure 17 show the position errors of the different algorithms in the east and north directions during the 300 s GNSS outage. It can be seen that the prediction performance of MLP for the north position error was unsatisfactory, while the effect of the direction that was proposed in our paper is obvious. Horizontal direction error of 300 s outage is shown in Figure 18. It can be seen that as the GNSS outage time increases to 5 min, the accuracy of both the pure INS and the MLP method begin to diverge, while the GRU and CNN-GRU accuracy is better maintained. The trajectories during this period are shown in the Figure 19. The trajectory that is predicted by the method that is proposed in our paper is close to the real trajectory. The maximum position errors are shown in Table 4. Compared to the pure INS, MLP, and GRU, the proposed method in our paper reduces the maximum position errors in the east direction by 93.96%, 77.60%, and 61.27%, in the north direction by 86.34%, 82.87%, and 57.67%, and in the horizontal direction by 93.36%, 84.58%, and 66.81%.
As shown in Figure 20, Experiment 2 contains five tunnels, with lengths of 1.3 km, 1.7 km, 3.2 km, 5.2 km, and 1.7 km, respectively. The first three sections of the tunnel are closely spaced which is specifically designed to more accurately show the algorithms’ effectiveness. As shown in Figure 21, the compensation effect of different algorithms for the first three tunnel sections can be seen. Since RTK cannot obtain position information in the tunnel, we choose the horizontal position error at the end of the tunnel as the evaluation index, and the results are shown in Table 5. Compared with pure INS, MLP, and GRU, the method that was proposed in this paper reduces the average horizontal position error at the end of the tunnel by 66.07%, 59.85%, and 36.50%.

5. Conclusions

In order to improve the positioning accuracy of integrated INS/GNSS navigation during GNSS outage, our paper proposes a new AI-assisted method. The method consists of two parts: first, CKF is used to provide more accurate positioning results. Then, by building a CNN-GRU network we can predict the position increments during GNSS outage. In the process, the CNN is utilized to quickly extract the multi-dimensional sequence features, and GRU is used to model the time series. In addition, a new real-time training strategy is proposed for practical application scenarios, where the duration of the GNSS outage time and the motion state information of the vehicle are taken into account in the training strategy. The experimental results show that compared with pure INS, MLP, and GRU, the proposed method reduces the maximum position error in the horizontal direction by 93.36%, 84.58%, and 66.81% in the 5 min simulated GNSS disruption experiments compared to the pure INS, MLP, and GRU, respectively. In the real GNSS failure scenario, the average horizontal position error at the end of the tunnel using our method is reduced by 66.07%, 59.85%, and 36.50%. The algorithm can provide real-time high-precision navigation results with high efficiency and has a good reduction effect on the error dispersion that is caused by prolonged GNSS failure.

Author Contributions

Methodology, writing—original draft preparation, software, S.Z.; Investigation, writing—reviewing and editing, Y.Z.; Supervision, conceptualization, T.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hightower, J.; Borriello, G. Location Systems for Ubiquitous Computing. Computer 2001, 34, 57–66. [Google Scholar] [CrossRef]
  2. Barbour, N.; Schmidt, G. Inertial Sensor Technology Trends. IEEE Sens. J. 2001, 1, 332–339. [Google Scholar] [CrossRef]
  3. Lee, B. Review of the Present Status of Optical Fiber Sensors. Opt. Fiber Technol. 2003, 9, 57–79. [Google Scholar] [CrossRef]
  4. Godha, S.; Cannon, M.E. GPS/MEMS INS Integrated System for Navigation in Urban Areas. GPS Solut. 2007, 11, 193–203. [Google Scholar] [CrossRef]
  5. Zhang, Q.; Niu, X.; Shi, C. Assessment of the Effect of GNSS Sampling Rate on GNSS/INS Relative Accuracy on Different Time Scales for Precision Measurements. Measurement 2019, 145, 583–593. [Google Scholar] [CrossRef]
  6. Falco, G.; Pini, M.; Marucco, G. Loose and Tight GNSS/INS Integrations: Comparison of Performance Assessed in Real Urban Scenarios. Sensors 2017, 17, 255. [Google Scholar] [CrossRef]
  7. Li, Q.; Li, R.; Ji, K.; Dai, W. Kalman Filter and Its Application. In Proceedings of the 2015 8th International Conference on Intelligent Networks and Intelligent Systems (ICINIS), Tianjin, China, 1–3 November 2015; pp. 74–77. [Google Scholar]
  8. Kalman, R.E.; Bucy, R.S. New Results in Linear Filtering and Prediction Theory. J. Basic Eng. 1961, 83, 95–108. [Google Scholar] [CrossRef]
  9. Costanzi, R.; Fanelli, F.; Meli, E.; Ridolfi, A.; Caiti, A.; Allotta, B. UKF-Based Navigation System for AUVs: Online Experimental Validation. IEEE J. Ocean. Eng. 2019, 44, 633–641. [Google Scholar] [CrossRef]
  10. Al Bitar, N.; Gavrilov, A. A Novel Approach for Aiding Unscented Kalman Filter for Bridging GNSS Outages in Integrated Navigation Systems. Navigation 2021, 68, 521–539. [Google Scholar] [CrossRef]
  11. Shen, C.; Zhang, Y.; Guo, X.; Chen, X.; Cao, H.; Tang, J.; Li, J.; Liu, J. Seamless GPS/Inertial Navigation System Based on Self-Learning Square-Root Cubature Kalman Filter. IEEE Trans. Ind. Electron. 2021, 68, 499–508. [Google Scholar] [CrossRef]
  12. Song, R.; Fang, Y. Vehicle State Estimation for INS/GPS Aided by Sensors Fusion and SCKF-Based Algorithm. Mech. Syst. Signal Process. 2021, 150, 107315. [Google Scholar] [CrossRef]
  13. Cui, B.; Wei, X.; Chen, X.; Li, J.; Li, L. On Sigma-Point Update of Cubature Kalman Filter for GNSS/INS Under GNSS-Challenged Environment. IEEE Trans. Veh. Technol. 2019, 68, 8671–8682. [Google Scholar] [CrossRef]
  14. Cui, B.; Chen, X.; Tang, X.; Huang, H.; Liu, X. Robust Cubature Kalman Filter for GNSS/INS with Missing Observations and Colored Measurement Noise. ISA Trans. 2018, 72, 138–146. [Google Scholar] [CrossRef] [PubMed]
  15. Wei, X.; Li, J.; Zhang, D.; Feng, K. An Improved Integrated Navigation Method with Enhanced Robustness Based on Factor Graph. Mech. Syst. Signal Process. 2021, 155, 107565. [Google Scholar] [CrossRef]
  16. Chen, B.; Liu, X.; Zhao, H.; Principe, J.C. Maximum Correntropy Kalman Filter. Automatica 2017, 76, 70–77. [Google Scholar] [CrossRef]
  17. Yun, P.; Wu, P.; He, S.; Li, X. A Variational Bayesian Based Robust Cubature Kalman Filter under Dynamic Model Mismatch and Outliers Interference. Measurement 2022, 191, 110063. [Google Scholar] [CrossRef]
  18. Ning, Y.; Wang, J.; Han, H.; Tan, X.; Liu, T. An Optimal Radial Basis Function Neural Network Enhanced Adaptive Robust Kalman Filter for GNSS/INS Integrated Systems in Complex Urban Areas. Sensors 2018, 18, 3091. [Google Scholar] [CrossRef]
  19. Zhang, Y.; Wang, L. A Hybrid Intelligent Algorithm DGP-MLP for GNSS/INS Integration during GNSS Outages. J. Navig. 2019, 72, 375–388. [Google Scholar] [CrossRef]
  20. LeCun, Y.; Bengio, Y.; Hinton, G. Deep Learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  21. Hochreiter, S.; Schmidhuber, J. Long Short-Term Memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
  22. Zhao, S.; Zhou, Y.; Shu, X. Study on Nonlinear Error Calibration of Fiber Optical Gyroscope Scale Factor Based on LSTM. Measurement 2022, 190, 110783. [Google Scholar] [CrossRef]
  23. Liu, J.; Guo, G. Vehicle Localization During GPS Outages with Extended Kalman Filter and Deep Learning. IEEE Trans. Instrum. Meas. 2021, 70, 7503410. [Google Scholar] [CrossRef]
  24. Tang, Y.; Jiang, J.; Liu, J.; Yan, P.; Tao, Y.; Liu, J. A GRU and AKF-Based Hybrid Algorithm for Improving INS/GNSS Navigation Accuracy during GNSS Outage. Remote Sens. 2022, 14, 752. [Google Scholar] [CrossRef]
  25. Zhi, Z.; Liu, D.; Liu, L. A Performance Compensation Method for GPS/INS Integrated Navigation System Based on CNN–LSTM during GPS Outages. Measurement 2022, 188, 110516. [Google Scholar] [CrossRef]
  26. Al Bitar, N.; Gavrilov, A. A New Method for Compensating the Errors of Integrated Navigation Systems Using Artificial Neural Networks. Measurement 2021, 168, 108391. [Google Scholar] [CrossRef]
  27. Savage, P.G. Strapdown Inertial Navigation Integration Algorithm Design Part 2: Velocity and Position Algorithms. J. Guid. Control Dyn. 1998, 21, 208–221. [Google Scholar] [CrossRef]
  28. Alom, M.Z.; Taha, T.M.; Yakopcic, C.; Westberg, S.; Sidike, P.; Nasrin, M.S.; Hasan, M.; Van Essen, B.C.; Awwal, A.A.S.; Asari, V.K. A State-of-the-Art Survey on Deep Learning Theory and Architectures. Electronics 2019, 8, 292. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Flowchart of the loosely coupled integrated system.
Figure 1. Flowchart of the loosely coupled integrated system.
Remotesensing 14 04494 g001
Figure 2. The overall architecture of the proposed method (a) GNSS is available; (b) GNSS ioutage (less than 2 min); (c) GNSS outage (more than 2 min).
Figure 2. The overall architecture of the proposed method (a) GNSS is available; (b) GNSS ioutage (less than 2 min); (c) GNSS outage (more than 2 min).
Remotesensing 14 04494 g002
Figure 3. The structure of CNN.
Figure 3. The structure of CNN.
Remotesensing 14 04494 g003
Figure 4. The structure of GRU.
Figure 4. The structure of GRU.
Remotesensing 14 04494 g004
Figure 5. Data acquisition vehicle platform.
Figure 5. Data acquisition vehicle platform.
Remotesensing 14 04494 g005
Figure 6. The vehicle trajectory in Experiment 1.
Figure 6. The vehicle trajectory in Experiment 1.
Remotesensing 14 04494 g006
Figure 7. The vehicle trajectory in Experiment 2.
Figure 7. The vehicle trajectory in Experiment 2.
Remotesensing 14 04494 g007
Figure 8. The east position error result of 60 s outage of Experiment 1.
Figure 8. The east position error result of 60 s outage of Experiment 1.
Remotesensing 14 04494 g008
Figure 9. The north position error result of 60 s outage of Experiment 1.
Figure 9. The north position error result of 60 s outage of Experiment 1.
Remotesensing 14 04494 g009
Figure 10. The horizontal position error result of 60 s outage of Experiment 1.
Figure 10. The horizontal position error result of 60 s outage of Experiment 1.
Remotesensing 14 04494 g010
Figure 11. The trajectories of 60 s outage of Experiment 1.
Figure 11. The trajectories of 60 s outage of Experiment 1.
Remotesensing 14 04494 g011
Figure 12. The east position error result of 180 s outage of Experiment 1.
Figure 12. The east position error result of 180 s outage of Experiment 1.
Remotesensing 14 04494 g012
Figure 13. The north position error result of 180 s outage of Experiment 1.
Figure 13. The north position error result of 180 s outage of Experiment 1.
Remotesensing 14 04494 g013
Figure 14. The horizontal position error result of 180 s outage of Experiment 1.
Figure 14. The horizontal position error result of 180 s outage of Experiment 1.
Remotesensing 14 04494 g014
Figure 15. The trajectories of 180 s outage of Experiment 1.
Figure 15. The trajectories of 180 s outage of Experiment 1.
Remotesensing 14 04494 g015
Figure 16. The east position error result of 300 s outage of Experiment 1.
Figure 16. The east position error result of 300 s outage of Experiment 1.
Remotesensing 14 04494 g016
Figure 17. The north position error result of 300 s outage of Experiment 1.
Figure 17. The north position error result of 300 s outage of Experiment 1.
Remotesensing 14 04494 g017
Figure 18. The horizontal position error result of 300 s outage of Experiment 1.
Figure 18. The horizontal position error result of 300 s outage of Experiment 1.
Remotesensing 14 04494 g018
Figure 19. The trajectories of 300 s outage of Experiment 1.
Figure 19. The trajectories of 300 s outage of Experiment 1.
Remotesensing 14 04494 g019
Figure 20. The trajectories of Experiment 2.
Figure 20. The trajectories of Experiment 2.
Remotesensing 14 04494 g020
Figure 21. The trajectories of periods #1-3 of Experiment 2.
Figure 21. The trajectories of periods #1-3 of Experiment 2.
Remotesensing 14 04494 g021
Table 1. The parameters of the sensors.
Table 1. The parameters of the sensors.
Fiber optic gyroscopeBias
Scale factor
Angular Random walk
0.02°/h
10 ppm
0.002°/ h
Quartz Flexible AccelerometerBias
Scale factor
10 ug
20 ppm
GNSS(Ublox NEO-M8T)Position accuracy
Velocity accuracy
2.5 m
0.05 m/s
RTK GNSS
(NovAtel ProPak6)
Position accuracy3 cm
Table 2. Maximum position error of 60 s outage of Experiment 1.
Table 2. Maximum position error of 60 s outage of Experiment 1.
East Error
(m)
North Error
(m)
Horizontal Error
(m)
Pure INS1.380.961.38
MLP1.741.862.10
GRU1.560.891.78
Our method0.571.001.15
Table 3. Maximum position error of 180 s outage of Experiment 1.
Table 3. Maximum position error of 180 s outage of Experiment 1.
East Error
(m)
North Error
(m)
Horizontal Error
(m)
Pure INS49.42 8.58 50.03
MLP39.35 27.49 47.93
GRU20.92 12.49 23.98
Our method3.95 5.37 6.67
Table 4. Maximum position error of 300 s outage of Experiment 1.
Table 4. Maximum position error of 300 s outage of Experiment 1.
East Error
(m)
North Error
(m)
Horizontal Error
(m)
Pure INS111.4855.81124.67
MLP30.0844.5153.72
GRU17.4018.0124.96
Our method6.747.628.28
Table 5. Horizontal position error at the end of the different tunnels.
Table 5. Horizontal position error at the end of the different tunnels.
#1
(m)
#2
(m)
#3
(m)
#4
(m)
#5
(m)
Pure INS2.565.276.8218.916.57
MLP7.466.945.779.624.12
GRU3.965.823.495.522.65
Our method1.903.022.524.361.81
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhao, S.; Zhou, Y.; Huang, T. A Novel Method for AI-Assisted INS/GNSS Navigation System Based on CNN-GRU and CKF during GNSS Outage. Remote Sens. 2022, 14, 4494. https://doi.org/10.3390/rs14184494

AMA Style

Zhao S, Zhou Y, Huang T. A Novel Method for AI-Assisted INS/GNSS Navigation System Based on CNN-GRU and CKF during GNSS Outage. Remote Sensing. 2022; 14(18):4494. https://doi.org/10.3390/rs14184494

Chicago/Turabian Style

Zhao, Shuai, Yilan Zhou, and Tengchao Huang. 2022. "A Novel Method for AI-Assisted INS/GNSS Navigation System Based on CNN-GRU and CKF during GNSS Outage" Remote Sensing 14, no. 18: 4494. https://doi.org/10.3390/rs14184494

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop