2.1. GNSS and 5G Error Characteristics for Fusion
GNSS positioning estimates the receiver position from satellite observations. In open-sky environments, sufficient satellite visibility and favorable geometry usually lead to stable meter-level positioning. However, in dense urban environments, satellite blockage, multipath propagation, and reduced satellite visibility can significantly degrade the reliability of GNSS-derived position observations.
For the proposed fusion algorithm, GNSS errors are mainly considered from the perspective of observation reliability. Satellite-end errors, propagation-path errors, and receiver-end errors jointly affect the GNSS-derived position observation. Among these errors, multipath propagation and signal blockage are particularly important because they can produce abrupt position jumps and abnormal residuals. These abnormal GNSS observations are later detected using the Mahalanobis-distance criterion combined with INS-based motion-continuity constraints.
In addition, the number of visible GNSS satellites is used as a direct indicator of GNSS observation availability. A larger number of visible satellites generally improves geometric redundancy and positioning reliability, whereas a small number of satellites indicates degraded or unreliable GNSS observations. Therefore, the satellite number
is used in the observation-quality-aware covariance-regulation strategy in
Section 2.4.
In this study, the 5G positioning subsystem provides TDOA-based position observations derived from PRS measurements. The gNodeBs transmit PRS signals, the UE measures arrival-time differences, and the LMF estimates the terminal position. The resulting 5G-derived position observation is then used as one measurement source in the proposed GNSS/5G/INS fusion framework.
Figure 2 shows the schematic diagram of the TDOA positioning principle.
The reliability of 5G-derived position observations is affected by base-station availability, synchronization accuracy, NLOS propagation, multipath effects, terminal measurement noise, and base-station coordinate error. Among these factors, NLOS and multipath errors are dominant in dense urban and indoor environments because they can introduce biased or abruptly varying range-difference measurements. The total 5G observation error can be summarized as
where
denotes the base-station synchronization error,
denotes the multipath-induced error,
denotes the NLOS error,
denotes the terminal measurement error, and
denotes the base-station coordinate error.
These error characteristics motivate two subsequent designs in the proposed method. First, abnormal GNSS and 5G observations are detected using statistical residual information and INS-based motion-continuity constraints. Second, the observation availability indicators and are used to dynamically regulate the relative confidence assigned to the external measurement sources, namely GNSS and 5G, in the UKF measurement update. INS is not assigned an observation-quality weight in this module; instead, it contributes through state prediction and INS-based motion-continuity constraints.
2.2. Overall Framework of the Proposed Fusion Method
This study develops a hierarchical fusion positioning framework composed of three modules: multi-sensor data preprocessing and error suppression, robust UKF-based nonlinear state estimation, and observation-quality-aware adaptive weighting. Using GNSS, 5G, and INS observations as inputs, the framework produces accurate and robust position estimates through the interaction of the three modules. First, the preprocessing layer reduces systematic sensor bias and random gross errors, thereby providing reliable observations for subsequent fusion. Second, the UKF filtering layer introduces a scenario-based state transition model and an adaptive sigma-point shrinkage mechanism, which can accurately handle the nonlinear characteristics of inertial navigation integration and sensor observation mapping, while suppressing filtering divergence caused by abnormal observations. Finally, the observation-quality-aware adaptive weighting layer dynamically regulates the effective measurement weights of GNSS and 5G based on the number of visible GNSS satellites and available 5G base stations, enabling smooth measurement-confidence transitions among open, semi-occluded, and fully occluded scenarios.
The novelty of the proposed framework lies in the closed-loop interaction among the three modules. The preprocessing module does not simply remove outliers independently; instead, it provides reliability-enhanced observations for the robust UKF. The UKF module further evaluates the innovation consistency and adaptively shrinks the sigma-point covariance when abnormal residuals occur. The weighting module then adjusts the external-observation confidence according to GNSS and 5G availability, ensuring that the final posterior estimate is obtained through quality-aware UKF measurement updating rather than a simple post-filter weighted average.
To avoid ambiguity, the proposed hierarchical fusion framework does not perform a secondary post-filter weighted average of standalone GNSS, 5G, and INS positioning results. Instead, GNSS- and 5G-derived position observations are used as measurement inputs of the UKF, while INS information is used for state prediction. The observation-quality-aware weights are introduced into the UKF by adaptively adjusting the effective measurement covariance matrices. Therefore, the final positioning output is the posterior position estimate extracted from the UKF state vector.
The following subsections describe the theoretical models, key equations, and implementation details of each module.
Figure 3 shows the overall framework diagram of the algorithm.
The left module performs multi-sensor data preprocessing and error suppression using GNSS, 5G, and INS observations as inputs. Through real-time bias calibration and cross-source gross-error detection, this module provides reliable observations for subsequent fusion. The middle module performs robust UKF-based nonlinear state estimation using the preprocessed multi-sensor data. First, it performs sigma point generation and prediction to obtain predicted states and predicted observations. Then, an adaptive sigma-point shrinkage mechanism is introduced: by comparing the observation residuals with statistically determined chi-square thresholds, it adaptively selects either actual observations or predicted values to participate in the update process. Finally, it completes UKF state estimation, achieving accurate processing of nonlinear characteristics such as INS integration and sensor observation mapping, while suppressing filtering divergence caused by abnormal observations. The right module implements observation-quality-aware covariance regulation. Based on the numbers of available GNSS satellites and 5G base stations, this module dynamically adjusts the effective measurement confidence of GNSS and 5G. INS is not treated as an independent weighted positioning source; rather, it supports the UKF through state prediction and motion-continuity constraints.
For clarity, the GNSS-derived and 5G-derived position observations at epoch k are denoted as and , respectively. The INS mechanization-derived position prediction is denoted as . It should be noted that is not used as an independent post-filter positioning solution for final weighted averaging. In the proposed implementation, INS mechanization provides the state prediction and motion constraint for the UKF. The notation is used only to represent the INS-predicted position component before measurement correction. The UKF state vector and its posterior estimate are denoted as and , respectively. The position component extracted from the posterior state estimate is denoted as .
2.3. Dual-Domain Error Suppression
Inertial navigation was originally developed for military applications such as missiles, aircraft, and ships, utilizing inertial sensors including accelerometers and gyroscopes. Inertial sensors can be classified into navigation-grade, tactical-grade, industrial-grade, and consumer-grade sensors, with significant differences in their performance and cost. Inertial navigation uses measurements from accelerometers and gyroscopes to estimate the position, velocity, and attitude of a platform through algorithms such as INS mechanization, PDR, and motion constraints. In inertial navigation algorithms, because of inertial-sensor errors and integration errors, INS accuracy gradually degrades over time. By using self-contained inertial sensors, inertial navigation is independent of any external information and thus immune to external electromagnetic interference. It can be applied in various environments including aerial, terrestrial, and underwater scenarios, and is suitable for both vehicles and pedestrians. Inertial navigation provides position, velocity, and attitude solutions with high update rates, short-term accuracy, and good stability, but its drawback is that navigation errors accumulate over time, resulting in poor long-term accuracy.
The core principle of inertial navigation is to measure the motion states of the carrier (i.e., velocity and angular velocity) via inertial sensors (i.e., accelerometers and gyroscopes), and calculate the real-time position, velocity, and attitude of the carrier through integral operations based on Newton’s laws of motion. Essentially, it autonomously infers the motion trajectory relying solely on internal sensors without depending on external signals. The inertial navigation calculation consists of three steps: (1) attitude update, (2) velocity update, and (3) position update.
Attitude update calculates the attitude of the carrier in the navigation frame by measuring the angular velocity (unit: rad/s) of the carrier relative to the inertial frame using gyroscopes. The differential equation of the attitude angle can be obtained as follows:
where
,
, and
are the angular velocities measured by the gyroscope in the body frame;
,
, and
are the rates of change of the attitude angles. By integrating the above equations, the real-time attitude angles
,
, and
can be obtained.
Velocity calculation involves measuring the specific force of the carrier via the accelerometer, transforming it to the navigation frame, subtracting the gravitational acceleration to derive the true acceleration, and then performing integration to calculate the velocity. The transformation of the specific force from the body frame to the navigation frame is expressed as follows:
where
is the measured value of the accelerometer in the body frame,
is the attitude matrix, and
is the specific force in the navigation frame.
Then the acceleration in the navigation frame is calculated as follows:
where
denotes the gravitational acceleration in the navigation frame, and
represents the acceleration in the navigation frame.
Finally, the velocity is obtained by integrating the acceleration, which is expressed as follows:
where
is the initial velocity, and
is the velocity at time
.
Position is calculated by integrating velocity with respect to time. In the local navigation frame, the position is represented by latitude
L, longitude
, and height
h, which can be obtained from the following position differential equations:
where
R is the Earth radius, and
,
, and
are the rates of change of latitude, longitude, and height, respectively.
By integrating the above equations, the final position result can be obtained, which is expressed as follows:
INS biases are systematic errors of inertial sensors. In static/low-dynamic scenarios, the true acceleration and angular velocity of the carrier are approximately zero, where the sensor output is approximately equal to the bias and can be estimated via statistical methods.
Static or low-dynamic states can be detected by calculating the variance of the INS acceleration data within a sliding window:
The state is determined to be static or low-dynamic when , where is the threshold.
The threshold
was determined from the stationary calibration data collected before each experiment. Specifically, the variance of the accelerometer output was calculated over a stationary segment, and
was set as
where
denotes the accelerometer variance during the stationary calibration period and
is a safety coefficient. In this study,
was used to avoid falsely classifying low-dynamic motion as a stationary state.
Bias estimation is implemented in static scenarios. The sensor output is expressed as , where is the accelerometer output vector, is the accelerometer bias vector, and is the accelerometer noise vector.
The accelerometer bias can be obtained by calculating the window average as follows:
Similarly, the gyroscope bias can be obtained via estimation as follows:
where
denotes the gyroscope bias.
Then, the calibrated INS data can be obtained as follows:
The calibration reduces systematic INS bias, which is a major source of long-term drift. The calibrated INS data are closer to the true motion state and provide more reliable inputs for subsequent UKF-based state estimation.
Gross errors refer to abnormal observations that deviate significantly from the normal observation distribution. The Mahalanobis distance quantifies the deviation between the current observation and the historical normal observation set. In addition, physical motion continuity is used as a consistency constraint: GNSS/5G observation jumps should be consistent with the INS-derived displacement.
Let the GNSS historical normal observation set be
, where M denotes the size of the historical window. The mean and covariance can be obtained, respectively, as follows:
By statistically analyzing the past M normal GNSS observation data, a baseline model for the normal observation state is established.
The squared Mahalanobis statistic of the current GNSS observation is expressed as
Similarly, the squared Mahalanobis statistic for the 5G observation is
where
and
are the residuals with respect to the historical normal baselines, and
and
denote the corresponding covariance matrices of the historical normal observation sets.
Unlike Euclidean distance, the Mahalanobis distance incorporates the covariance of the historical observation set and is therefore more appropriate for residual distributions with unequal variance and inter-dimensional correlation.
These squared Mahalanobis statistics quantify the deviation of the current GNSS and 5G observations from their historical normal baselines. They are then combined with the normal fluctuation range to identify abnormal observations.
A consistency judgment is performed on the INS motion, and the INS reckoning step size is expressed as follows:
where
denotes the INS-derived velocity vector at time
.
The GNSS observation jump is defined as follows:
The position difference between two consecutive GNSS observations is used to represent the GNSS-derived displacement over the interval.
Similarly, the 5G observation jump is defined as
Here, and denote the GNSS and 5G measurement vectors; when the measurement vector is represented in position form, they correspond to and , respectively.
Based on this displacement comparison, the consistency judgment can be obtained as follows:
where
is the threshold. The tolerance coefficient
accounts for the short-term uncertainty of INS mechanization and the possible time synchronization error between external observations and INS data. A value slightly larger than 1 allows normal dynamic motion and small INS integration errors, whereas an excessively large value may allow abnormal GNSS/5G jumps to pass the consistency test. In this study,
was selected based on a preliminary calibration segment. This value provides a practical tolerance for short-term INS integration errors and small time-synchronization deviations while still preventing large GNSS/5G jumps from entering the subsequent fusion process.
By comparing the moving distance derived from GNSS observations with the INS-reckoned distance, it is determined whether the GNSS observations are consistent with the INS-derived motion, thereby preventing abnormal observation jumps from entering the fusion process.
The Mahalanobis distance is adopted in this study because it accounts for the covariance structure of historical observations and provides a lightweight statistical criterion for abnormal-observation detection without requiring labeled training data. Compared with simple Euclidean-distance or fixed-threshold residual tests, it is more suitable for multi-source positioning observations whose uncertainty varies with satellite visibility, base-station availability, and environmental occlusion. Compared with learning-based outlier detectors, it has lower computational complexity and is more appropriate for real-time GNSS/5G/INS fusion scenarios with limited training data and rapidly changing observation conditions.
However, the Mahalanobis-distance criterion alone may still produce false alarms when the platform undergoes rapid motion or when short-term observation fluctuations are caused by dynamic environmental changes rather than true gross errors. Therefore, this study further introduces INS-based motion-continuity constraints to assist abnormal-observation identification. By jointly considering residual statistics and physically plausible motion continuity, the proposed method can better distinguish true GNSS/5G outliers from temporarily disturbed but still usable observations.
Therefore, in the proposed framework, the Mahalanobis-distance test serves as a computationally efficient first-stage gross-error screening tool, while INS continuity constraints and the subsequent adaptive fusion modules further improve robustness. Although other approaches, such as learning-based outlier detection or robust estimation methods, may also be applied, the Mahalanobis-distance test is selected here as a practical compromise between statistical rigor, computational efficiency, and real-time deployability.
Instead of using a fixed empirical Mahalanobis-distance threshold, the rejection threshold for the first-stage gross-error screening is determined from the chi-square distribution. For
, the squared Mahalanobis statistic
is compared with
where
is the dimension of the corresponding observation vector and
is the significance level. In this study,
was used for gross-error rejection, corresponding to a 99% confidence level under the Gaussian residual assumption.
Therefore, the gross-error rejection rule is defined as
If both conditions are satisfied, the corresponding GNSS or 5G observation is rejected as a gross error before entering the UKF measurement update.
This method addresses the issue of random gross errors such as GNSS multipath interference and 5G NLOS errors, and prevents abnormal measurement vector from contaminating the UKF filtering process. In traditional filtering methods, gross errors in the input cause the state estimation to deviate drastically from the true value. Therefore, the proposed method ensures the reliability of the data source for subsequent fusion.
2.4. Adaptive-Shrinkage UKF and Quality-Aware Covariance Regulation
The UKF estimates nonlinear system states by propagating deterministically selected sigma points through the nonlinear state-transition and measurement functions. In this study, the standard UKF prediction-update structure is adopted, while robustness is enhanced through residual-driven sigma-point covariance shrinkage and quality-aware measurement covariance regulation.
The core states to be estimated by the fusion system are defined explicitly. The position, velocity, attitude angles required for positioning, as well as the key error sources of the inertial navigation system (INS) are integrated into a unified state vector. The fusion state is given by:
where
denotes the position,
denotes the velocity,
denotes the attitude-angle vector, and
and
denote the accelerometer bias and gyroscope bias, respectively.
The dynamic evolution law of the system state is described by the state transition model:
where
is the state-transition matrix,
is the control-input matrix,
is the control-input vector, and
is the process-noise vector. This model quantifies the state transition from time
to
k, and the introduction of process noise reflects the uncertainty of the system dynamic model.
To address the nonlinear characteristics of the positioning system, the UKF generates sigma points to approximate the Gaussian distribution of the state. Here, n denotes the dimension of the state vector. Since the proposed fusion state contains position, velocity, attitude angles, accelerometer bias, and gyroscope bias, , and thus sigma points are generated at each epoch. The term is dimensionless because it denotes the number of deterministic sampling points rather than a physical measurement.
Based on
and
,
sigma points can be generated as follows:
The generated sigma points are substituted into the nonlinear state equation to complete state prediction. The predicted state mean and covariance are then obtained as follows:
The a priori state mean is calculated as:
The a priori covariance matrix is calculated as:
When the normalized innovation squared statistic exceeds the chi-square threshold, an observation anomaly or model mismatch is indicated.
We substitute the a priori predicted sigma points into the observation function and then obtain the theoretically expected measurement vector through weighting, i.e., the observation baseline predicted based on system dynamics. The predicted measurement vector is:
where
h denotes the observation function.
We subtract the predicted measurement vector from the current actual measurement vector to calculate the gap between the actual observation and the theoretical prediction. A smaller gap indicates a better match between the observation and the system dynamics; a larger gap may indicate observation anomalies.
The UKF measurement vector is constructed from the available external position observations after preprocessing and gross-error screening. When both GNSS and 5G observations are available, the measurement vector is defined as
where
is the position extraction matrix. If either GNSS or 5G observations are unavailable or rejected by the gross-error test, the corresponding rows are removed from
and
.
Therefore, GNSS and 5G observations are incorporated as external measurement updates, whereas INS contributes to the UKF through state prediction and motion constraints rather than as an independent post-filter position solution.
We calculate the uncertainty of this gap, i.e., the fluctuation range that the gap should have under normal conditions. The residual covariance is:
To avoid the arbitrariness of a fixed
threshold, the UKF innovation consistency test is performed using the normalized innovation squared (NIS) statistic. For
, the innovation vector is defined as
The NIS statistic is calculated as
where
denotes the innovation covariance matrix corresponding to the j-th observation source, which is obtained from the corresponding block of
. Under the Gaussian innovation assumption,
approximately follows a chi-square distribution with
degrees of freedom. Therefore, the detection threshold is defined as
If , the corresponding observation is regarded as degraded and its measurement covariance is inflated before the UKF measurement update.
When an observation anomaly occurs, a shrinkage factor
is introduced to adjust the sigma-point covariance:
Here, controls the conservativeness of the UKF prediction under abnormal innovations. A smaller reduces the influence of abnormal observations more strongly but may also weaken the filter’s responsiveness to real motion changes. In this study, is used as a conservative shrinkage factor. This setting reduces the influence of abnormal observations while retaining sufficient filter responsiveness to normal motion changes.
We regenerate sigma points based on the shrunk covariance and repeat the prediction and update steps to obtain the robust state estimate, i.e.,
where
is the Kalman gain recalculated using the shrunk covariance
. This residual-driven shrinkage mechanism differs from the conventional UKF, where the sigma-point covariance is propagated using fixed noise assumptions. By adaptively reducing the predicted covariance under abnormal residuals, the proposed method limits the influence of unreliable observations on the posterior state update and improves filtering stability in NLOS or partially occluded environments.
To quantify the instantaneous reliability of the external measurement sources, the GNSS and 5G observation-quality scores are defined as
where
and
denote the numbers of available GNSS satellites and available 5G base stations at epoch
k, respectively. The threshold of six GNSS satellites is selected because at least four satellites are required for 3D positioning, while additional satellites improve geometric redundancy and observation reliability. The threshold of four 5G base stations corresponds to the minimum requirement for stable 3D TDOA positioning. Therefore, these thresholds are used to normalize the availability of GNSS and 5G observations into comparable quality scores.
It should be emphasized that the adaptive weights are not used to directly average standalone positioning results. Instead, the weights are introduced to regulate the effective measurement covariance matrices of GNSS and 5G in the UKF measurement update. In this way, external observations with higher reliability are assigned smaller equivalent covariance, while degraded observations are automatically down-weighted through covariance inflation.
After obtaining the preliminary observation quality scores, the normalized weights of GNSS and 5G are calculated as
where
and
denote the observation-quality scores of GNSS and 5G, respectively, and
is a small positive constant used only to avoid division by zero. Since
is several orders of magnitude smaller than the normalized quality scores, it has negligible influence when at least one external observation source is available.
To avoid abrupt changes in the measurement noise covariance, the normalized weights are smoothed as
where
is the smoothing coefficient. A larger
produces smoother but slower weight transitions, whereas a smaller
improves responsiveness but may introduce abrupt covariance changes. The value of
is selected according to the sampling interval and the need to balance smooth covariance transitions with real-time responsiveness.
The smoothed weights are then used to construct the effective measurement covariance matrix:
Therefore, the adaptive weighting mechanism affects the UKF update through the measurement covariance matrix rather than through a post-filter weighted average. The posterior state estimate is updated as
where
is the Kalman gain computed using
. Since INS is used in the prediction model rather than in the external measurement vector, no INS-related block is included in
.
Finally, the positioning output is extracted from the posterior UKF state estimate:
where
is the selection matrix used to extract the position component. Thus, the final positioning result is generated by the UKF posterior estimate, not by directly averaging GNSS, 5G, and INS positioning results.
In this strategy, sensors with higher observation quality are assigned higher confidence during the UKF measurement update, which improves both positioning accuracy and scenario adaptability. The parameter settings used in the proposed method are summarized in
Table 1.
The smoothed GNSS and 5G measurement weights in Equation (
41) prevent abrupt changes in the effective measurement covariance matrix. When GNSS or 5G observations become degraded, their corresponding covariance terms are inflated, and the UKF posterior estimate relies relatively more on the INS-driven state prediction. This does not introduce a separate INS weight; rather, it reflects the prediction-update structure of the UKF.