Next Article in Journal
Design, Modeling and Performance Analysis of an Actively Variable Stiffness Pneumatic Flexible Bending Joint
Previous Article in Journal
A Blockchain-Enabled Security Framework for Cloud-Based Sensor Systems with Deep Learning-Driven Attack Classification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Residual-Driven ResCompFormer for Multi-Sensor Systematic Error Compensation and Target Trajectory Reconstruction

College of Science, National University of Defense Technology, Fuyuan Road No. 1, Changsha 410072, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(16), 5199; https://doi.org/10.3390/s26165199
Submission received: 21 July 2026 / Revised: 12 August 2026 / Accepted: 14 August 2026 / Published: 17 August 2026
(This article belongs to the Section Optical Sensors)

Abstract

Multi-sensor data fusion is essential for accurate target tracking and trajectory reconstruction. However, common forms of systematic error in multi-sensor observations, including constant biases, linear drifts, and saturating exponential drifts, can degrade measurement consistency and trajectory estimation accuracy. Within the B-spline-constrained Error Model Best Estimate of Trajectory (EMBET) framework, B-spline coefficients and systematic-error parameters may produce similar observation responses, allowing part of the systematic-error response to be absorbed into the spline-coefficient correction and thereby weakening the identifiability of the systematic-error parameters. To avoid the weak-identifiability mechanism associated with the joint parametric estimation of trajectory and systematic-error terms, a residual-driven ResCompFormer method is proposed for systematic-error compensation and target trajectory reconstruction. First, a B-spline-constrained EMBET model is established to analyze the coupling between B-spline coefficients and systematic-error parameters. Systematic-error estimation is then removed from the joint EMBET parameter-estimation problem and reformulated as observation-domain error-sequence prediction, and ResCompFormer is employed to capture temporal dependencies and cross-channel correlations in multi-sensor residuals. The predicted errors are fed back to correct the observations, followed by iterative trajectory re-estimation. Simulation results confirm the systematic-error absorption mechanism and show that the proposed method outperforms the considered model-driven and data-driven methods in both systematic-error compensation and trajectory reconstruction, including iterative and stepwise EMBET variants. Additional experiments demonstrate the robustness of the proposed method to variations in systematic-error characteristics and sensor availability.

1. Introduction

Accurate trajectory estimation is essential for performance evaluation, guidance and control analysis, and measurement-system assessment in aerospace flight-test and range-testing campaigns [1,2]. These tasks commonly involve long observation intervals, complex environments, incomplete coverage by individual instruments, and heterogeneous measurement accuracies. A single sensor is therefore unlikely to provide uniformly reliable trajectory information over an entire flight arc. Radar, electro-optical theodolites, telemetry systems, and other heterogeneous sensors are commonly used to observe the same target cooperatively [3,4]. Recent studies on integrated and tightly coupled trajectory estimation have shown that fusing heterogeneous observations within a unified estimation framework better exploits complementary information and provides redundant constraints for trajectory reconstruction and sensor-error calibration [5,6].
Multi-sensor measurements generally contain both random and systematic errors. Random errors mainly arise from sensor noise, environmental disturbances, and other stochastic uncertainties and are commonly modeled as zero-mean random noise with a specified covariance structure. Systematic errors originate from persistent imperfections in the measurement and data-processing chain, such as axis misalignment, zero offsets, ranging biases, time-synchronization mismatch, coordinate-reference inconsistencies, and variations in sensor operating conditions. In the observation domain, these errors may appear as constant biases, slowly varying drifts, nonlinear time-varying drifts, or combinations of several components [7,8]. When propagated through the multi-sensor fusion model, such structured errors may produce persistent trajectory deviations or local distortions in the reconstructed trajectory [9]. Moreover, different sensors and observation channels may contain systematic errors with distinct amplitudes and temporal characteristics. Inadequate identification or compensation of these errors reduces the consistency among heterogeneous observations and degrades multi-sensor fusion accuracy [10,11]. Therefore, systematic error modeling, parameter identifiability analysis, and error compensation remain important issues in multi-sensor trajectory determination.
The Error Model Best Estimate of Trajectory (EMBET) method is a model-driven approach for the post-processing of range-measurement data. It represents the target trajectory and systematic-error parameters in a unified nonlinear model and estimates them jointly by exploiting redundant observations from multiple sensors and observation channels [8,12]. Iterative error identification and clustering-assisted identification were introduced to improve error separation under complex measurement conditions [9,13]. These approaches retain explicit physical interpretations and are compatible with established range-data processing procedures. Their performance, however, depends on the trajectory parameterization, the prescribed systematic error model, and the observation geometry. Model mismatch, numerical ill-conditioning, and weak identifiability may arise when the true error pattern differs from the assumed model or when trajectory corrections and systematic error perturbations generate similar responses in the observation space.
In a conventional EMBET formulation without trajectory parameterization, treating the target state at every epoch as an independent unknown for long observation arcs with high sampling rates produces a rapidly growing parameter vector, making the associated normal equations computationally expensive to form and solve. Reduced-parameter models address this problem by representing a continuous trajectory with splines, polynomials, or other low-dimensional basis functions [14,15,16]. B-splines are particularly suitable because of their local support, smoothness, differentiability, and flexibility for nonuniform sampling. They have been used in heterogeneous measurement fusion, trajectory determination, and trajectory estimation with incomplete observations [17,18,19]. Continuous-time and batch parameterizations have also been adopted to integrate observations from global navigation satellite systems, inertial sensors, imaging sensors, and laser scanners [5,6]. Recent work further emphasizes continuous-time B-spline trajectory representations for multi-sensor state estimation and calibration. A recent review systematically summarizes their applications in asynchronous multi-source fusion, offline calibration, and online odometry [20]. Continuous-time B-spline trajectories have also been adopted for camera–IMU extrinsic calibration and multimodal spatiotemporal calibration [21,22].
Reduced-order trajectory parameterization does not necessarily improve the identifiability of systematic-error parameters. In a linearized observation model, increments in the B-spline coefficients and systematic-error parameters are mapped into the observation space through their respective sensitivity matrices. When these column spaces are strongly correlated, the two parameter groups can produce similar observation responses, making it difficult to distinguish spline-coefficient corrections from systematic-error effects. In this study, parameter coupling refers specifically to the similarity between the observation responses induced by the B-spline coefficients and those induced by the systematic-error parameters. Under strong coupling, part of the observation variation caused by systematic errors can also be represented by changes in the B-spline coefficients. This overlap directly weakens systematic-error estimation and may consequently degrade trajectory reconstruction. Constant biases and slowly varying drifts are particularly likely to be confused with smooth, low-frequency trajectory corrections. Nonlinear drifts may also be approximated locally when the spline representation has sufficient flexibility. The estimability of systematic error states therefore depends on trajectory excitation, sensor configuration, observation type, and measurement sensitivity [23].
Existing studies have attempted to mitigate parameter coupling and weak identifiability through regularization, spline-structure adjustment, and stronger observation constraints. Sparse regularization encourages prominent sensor errors to be represented by explicit error terms rather than absorbed into trajectory corrections [7]. Other methods adjust the spline order, knot number, or knot locations, or introduce sparse B-spline representations to limit trajectory flexibility and alleviate ill-posed estimation [17,18,19]. These strategies can improve numerical stability, but they generally rely on prescribed error structures, parameter distributions, or regularization assumptions. A single parametric error model may be insufficient when heterogeneous observation channels contain systematic errors with different amplitudes and temporal patterns. Semiparametric studies similarly indicate that uncertain and complex systematic errors require a balance between physical modeling and adaptive representations [24].
Data-driven methods provide an alternative by learning nonstationary sensor-error patterns directly from multi-channel sequences. Long short-term memory networks, convolutional neural networks, and self-supervised models have been applied to inertial-sensor calibration, denoising, and navigation by learning bias, drift, and nonstationary characteristics from measurement sequences [25,26,27,28]. Recent work has further extended this direction toward online sensor self-calibration and adaptive compensation. Memory-efficient neural calibration has been developed for on-device adaptation of MEMS inertial sensors, while Transformer-assisted inertial localization has been used to adapt noise statistics and compensate long-term localization errors in the presence of missing IMU data [29,30]. Dynamic receptive-field mechanisms and Transformer architectures can further capture long-range temporal dependencies and nonlinear variations [31,32]. Although these studies primarily concern inertial sensors, the underlying sequence-modeling principle is also relevant to heterogeneous trajectory measurements: the error component may exhibit temporal continuity, channel-dependent behavior, and cross-channel dependence that cannot be adequately represented by a fixed low-order parametric model.
A practical limitation of supervised error-compensation learning is the need for paired measurement sequences and sufficiently accurate systematic-error labels, which may be difficult to obtain because the systematic component is not directly observable without an accurate reference trajectory or independent calibration. Recent temporal–contextual self-supervised and class-aware semi-supervised frameworks have shown that unlabeled time-series data can be exploited for representation learning before task-specific refinement [33,34]. Although developed for fault diagnosis rather than trajectory-error compensation, these approaches suggest a potential extension in which the residual encoder is pretrained on unlabeled multi-sensor sequences and then fine-tuned with systematic-error and trajectory-reconstruction objectives.
Residuals from an initial trajectory estimate contain random noise together with systematic components that have not been fully separated from the trajectory representation. Different systematic error forms produce distinct temporal structures. A constant bias produces a persistent offset, a linear drift produces a progressively changing residual, and a saturating exponential drift produces a smooth nonlinear transition toward an asymptotic level. In a heterogeneous sensor network, residual channels are also coupled through the common target motion, coordinate transformations, observation geometry, sensor identity, and measurement type. A compensation model should therefore capture both temporal dependencies and relationships among observation channels. Informer and Autoformer demonstrated the effectiveness of attention mechanisms for long-sequence modeling [35,36]. Recent developments include the patch-based and channel-independent representation of PatchTST [37], the variable-as-token design of iTransformer [38], and channel-wise attention in SAMformer [39]. Pretrained time-series models have also been explored for cross-domain zero-shot and probabilistic forecasting [40,41]. These strategies broaden long-sequence representation and multivariate time-series modeling, but they primarily target generic forecasting rather than signed systematic-error compensation coupled with trajectory reconstruction.
ResCompFormer retains the standard scaled dot-product attention mechanism [42] but reorganizes the input representation for systematic-error compensation. At each sampling epoch, numerical residuals are augmented with sensor-identity and measurement-type embeddings and jointly projected across channels into one latent token before temporal positional encoding and self-attention. Thus, time remains the attention axis while cross-channel information is fused before attention. This differs from the channel-independent temporal patching of PatchTST [37], the variable-as-token design of iTransformer [38], and the explicit cross-variable or channel-wise attention mechanisms used by Crossformer [43] and SAMformer [39]. A non-autoregressive decoder then predicts the complete multichannel signed systematic-error sequence in parallel.
The network output is further coupled to B-spline-constrained EMBET rather than treated as an isolated sequence prediction. During inference, systematic-error prediction and trajectory re-estimation are performed iteratively; during training, a differentiable EMBET layer propagates the trajectory-reconstruction objective through the re-estimation procedure to the network.
To address these limitations, this study proposes a residual-driven ResCompFormer framework for multi-sensor systematic-error compensation and target trajectory reconstruction. The main contributions are summarized as follows.
First, a B-spline-constrained EMBET model is established, and a weighted sensitivity-space analysis is developed to characterize how systematic-error responses are projected onto and absorbed into the spline sensitivity space. This analysis distinguishes structural non-identifiability from practical weak identifiability and clarifies the information that remains available for systematic-error estimation. Second, systematic-error estimation is removed from the joint parametric estimation of trajectory and systematic-error terms and reformulated as signed observation-domain sequence prediction. This decoupling avoids the weak-identifiability mechanism caused by direct competition between B-spline coefficients and systematic-error parameters within the same estimation problem. ResCompFormer then exploits same-epoch multichannel feature fusion, temporal self-attention, and parallel non-autoregressive decoding to predict the systematic-error sequence. Third, ResCompFormer is coupled to B-spline-constrained EMBET through iterative compensation and trajectory re-estimation, while a differentiable trajectory loss links observation-domain compensation to the final trajectory objective during training. Within this decoupled formulation, temporal and cross-channel regularities learned from the training data provide a data-driven prior for systematic-error prediction without altering the underlying structural identifiability conditions.
Simulations are conducted using a nonlinear six-degree-of-freedom fixed-wing unmanned aerial vehicle (UAV) model and a heterogeneous radar-electro-optical sensor network. Constant biases, linear drifts, and saturating exponential drifts are considered in the weak-identifiability and compensation experiments. The proposed method predicts observation-domain error sequences without explicitly fitting the corresponding parametric coefficients during inference. Section 2 presents the B-spline-constrained EMBET model and the sensitivity-space analysis. Section 3 describes ResCompFormer and the iterative compensation procedure. Section 4 presents the simulation design and experimental evaluation, and Section 5 concludes the paper. A summary of the principal mathematical notation used throughout the manuscript is provided in Appendix A.

2. B-Spline-Constrained EMBET Fusion Model and Parameter Estimation

2.1. Multi-Sensor Observation Model and B-Spline Trajectory Parameterization

Consider an aerial target observed by a heterogeneous multi-sensor system. Let the position and velocity of the target in the Earth-centered, Earth-fixed (ECEF) frame at time t be denoted by x ( t ) = ( x ( t ) , y ( t ) , z ( t ) ) T and x ˙ ( t ) = ( x ˙ ( t ) , y ˙ ( t ) , z ˙ ( t ) ) T , respectively. The sensor measurements may include range, azimuth, elevation, and range rate, all expressed in a local east–north–up (ENU) frame centered at the corresponding sensor station. At time t, the true range R i ( t ) , azimuth angle A i ( t ) , elevation angle E i ( t ) , and range rate R ˙ i ( t ) of the target can be expressed as follows
R i ( t ) = x s , i 2 ( t ) + y s , i 2 ( t ) + z s , i 2 ( t ) , A i ( t ) = atan2 x s , i ( t ) , y s , i ( t ) , E i ( t ) = arctan z s , i ( t ) x s , i 2 ( t ) + y s , i 2 ( t ) , R ˙ i ( t ) = x s , i ( t ) x ˙ s , i ( t ) + y s , i ( t ) y ˙ s , i ( t ) + z s , i ( t ) z ˙ s , i ( t ) x s , i 2 ( t ) + y s , i 2 ( t ) + z s , i 2 ( t ) ,
where x s , i ( t ) = x s , i ( t ) , y s , i ( t ) , z s , i ( t ) T and x ˙ s , i ( t ) = x ˙ s , i ( t ) , y ˙ s , i ( t ) , z ˙ s , i ( t ) T denote the target position and velocity in the local ENU frame of sensor i. The components x s , i ( t ) , y s , i ( t ) , and z s , i ( t ) correspond to the east, north, and up directions. The azimuth angle is measured clockwise from local north. The target position and velocity relative to sensor i are transformed from the ECEF frame to the local ENU frame following the coordinate transformation in [44].
Let the target state at time t be denoted by α ( t ) = [ x T ( t ) , x ˙ T ( t ) ] T . The corresponding noiseless measurements are nonlinear functions of the target state α ( t ) . Let the sampling epochs be collected in the vector t = ( t 1 , t 2 , , t m ) T . The stacked target-state vector to be estimated is defined as X = ( α ( t 1 ) T , α ( t 2 ) T , , α ( t m ) T ) T .
Because different sensor types may provide different measurement components, define the set of candidate measurement types as D = { R , R ˙ , A , E } , and let D i D denote the set of measurement types available from sensor i, where i = 1 , 2 , , n . For sensor i, let d D i denote a generic available measurement type. The corresponding measurement vector over all sampling epochs is defined as
y i , d = y i , d ( t 1 ) , y i , d ( t 2 ) , , y i , d ( t m ) T R m ,
where y i , d ( t j ) denotes the measurement of type d provided by sensor i at sampling epoch t j .
The measurement vector of sensor i, obtained by stacking all available measurement components, is expressed as
y i = y i , d 1 T , y i , d 2 T , , y i , d | D i | T T R m | D i | ,
where d c D i , c = 1 , 2 , , | D i | , denotes the cth measurement component available from sensor i, and | D i | denotes the number of measurement components provided by that sensor.
The measurement model for sensor i can then be written as
y i = f i ( X ) + u i ( t ; γ ) + ϵ i , y i R m | D i | ,
where f i ( X ) R m | D i | denotes the nonlinear observation function for sensor i, stacked over all sampling epochs and available measurement components; u i ( t ; γ ) R m | D i | denotes the corresponding systematic-error vector, stacked in the same order and parameterized by the systematic-error parameter vector γ = ( γ 1 , γ 2 , , γ n γ ) T R n γ ; and ϵ i R m | D i | denotes the random measurement-noise vector for sensor i, stacked according to the same ordering.
Stacking the measurement vectors from all sensors yields the global observation vector Y = y 1 T , y 2 T , , y n T T R m C , where C = i = 1 n | D i | denotes the total number of available observation channels, with each channel corresponding to a sensor–measurement-component pair. The resulting joint nonlinear observation model is
Y = F ( X ) + U ( t ; γ ) + ϵ ,
where F ( X ) = ( f 1 T ( X ) , f 2 T ( X ) , , f n T ( X ) ) T R m C denotes the stacked noiseless observation vector predicted from the trajectory X , U ( t ; γ ) = ( u 1 T ( t ; γ ) , u 2 T ( t ; γ ) , , u n T ( t ; γ ) ) T R m C is the systematic-error vector, and ϵ = ( ϵ 1 T , ϵ 2 T , , ϵ n T ) T R m C is the random measurement-noise vector. Assume that ϵ has zero mean, i.e., E [ ϵ ] = 0 , and a positive definite covariance matrix Cov ( ϵ ) = Σ R m C × m C . Figure 1 illustrates the joint observation geometry between the heterogeneous multi-sensor system and the aerial target. The observations acquired by different sensor types at multiple sampling epochs are stacked into the global observation vector Y .
To reduce the trajectory dimensionality while retaining a smooth continuous-time representation, the target trajectory in the ECEF frame is parameterized using B-spline basis functions of order p + 1 . Let the sampling epochs be t j [ a , b ] , j = 1 , , m .
Consider the strictly increasing extended knot vector T = { T p , , T N + p + 1 } , where T 0 = a and T N + 1 = b , and N denotes the number of interior knots in ( a , b ) . The N + 2 p + 2 knots satisfy
T p < < T 0 < < T N + 1 < < T N + p + 1 .
The B-spline basis functions whose supports intersect [ a , b ] are indexed by τ = p , , N . Therefore, the total number of basis functions is q = N + p + 1 .
Let B τ , p + 1 ( t ) denote the B-spline basis function of order p + 1 . Define w τ , p + 1 ( t ) = r = τ τ + p + 1 ( t T r ) . Since the knots are distinct, w τ , p + 1 ( T k ) 0 . The basis function can then be expressed as
B τ , p + 1 ( t ) = T τ + p + 1 T τ k = τ τ + p + 1 ( T k t ) + p w τ , p + 1 ( T k ) , τ = p , , N ,
where ( u ) + p = max ( u , 0 ) p . Its first derivative is
B ˙ τ , p + 1 ( t ) = p B τ , p ( t ) T τ + p T τ p B τ + 1 , p ( t ) T τ + p + 1 T τ + 1 , τ = p , , N .
Define the basis vector and its derivative, respectively, as B p + 1 ( t ) = [ B p , p + 1 ( t ) , , B N , p + 1 ( t ) ] R 1 × q , and B ˙ p + 1 ( t ) = [ B ˙ p , p + 1 ( t ) , , B ˙ N , p + 1 ( t ) ] R 1 × q .
Let b x , b y , b z R q denote the spline coefficient vectors in the three coordinate directions, where, for example, b x = [ b x , p , , b x , N ] T . The target position and velocity are approximated by
x ( t ) B p + 1 ( t ) b x , y ( t ) B p + 1 ( t ) b y , z ( t ) B p + 1 ( t ) b z , x ˙ ( t ) B ˙ p + 1 ( t ) b x , y ˙ ( t ) B ˙ p + 1 ( t ) b y , z ˙ ( t ) B ˙ p + 1 ( t ) b z .
Let b = [ b x T , b y T , b z T ] T R 3 q and α ( t ) = [ x ( t ) , y ( t ) , z ( t ) , x ˙ ( t ) , y ˙ ( t ) , z ˙ ( t ) ] T . Then
α ( t ) B ( t ) b ,
where
B ( t ) = B p + 1 ( t ) 0 0 0 B p + 1 ( t ) 0 0 0 B p + 1 ( t ) B ˙ p + 1 ( t ) 0 0 0 B ˙ p + 1 ( t ) 0 0 0 B ˙ p + 1 ( t ) R 6 × 3 q .
By stacking the trajectory states at all sampling epochs, define
B s = [ B T ( t 1 ) , , B T ( t m ) ] T ,
such that X ( b ) B s b . Using this representation, (5) can be expressed in terms of the B-spline coefficient vector as
Y = F ( b ) + U ( t ; γ ) + ϵ ,
where F ( b ) F ( X ( b ) ) F ( B s b ) .
The spline coefficient vector b and the systematic-error parameter vector γ are jointly estimated by solving
( b ^ , γ ^ ) = arg min b , γ Y F ( b ) U ( t ; γ ) P 2 ,
where r P 2 = r T P r and P = Σ 1 . The reconstructed trajectory and the estimated systematic-error vector are then given by
X ^ = B s b ^ , U ^ ( t ) = U ( t ; γ ^ ) ,
respectively.

2.2. Identifiability Analysis of the Coupling Between Spline Coefficients and Systematic Errors

The B-spline-constrained EMBET model represents the target trajectory using the spline coefficient vector b and parameterizes the systematic errors using γ . These two parameter groups are jointly estimated by minimizing the weighted nonlinear least-squares objective in (14).
B-spline parameterization reduces the number of trajectory variables and provides a smooth continuous-time trajectory representation. However, because the B-spline basis can represent smooth low-frequency variations, slowly varying systematic errors may be partially absorbed into the estimated trajectory, biasing the systematic-error parameter estimates. The coupling between the B-spline coefficients and the systematic-error parameters is examined by locally linearizing the observation model.
Let ( b k , γ k ) denote the current estimates of the spline coefficients and systematic-error parameters at iteration k. Performing a first-order Taylor expansion of (13) in the neighborhood of ( b k , γ k ) yields
Y F ( b k ) + U ( t ; γ k ) + F b | b k ( b b k ) + U γ | γ k ( γ γ k ) + ϵ .
Let l k = Y F ( b k ) U ( t ; γ k ) , Δ b k = b b k , and Δ γ k = γ γ k . In addition, define
J b k = F b | b k , J γ k = U γ | γ k .
Equation (16) can therefore be written in the following linearized form
l k = J b k Δ b k + J γ k Δ γ k + ϵ .
Assuming that the weighting matrix is P = Σ 1 , the generalized least-squares objective function corresponding to (18) is given by
Q k ( Δ b k , Δ γ k ) = Φ k T P Φ k ,
where Φ k = ( l k J b k Δ b k J γ k Δ γ k ) . Differentiating (19) with respect to Δ b k and Δ γ k and setting both derivatives to zero yields the joint normal equations
J b k T P J b k J b k T P J γ k J γ k T P J b k J γ k T P J γ k Δ b ^ k Δ γ ^ k = J b k T P l k J γ k T P l k .
Equation (20) shows that the spline coefficients and systematic-error parameters are jointly estimated within the same normal-equation system. In the linearized model (16), the parameter perturbations Δ b k and Δ γ k affect the observations through the sensitivity matrices J b k and J γ k , respectively. Independent identification of the systematic-error parameters therefore depends on the separability of the column spaces of J b k and J γ k . This condition is formalized in Theorem 1.
Theorem 1.
If there exist non-zero vectors d R 3 q and a R n γ such that
J γ k a = J b k d ,
then the parameter-correction pair ( b k , γ k ) is not locally identifiable from the linearized observation model.
Proof of Theorem 1.
For any candidate correction pair ( Δ b k , Δ γ k ) , the fitted linearized observation response is J b k Δ b k + J γ k Δ γ k . Define another parameter correction pair as
Δ b k = Δ b k + d , Δ γ k = Δ γ k a .
Then, we have
J b k Δ b k + J γ k Δ γ k = J b k ( Δ b k + d ) + J γ k ( Δ γ k a ) = J b k Δ b k + J γ k Δ γ k + J b k d J γ k a .
From (21), we have J b k d J γ k a = 0 . Thus, (23) reduces to
J b k Δ b k + J γ k Δ γ k = J b k Δ b k + J γ k Δ γ k .
Substituting (24) into (19), we obtain
Q k ( Δ b k , Δ γ k ) = Q k ( Δ b k , Δ γ k ) .
Because d 0 and a 0 , we have ( Δ b k , Δ γ k ) ( Δ b k , Δ γ k ) . Therefore, two different parameter correction pairs yield identical fitted values and identical objective function values. Hence, the parameter decomposition is not unique, i.e., the systematic-error parameters are not uniquely identifiable in the generalized least-squares sense. This completes the proof.    □
Theorem 1 indicates that when R ( J b k ) R ( J γ k ) { 0 } , the observation responses induced by spline-coefficient and systematic-error perturbations are indistinguishable along the shared subspace, where R ( · ) denotes the column space of a matrix.
In practice, exact equality in (21) rarely holds, whereas an approximate relationship, J γ k a J b k d , is more common. In this case, the systematic-error parameters may remain formally identifiable, but the near-collinearity of the two response spaces makes the normal equations severely ill-conditioned. Consequently, the parameter estimates become highly sensitive to measurement noise, knot placement, and initial values, indicating weak identifiability of the systematic-error parameters.
To characterize the component of the systematic-error response that can be absorbed by spline-coefficient perturbations, define the following weighted projection onto R ( J b k ) .
Definition 1.
Let P be symmetric positive definite and define the weighted inner product by u , v P = u T P v . If J b k has full column rank, then J b k T P J b k is invertible. The matrix
Π b k = J b k ( J b k T P J b k ) 1 J b k T P
is the P -weighted orthogonal projector onto the spline sensitivity space R ( J b k ) . The corresponding complementary projection matrix is defined as
M b k = I Π b k .
The range of M b k is the P -weighted orthogonal complement of the spline sensitivity space, namely
R ( J b k ) P = { v : J b k T P v = 0 } .
Based on Definition 1, the systematic-error response can be decomposed relative to the spline sensitivity space as follows.
Theorem 2.
Under the linearized model in (16), let the observation response induced by the systematic-error parameter perturbation Δ γ k be denoted by s k = J γ k Δ γ k . Then, the systematic-error response can be decomposed as
s k = Π b k s k + M b k s k .
Furthermore, there exists a vector c k such that Π b k J γ k Δ γ k = J b k c k . Accordingly, the linearized observation equation can be reformulated as
l k = J b k Δ b ˜ k + M b k J γ k Δ γ k + ϵ ,
where Δ b ˜ k = Δ b k + c k .
Proof of Theorem 2.
From Definition 1, Π b k is the P -weighted projection matrix onto the spline sensitivity space R ( J b k ) , and M b k = I Π b k . Therefore, the systematic-error response s k can be decomposed into its projected component in the spline sensitivity space and its complementary component, which gives (29).
By the definition of Π b k , the projected component of the systematic-error response can be written as
Π b k J γ k Δ γ k = J b k J b k T P J b k 1 J b k T P J γ k Δ γ k .
Let c k = J b k T P J b k 1 J b k T P J γ k Δ γ k . Thus, the projected component can be expressed as Π b k J γ k Δ γ k = J b k c k . Therefore, the projected component can be reproduced by the spline-coefficient perturbation c k through the response J b k .
Substituting (29) into the linearized observation equation l k = J b k Δ b k + J γ k Δ γ k + ϵ yields
l k = J b k Δ b k + J b k c k + M b k J γ k Δ γ k + ϵ = J b k Δ b k + c k + M b k J γ k Δ γ k + ϵ .
By defining Δ b ˜ k = Δ b k + c k , (30) is obtained. This completes the proof.    □
Theorem 2 indicates that the component of the systematic-error response lying in the spline sensitivity space R ( J b k ) can be expressed as J b k c k and absorbed into the modified spline-coefficient correction Δ b ˜ k = Δ b k + c k . Therefore, the apparent absorption of systematic errors by spline coefficients arises from projecting systematic-error responses onto the spline sensitivity space. The projected component is indistinguishable from a spline-coefficient correction, whereas M b k J γ k Δ γ k represents the component that cannot be explained by spline-coefficient perturbations and therefore contains the independent information available for estimating the systematic-error parameters.
Figure 2 illustrates the geometric decomposition of the systematic-error response J γ k Δ γ k in the observation space.
Eliminating the spline-coefficient corrections from the objective function yields a profiled formulation for estimating the systematic-error parameters. For a fixed Δ γ k , define r γ , k = l k J γ k Δ γ k . Differentiating (19) with respect to Δ b k gives
Q k Δ b k = 2 J b k T P l k J b k Δ b k J γ k Δ γ k .
Setting this derivative to zero yields the optimal spline-coefficient correction for the given Δ γ k
Δ b ^ k ( Δ γ k ) = ( J b k T P J b k ) 1 J b k T P ( l k J γ k Δ γ k ) .
Substituting this expression into (19) yields the profiled objective function for the systematic-error parameters
Q k ( Δ γ k ) = ( l k J γ k Δ γ k ) T P M b k ( l k J γ k Δ γ k ) .
After eliminating the spline-coefficient corrections, the information available for estimating the systematic-error parameters is contained in the component projected onto the P -weighted orthogonal complement R ( J b k ) P .
Theorem 3.
Under the linearized model (16), suppose that P is symmetric positive definite, J b k has full column rank, and the profiled Schur-complement information matrix S γ k = J γ k T P M b k J γ k is nonsingular. Then, the generalized least-squares estimate of the systematic-error parameters at iteration k is given by
Δ γ ^ k = ( J γ k T P M b k J γ k ) 1 J γ k T P M b k l k .
The corresponding profiled Schur-complement information matrix is S γ k = J γ k T P M b k J γ k .
Proof of Theorem 3.
Taking the partial derivative of (35) with respect to Δ γ k yields
Q k Δ γ k = 2 J γ k T P M b k l k J γ k Δ γ k .
Setting this derivative to zero gives the normal equation
J γ k T P M b k J γ k Δ γ ^ k = J γ k T P M b k l k .
By the nonsingularity of the profiled Schur-complement information matrix S γ k , the generalized least-squares estimate of the systematic-error parameters is given by (36), which completes the proof.    □
Theorem 3 shows that the local identifiability of the systematic-error parameters is determined not by J γ k alone, but by the projected sensitivity matrix M b k J γ k , which represents the component of J γ k in the P -weighted orthogonal complement R ( J b k ) P of the spline sensitivity space. If M b k J γ k = 0 , then S γ k = 0 , and the systematic-error parameters are completely unidentifiable. If M b k J γ k 0 , but the profiled Schur-complement information matrix S γ k is nearly singular, the systematic-error parameters are formally estimable but only weakly identifiable, and their estimates are highly sensitive to noise.
Under the local linear approximation, the covariance of the systematic-error parameter estimate is approximated by
Cov ( Δ γ ^ k ) ( J γ k T P M b k J γ k ) 1 = S γ k 1 .
The approximate equality in (39) arises from the first-order linearization of the original nonlinear estimation model. As S γ k approaches singularity, the variance of the systematic-error estimates increases rapidly. In this case, even a numerically converged solution may differ substantially from the true parameter values. The component of the systematic-error response lying in the spline sensitivity space is absorbed into the spline-coefficient correction. Therefore, the final trajectory estimate may contain not only the true trajectory variation but also a portion of the systematic error.
The preceding analysis clarifies the mechanism underlying the weak identifiability of the systematic-error parameters in the B-spline-constrained EMBET model. As shown in (18), perturbations in the spline coefficients and systematic-error parameters jointly contribute to the observation residuals. Their separate identification therefore depends on whether the corresponding observation responses can be distinguished in the observation space. Theorem 1 shows that if the column spaces of the spline sensitivity matrix J b k and the systematic-error sensitivity matrix J γ k overlap, the two types of parameter perturbations produce indistinguishable responses along the shared subspace, leading to a non-unique decomposition of the linearized observation response. Theorem 2 further shows that the component of the systematic-error response lying in R ( J b k ) can be represented as J b k c k and absorbed into the spline-coefficient correction. Only the component remaining in the P -weighted orthogonal complement of the spline sensitivity space provides independent information for estimating the systematic-error parameters.
Theorem 3 formalizes this result through the profiled Schur-complement information matrix S γ k = J γ k T P M b k J γ k . When the systematic-error sensitivity space is largely aligned with the spline sensitivity space, the projected sensitivity matrix M b k J γ k becomes small in norm or nearly rank-deficient. Consequently, S γ k becomes ill-conditioned, and the variance of the systematic-error parameter estimates increases. Thus, the absorption of systematic-error responses into the spline-coefficient correction is not merely a numerical artifact of the optimization procedure but a structural consequence of the overlap between the spline and systematic-error sensitivity spaces.
The degree of coupling varies across systematic-error types because their observation-domain responses overlap differently with the spline sensitivity space. For the constant biases, linear drifts, and saturating exponential drifts considered here, the severity of weak identifiability depends on the extent to which their observation-domain responses overlap with the spline sensitivity space. In particular, the smooth time-varying response of a saturating exponential drift may be partially represented by perturbations in the B-spline coefficients, thereby weakening the local identifiability of the corresponding systematic-error parameters. The above analysis shows that weak identifiability in the B-spline-constrained EMBET framework arises from the joint estimation of B-spline coefficients and systematic-error parameters. To avoid this coupling, the proposed method does not estimate systematic errors through the EMBET parameter-estimation process; instead, ResCompFormer directly predicts the systematic-error sequence from observation residuals, thereby avoiding the weak-identifiability mechanism associated with the joint parametric estimation of trajectory and systematic-error terms.

3. ResCompFormer-Based Iterative Compensation Method for Systematic Errors

Section 2 established a B-spline-constrained EMBET model for trajectory estimation. Conventional EMBET methods fuse multi-sensor observations by jointly estimating the B-spline coefficients and systematic-error parameters, thereby improving the continuity and stability of trajectory reconstruction. However, when the systematic-error sensitivity space overlaps with the spline sensitivity space, the two parameter groups may produce similar observation responses, resulting in parameter coupling during joint estimation. Consequently, part of the systematic-error response may be absorbed into the spline-coefficient correction, thereby weakening the local identifiability of the systematic-error parameters. To address this issue, the proposed method no longer jointly estimates the B-spline coefficients and systematic-error parameters within the same nonlinear least-squares problem. Instead, ResCompFormer, parameterized by the optimized network parameter set θ * , predicts the signed observation-domain systematic-error sequence from the observation residual sequence while θ * is held fixed during inference. The B-spline coefficients are then re-estimated from the corrected observations. Consequently, the systematic-error estimate and the B-spline coefficients no longer compete to explain the same observation residuals within a single normal-equation system. This decouples systematic-error estimation from B-spline trajectory estimation and thereby avoids the weak-identifiability mechanism associated with their joint parametric estimation. Within this decoupled formulation, ResCompFormer exploits temporal patterns of systematic errors, sensor identities, measurement-type information, and cross-channel residual structures learned from the training data to predict the observation-domain systematic-error sequence. These learned regularities provide a data-driven prior that improves prediction stability over the data distribution represented during training.

3.1. Algorithmic Procedure

The proposed method addresses the coupling between systematic-error parameters and B-spline coefficients through iterative compensation in the observation domain. At each iteration, the residual sequence is fed into the trained ResCompFormer network, which predicts the signed systematic-error sequence under the current trajectory estimate. Let θ denote the set of all trainable parameters of ResCompFormer, and let θ * denote the optimized parameter set obtained by minimizing the total training loss, as formally defined in Equation (79). During inference, θ * is held fixed, and the predicted systematic-error sequence is not introduced as an additional unknown to be jointly optimized with the B-spline coefficients. Only the B-spline coefficients are re-estimated by the EMBET solver after the observations have been compensated using the predicted systematic-error sequence. This separates network-based systematic-error estimation from spline-based trajectory estimation at the optimization level.
The stacked observation residual vector at iteration k is defined as
R k = Y F ( b k ) , R k R m C ,
where F ( b k ) denotes the stacked model-predicted observation vector computed from the current B-spline coefficients b k .
For observation channel ( i , d ) , where d D i , the residual at time t is given by
r i , d ( k ) ( t ) = y i , d ( t ) f i , d ( b k , t ) ,
where y i , d ( t ) denotes the measured value of component d provided by sensor i at time t and f i , d ( b k , t ) denotes the corresponding model-predicted measurement computed from the current B-spline coefficients b k .
The initial B-spline coefficients are estimated from the original observations while ignoring systematic errors:
b 0 = arg min b Y F ( b ) P 2 .
The initial systematic-error estimate is set to U ^ 1 = 0 . Then, for iteration k = 0 , 1 , , the observation residual vector R k is constructed according to (40). According to the fixed observation-channel ordering, the residuals are normalized by their corresponding measurement-noise standard deviations and organized into the matrix
R ¯ k = r ¯ c ( k ) ( t j ) j = 1 , , m c = 1 , , C R m × C ,
where
r ¯ c ( k ) ( t j ) = r c ( k ) ( t j ) σ c ,
and observation channel c corresponds to a sensor-component pair ( i c , d c ) under the fixed channel ordering, with σ c σ i c , d c denoting the corresponding measurement-noise standard deviation.
In the simulation setting considered here, random-noise samples are generated independently across sensors, measurement components, and observation epochs. The corresponding covariance matrix Σ is therefore diagonal, and channel-wise division by σ c provides a noise-scale standardization consistent with this covariance structure. This standardization does not imply that the residuals are statistically independent, because systematic errors and trajectory-estimation errors may still introduce temporal and cross-channel correlations.
The trained ResCompFormer maps the standardized residual matrix R ¯ k to a signed observation-domain systematic-error matrix over all sampling epochs and available channels. Although the input residuals are normalized by their measurement-noise standard deviations, the network output remains in the original observation units and can therefore be used directly for observation compensation. The forward prediction is written as
U ˜ k , mat = T θ * ( R ¯ k ) R m × C ,
where T θ * ( · ) denotes the trained ResCompFormer network with fixed parameters θ * , m is the number of sampling epochs, and C is the number of available observation channels. Each row of U ˜ k , mat represents the predicted signed systematic-error values corresponding to one sampling epoch, while each column represents the predicted signed systematic-error sequence associated with one available observation channel.
Because the subsequent EMBET trajectory re-estimation uses the vectorized global observation Y , the predicted systematic-error matrix is reshaped into a vector using the same observation ordering:
U ˜ k = vec ( U ˜ k , mat ) R m C .
To improve iterative stability, a damping update is applied:
U ^ k = η U ˜ k + ( 1 η ) U ^ k 1 ,
where η ( 0 , 1 ] is the damping factor and U ^ k R m C denotes the vectorized signed systematic-error estimate at iteration k.
The original observations are then compensated as
Y c ( k ) = Y U ^ k ,
Here, U ^ k is the estimated signed additive systematic error in the original observations; subtracting it yields the corrected observation vector Y c ( k ) .
Based on the compensated observations, the B-spline coefficients are re-estimated as
b k + 1 = arg min b Y c ( k ) F ( b ) P 2 .
The procedure is repeated until the relative changes in both the B-spline coefficients and the systematic-error estimate satisfy the convergence criteria
δ b k = b k + 1 b k max ( b k , ε ) < τ b ,
δ U k = U ^ k U ^ k 1 max ( U ^ k 1 , ε ) < τ U ,
where ε is a small positive constant introduced to avoid division by zero and τ b and τ U are the convergence thresholds for the B-spline coefficients and the systematic-error estimate, respectively.
Upon convergence, the algorithm returns the B-spline coefficients b ^ and the vectorized signed systematic-error estimate U ^ . The final trajectory X ^ is reconstructed at t 1 , t 2 , , t m using the prescribed knot vector, spline order, and estimated B-spline coefficients.
Algorithm 1 summarizes the residual-driven iterative compensation procedure. At each iteration, the algorithm constructs observation residuals from the current trajectory estimate, uses ResCompFormer to predict the signed observation-domain systematic-error sequence, and refines the B-spline coefficients through observation compensation and trajectory re-estimation until convergence.
As shown in Algorithm 1, ResCompFormer is the core component of the iterative compensation framework. At each iteration, it predicts the signed observation-domain systematic error from the normalized residuals according to (45), and this prediction directly influences both observation compensation and trajectory reconstruction. Section 3.2 describes the network architecture in detail.
Algorithm 1: Iterative Systematic Error Compensation Based on ResCompFormer
Sensors 26 05199 i001

3.2. ResCompFormer Network Architecture

ResCompFormer builds on the Transformer architecture to extract features from multi-sensor residual sequences and predict systematic errors. The model comprises a residual-embedding module, an encoder, and a non-autoregressive decoder.
The residual-embedding module combines sensor identity, measurement type, and numerical residual values in a unified representation. The encoder models temporal dependencies in the fused residual sequence, while the decoder predicts the complete signed systematic-error sequence in parallel within a single forward pass. The overall architecture of ResCompFormer is illustrated in Figure 3.

3.2.1. Residual Embedding Representation

At each iteration, the multi-sensor residuals are first organized into a unified input representation. Let the set of all available observation channels be denoted by Ω = { ( i , d ) i = 1 , 2 , , n , d D i } , and let the number of channels be C = | Ω | = i = 1 n | D i | .
The normalized residual matrix R ¯ k R m × C defined in Equation (43) is used as the input to ResCompFormer. At sampling epoch t j , its jth row collects the normalized residuals of all C available observation channels:
R ¯ k [ j , : ] = r ¯ 1 ( k ) ( t j ) , r ¯ 2 ( k ) ( t j ) , , r ¯ C ( k ) ( t j ) R 1 × C .
Under the fixed channel ordering, observation channel c corresponds to the specific sensor-component pair ( i c , d c ) Ω .
In addition to the numerical residual embedding, the model uses independent learnable embeddings for sensor identity and measurement type. These embeddings allow the temporal model to distinguish residuals from different sensors and measurement modalities.
First, the normalized residual r ¯ c ( k ) ( t j ) for observation channel c is mapped into a d e -dimensional feature space
e c , j r = W r r ¯ c ( k ) ( t j ) + b r + e d c meas + e i c sens ,
where W r R d e × 1 and b r R d e denote the weight matrix and bias vector of the numerical residual embedding, respectively. e d c meas R d e and e i c sens R d e are the learnable embedding vectors corresponding to the measurement type d c and sensor index i c for observation channel c, respectively.
At each sampling epoch t j , the residual embeddings of all C available observation channels are arranged in the fixed channel order to form the residual embedding matrix:
E j = e 1 , j r , e 2 , j r , , e C , j r T R C × d e .
The matrix E j is flattened into a feature vector and then projected to the encoder dimension. The flattened residual embedding vector is denoted by
g j = Flatten ( E j ) R C d e ,
where Flatten ( · ) denotes the channel-wise concatenation of the residual embedding vectors according to the fixed ordering of the available observation channels. Then, a linear mapping is applied to obtain the input feature at time step j
z j = W f g j + b f R d model ,
where W f R d model × ( C d e ) and b f R d model are learnable parameters, and d model denotes the input dimension of the encoder.
The flattening and linear projection jointly fuse the observation channels rather than processing them independently. At each sampling epoch, g j contains the residual embeddings of all C channels. Equivalently, if W f is partitioned as W f = [ W f , 1 , , W f , C ] , where W f , c R d model × d e , then z j = c = 1 C W f , c e c , j r + b f . Thus, each latent feature can depend on the residual, sensor identity, and measurement type of every available channel at the same sampling epoch. The Transformer encoder subsequently models the temporal evolution of these jointly fused multichannel features.
This mechanism provides implicit cross-channel feature mixing through the all-channel projection rather than an explicit pairwise channel-attention operation. Consequently, the architecture retains a compact temporal-token representation while preserving information from all observation channels before temporal self-attention. Because the baseline dataset also contains a fixed channel–error assignment, the sensor-identity embeddings may encode a persistent statistical association between particular channel identities and error types. The effect of this association is examined under randomized channel–error assignments in Section 4.4.3.
Finally, positional encoding is added to the input feature z j at each time step to preserve temporal sequence information
h j = Dropout ( z j + e j pos ) ,
where e j pos R d model is the learnable positional encoding vector for time step j, and Dropout is used to regularize training. The features of all time steps are then assembled into the encoder input matrix
H ( 0 ) = h 1 , h 2 , , h m T R m × d model .

3.2.2. Encoder

The ResCompFormer encoder maps the fused multi-sensor residual embeddings to high-dimensional temporal features that provide global temporal context for the non-autoregressive decoder. The encoder consists of N e stacked identical layers, each containing a multi-head self-attention (MHA) module and a position-wise feed-forward network (FFN). Let the input of the encoder be H ( 0 ) R m × d model . For encoder layer l, the input is the output of the preceding layer, denoted by H ( l 1 ) .
In encoder layer l, the input features are first mapped into the query, key, and value matrices through head-specific linear transformations
Q h ( l ) = H ( l 1 ) W Q , h ( l ) , K h ( l ) = H ( l 1 ) W K , h ( l ) , V h ( l ) = H ( l 1 ) W V , h ( l ) ,
where h = 1 , 2 , ; N h denotes the index of the attention head; and N h is the number of attention heads. W Q , h ( l ) , W K , h ( l ) , and W V , h ( l ) R d model × d k are learnable projection matrices for attention head h in layer l.
Each attention head then models dependencies across time steps using scaled dot-product attention
head h ( l ) = Softmax Q h ( l ) K h ( l ) T d k V h ( l ) ,
where d k = d model / N h denotes the feature dimension of each attention head.
The outputs of all attention heads are concatenated and then projected by an output projection matrix to obtain the output of the multi-head self-attention module
MHA H ( l 1 ) = Concat head 1 ( l ) , , head N h ( l ) W O ( l ) ,
where W O ( l ) R N h d k × d model is the output projection matrix in layer l.
Through the multi-head attention mechanism, the model captures long-range temporal dependencies in the fused residual sequence. The sensor-identity and measurement-type information has already been incorporated into the residual embeddings and channel-wise feature fusion, enabling the encoder to represent residual patterns associated with different sensors and measurement types. This representation helps the encoder characterize constant biases, linear drifts, and saturating exponential drifts with distinct temporal structures.
To improve training stability, a residual connection and layer normalization are applied after the multi-head self-attention module
H ˜ ( l ) = LayerNorm H ( l 1 ) + MHA H ( l 1 ) .
The position-wise feed-forward network then applies a nonlinear transformation at each time step
FFN H ˜ ( l ) = FC 2 GELU FC 1 H ˜ ( l ) ,
where FC 1 and FC 2 denote the first and second fully connected (FC) layers, respectively, and GELU denotes the Gaussian error linear unit activation function.
Finally, a residual connection and layer normalization are applied to the feed-forward output to obtain encoder layer l:
H ( l ) = LayerNorm H ˜ ( l ) + FFN H ˜ ( l ) .

3.2.3. Decoder

After the encoder extracts global temporal features from the residual sequence, ResCompFormer uses a non-autoregressive decoder to predict the signed systematic-error values for all sampling epochs in parallel. Rather than feeding back previous predictions autoregressively, the decoder concatenates a segment of encoded residual features used as start tokens with zero placeholder vectors at the positions to be predicted. Learnable decoder positional embeddings distinguish these placeholder positions, allowing the complete signed systematic-error sequence to be generated in a single forward pass.
First, a residual feature segment with length L start is selected from the encoder output sequence H ( N e ) as the start token sequence of the decoder
X start = H 1 : L start , : ( N e ) R L start × d model .
The start-token sequence provides residual context for the decoder. Meanwhile, an all-zero placeholder sequence is constructed as
X 0 = 0 m × d model R m × d model .
The start token sequence and the placeholder sequence are first concatenated as
X dec 0 = Concat X start , X 0 R ( m + L start ) × d model .
Then, a learnable decoder positional embedding matrix is added to the concatenated sequence:
X dec = X dec 0 + E pos dec , E pos dec R ( m + L start ) × d model .
Although the placeholder vectors themselves are initialized as zeros, the added decoder positional embeddings provide explicit temporal-position information for all prediction slots. Therefore, the decoder can distinguish the prediction slots corresponding to different sampling epochs.
Passing the input through N d stacked decoder layers yields the output feature sequence
Z dec = Decoder X dec , H ( N e ) R ( m + L start ) × d model ,
where H ( N e ) serves as the encoder memory for the decoder.
The first L start positions correspond to start tokens and serve only as decoder context. Therefore, only the features at the final m placeholder positions are retained for systematic-error prediction:
Z pred = Z dec L start + 1 : L start + m , : R m × d model .
A final linear projection maps the prediction features to the C observation channels, yielding the signed observation-domain systematic-error matrix
U ˜ k , mat = Z pred W u + 1 m b u T R m × C ,
where W u R d model × C and b u R C are the learnable output projection parameters, and 1 m denotes an m-dimensional column vector of ones. Here, column c of U ˜ k , mat corresponds to the predicted signed systematic-error sequence of observation channel c over all sampling epochs.
The predicted matrix is then vectorized using the same channel ordering as the global observation vector Y :
U ˜ k = vec U ˜ k , mat R m C .
The non-autoregressive decoder predicts the entire systematic-error sequence in parallel within a single forward pass. This formulation avoids recursive error propagation and reduces the inference latency associated with autoregressive decoding.

3.2.4. Loss Function

ResCompFormer is trained with a joint objective that combines a signed systematic-error prediction loss with a trajectory reconstruction loss. The first term supervises observation-domain error prediction directly, whereas the second links the predicted errors to the downstream trajectory-reconstruction objective.
The signed systematic-error prediction loss directly penalizes deviations between the network output and the ground-truth signed systematic error. Let U ˜ mat denote the predicted systematic-error matrix and U mat the corresponding ground-truth matrix. The loss is defined as
L e = 1 N obs j = 1 m c = 1 C u ˜ c ( t j ) u c ( t j ) 2 σ c 2 ,
where N obs = m C denotes the total number of observation elements, and σ c denotes the standard deviation of observation noise for channel c.
The trajectory reconstruction loss constrains the final trajectory estimate through a differentiable B-spline-constrained EMBET module, thereby linking observation-domain systematic-error prediction to the downstream trajectory reconstruction objective. Let U ˜ mat ( θ ) denote the systematic-error sequence predicted by ResCompFormer, where θ denotes the trainable network parameters. The corresponding vectorized prediction and compensated observation vector are given by
U ˜ ( θ ) = vec U ˜ mat ( θ ) , Y c ( θ ) = Y U ˜ ( θ ) .
Given the compensated observations, the B-spline coefficients are re-estimated by solving the conditional weighted nonlinear least-squares problem
b ^ ( θ ) = arg min b 1 2 Y c ( θ ) F ( b ) P 2 , P = Σ 1 .
The reconstructed trajectory is subsequently obtained as
X ^ ( θ ) = B s b ^ ( θ ) ,
where B s is the stacked B-spline state-mapping matrix. During training, the nonlinear iterations executed by the EMBET solver are retained in the computational graph, allowing the trajectory reconstruction loss to propagate through the B-spline coefficient estimation procedure. The corresponding backpropagation and numerical implementation are described in Section 3.2.5.
The trajectory reconstruction loss is defined as
L t = 1 m j = 1 m α x x ^ ( t j ) x ( t j ) 2 2 σ x 2 + α x ˙ x ˙ ^ ( t j ) x ˙ ( t j ) 2 2 σ x ˙ 2 ,
where α x + α x ˙ = 1 . The constants σ x and σ x ˙ are fixed normalization scales for the position and velocity reconstruction errors, respectively and are computed from the root-mean-square scales of the ground-truth position and velocity sequences in the training set.
The total loss function is defined as
L ( θ ) = λ 1 L e ( θ ) + λ 2 L t ( θ ) .
where λ 1 and λ 2 are the weighting coefficients of the systematic-error prediction loss and trajectory reconstruction loss, respectively.
The optimized network parameters are obtained as
θ * = arg min θ L ( θ ) .
The two loss terms provide complementary forms of supervision. The systematic-error prediction loss directly constrains the signed error sequence in the observation domain, whereas the trajectory reconstruction loss evaluates the effect of the predicted errors on the reconstructed position and velocity. Consequently, the gradient of L t is propagated through observation compensation and the differentiable EMBET trajectory-re-estimation procedure to the ResCompFormer parameters.

3.2.5. Gradient Backpropagation and Numerical Implementation of the Differentiable EMBET Layer

The trajectory reconstruction loss depends on the systematic-error prediction through the nonlinear B-spline trajectory-re-estimation procedure. To propagate trajectory-level supervision to ResCompFormer, the nonlinear iterations executed by the EMBET solver during training are retained in the computational graph and differentiated by backpropagation.
For the compensated observation vector Y c , let b ( s ) denote the B-spline coefficient vector at the s-th nonlinear iteration. Here, s indexes the inner Gauss–Newton iterations of the differentiable EMBET solver, whereas k denotes the outer systematic-error compensation iteration introduced in Section 3.1. The corresponding observation residual and Jacobian with respect to the B-spline coefficients are
r ( s ) = Y c F b ( s ) , J b ( s ) = F ( b ) b b = b ( s ) .
Using the weighting matrix P = Σ 1 defined in Section 2.1, the Gauss–Newton coefficient increment is obtained from
J b ( s ) T P J b ( s ) Δ b ( s ) = J b ( s ) T P r ( s ) ,
followed by
b ( s + 1 ) = b ( s ) + Δ b ( s ) .
After the prescribed nonlinear iterations, the resulting coefficient vector is denoted by b ^ , and the reconstructed trajectory is
X ^ = B s b ^ .
Gradient propagation through the EMBET solver.
The original observation vector Y is independent of the network parameters, whereas the compensated observations satisfy
Y c ( θ ) = Y U ˜ ( θ ) .
Accordingly, application of the chain rule gives the gradient of the trajectory reconstruction loss with respect to the ResCompFormer parameters as
θ L t = U ˜ θ T Y c U ˜ T b ^ Y c T B s T X ^ L t .
Since Y c / U ˜ = I , Equation (85) can be written as
θ L t = U ˜ θ T b ^ Y c T B s T X ^ L t .
Equation (86) makes the backpropagation path explicit. The trajectory-level gradient is first mapped from the reconstructed trajectory to the estimated B-spline coefficients, then propagated through the nonlinear trajectory re-estimation procedure to the compensated observations, and finally transferred through the systematic-error prediction to the network parameters.
The term b ^ / Y c contains the accumulated dependence of all nonlinear iterations on the compensated observations. From Equation (82), the sensitivity between two successive iterations satisfies
b ( s + 1 ) Y c = I + Δ b ( s ) b ( s ) b ( s ) Y c + Δ b ( s ) Y c .
The first term in Equation (87) accounts for the indirect influence of the compensated observations through the B-spline coefficients obtained in preceding iterations. The second term accounts for their direct influence on the coefficient increment through the current residual. Moreover, J b ( s ) itself depends on b ( s ) ; consequently, coefficient changes generated in earlier iterations affect both the residual and the Jacobian in subsequent iterations. These dependencies are retained in the computational graph and evaluated by automatic differentiation.
The coefficient increment in Equation (81) is obtained by solving a linear system at each nonlinear iteration. Differentiating this equation gives
J b ( s ) T P J b ( s ) d Δ b ( s ) = d J b ( s ) T P r ( s ) d J b ( s ) T P J b ( s ) Δ b ( s ) .
Equation (88) shows that the differential of the B-spline coefficient increment can itself be obtained through a linear-system solution. Therefore, differentiation through the Gauss–Newton step does not require explicitly differentiating a matrix-inverse expression. In practice, the linear-system operation is kept in the computational graph, and its reverse-mode derivatives are evaluated together with the residual, Jacobian, and coefficient-update operations.
Several implementation choices improve the numerical robustness of the differentiable EMBET layer. First, the weighting matrix P = Σ 1 accounts for the different noise scales of heterogeneous measurement components and reduces scale imbalance in the weighted least-squares system. Second, the coefficient increments and the corresponding backward derivatives are evaluated through linear-system solves rather than through explicitly formed matrix inverses, thereby avoiding unnecessary round-off errors associated with explicit inversion. Third, only the nonlinear iterations executed during training are retained in the computational graph, which limits the depth of the unrolled optimization and reduces the accumulation of numerical and gradient errors over successive iterations.
These measures improve the numerical robustness of the differentiable implementation but do not remove ill-conditioning inherent in the underlying estimation problem. If J b ( s ) becomes rank-deficient or nearly rank-deficient, the corresponding linearized least-squares system may remain sensitive to measurement perturbations. The differentiable EMBET layer therefore relies on the same local solvability and conditioning requirements as the underlying nonlinear trajectory estimator.
The differentiable training procedure and the complete inference procedure serve different purposes. During training, the nonlinear trajectory-re-estimation iterations retained in the computational graph provide trajectory-level gradients for network optimization. During inference, the optimized network parameters are held fixed, and the complete residual-driven compensation procedure, including residual construction, systematic-error prediction, observation compensation, and B-spline trajectory re-estimation, is repeated until the prescribed convergence criterion is satisfied.

4. Simulation Experiments

This section presents simulation experiments to validate the mechanism underlying weak identifiability analyzed in Section 2.2 and to evaluate the proposed ResCompFormer-based compensation method. After constructing the multi-sensor simulation dataset, a controlled experiment examines the coupling between systematic-error responses and the B-spline trajectory representation. Compensation and trajectory-reconstruction performance are then evaluated under the systematic-error model used to generate the training and test data, with iterative and stepwise EMBET variants included for comparison. The evaluation is further extended to parameter-distribution shift, an unseen systematic-error form, randomized channel–error assignments, and dropout of previously known sensors. Finally, the sensitivity to residual normalization and decoder configuration is examined together with computational efficiency.

4.1. Simulation Dataset Construction

4.1.1. UAV Trajectory Construction

To avoid the inverse crime that may arise when the same B-spline representation is used for both trajectory generation and trajectory reconstruction, the ground-truth UAV trajectories are generated using a nonlinear six-degree-of-freedom (six-DOF) fixed-wing flight-dynamics model rather than a prescribed spline model. The flight-dynamics model and representative maneuver scenarios follow established theoretical and simulation formulations for small fixed-wing UAVs [45,46].
For trajectory sample , the full flight-dynamics state used for ground-truth trajectory generation is defined as
χ ( ) ( t ) = x n ( ) T ( t ) , v b ( ) T ( t ) , ϕ ( ) ( t ) , θ ( ) ( t ) , ψ ( ) ( t ) , ω x ( ) ( t ) , ω y ( ) ( t ) , ω z ( ) ( t ) T ,
where x n ( ) ( t ) denotes the UAV position in the local north-east-down (NED) navigation frame; v b ( ) ( t ) denotes the velocity expressed in the body-fixed frame; and ϕ ( ) ( t ) , θ ( ) ( t ) , and ψ ( ) ( t ) denote the roll, pitch, and yaw angles, respectively. Furthermore, ω x ( ) ( t ) , ω y ( ) ( t ) , and ω z ( ) ( t ) denote the corresponding body-axis angular rates.
The attitude angles and angular rates in Equation (89) are auxiliary states required by the six-DOF flight-dynamics simulator to generate dynamically feasible trajectories. They are neither included in the heterogeneous multi-sensor observation model nor estimated by the EMBET solver. Only the position and velocity components generated by the flight-dynamics model are retained for observation generation and subsequent trajectory reconstruction.
The state evolution is governed by
χ ˙ ( ) ( t ) = F χ ( ) ( t ) , δ ( ) ( t ) ; η ,
where F ( · ) represents the nonlinear six-DOF flight-dynamics model; δ ( ) ( t ) contains the throttle, aileron, elevator, and rudder commands; and η collects the aircraft mass, moments of inertia, aerodynamic coefficients, propulsion parameters, and gravity-related parameters.
To construct trajectory samples with diverse motion characteristics, the initial position, heading, airspeed, altitude, commanded flight states, maneuver initiation time, and maneuver duration are independently randomized within prescribed feasible ranges. A guidance and stabilization module converts the commanded heading, airspeed, altitude, and turning variables into dynamically feasible throttle and control-surface commands. Accordingly, the resulting dataset covers straight and level flight, climbing and descending flight, coordinated turns, loitering flight, and coupled three-dimensional maneuvers with diverse spatial geometries and motion intensities.
The nonlinear dynamic equations are numerically integrated over the time interval [ 0 , T max ] using the sampling interval T s . Trajectory samples that violate the prescribed airspeed, altitude, or bank-angle constraints are discarded and regenerated.
Because the velocity state in Equation (89) is expressed in the body-fixed frame, it is first transformed into the local NED navigation frame as
v n ( ) ( t ) = C b n ϕ ( ) ( t ) , θ ( ) ( t ) , ψ ( ) ( t ) v b ( ) ( t ) ,
where C b n ( · ) denotes the direction-cosine matrix from the body-fixed frame to the local NED navigation frame.
Finally, the generated NED position x n ( ) ( t ) and velocity v n ( ) ( t ) are transformed into the Earth-centered, Earth-fixed (ECEF) frame using a predefined geodetic reference point. Only the resulting ECEF position x ( ) ( t ) and velocity x ˙ ( ) ( t ) constitute the trajectory state used to generate the heterogeneous multi-sensor observations and to evaluate the subsequent EMBET trajectory reconstruction. The attitude angles and angular rates are not passed to the EMBET solver.

4.1.2. Multi-Sensor Observation Data Generation

The simulation uses 11 sensors to track the target: seven radar sensors and four electro-optical sensors. The radar measurement components include range and range rate, while the electro-optical sensors measure azimuth and elevation angles. The locations of all sensor stations are preset in the ECEF frame. For trajectory at sampling time t j , multi-sensor observations are generated using the sensor model in (1), the ground-truth ECEF position x ( ) ( t j ) and velocity x ˙ ( ) ( t j ) , and the sensor-station position s i , which defines the origin of the corresponding local ENU frame.
To emulate practical measurements, Gaussian white noise and the systematic-error components described below are added to the simulated observations. The random-noise samples are independently generated across sensors, measurement components, and observation epochs. Accordingly, the measurement-noise covariance matrix Σ used in the simulation experiments is diagonal. The standard deviations of the range and range rate measurement noises are set to σ R = 5 m and σ R ˙ = 0.3 m/s, respectively, while the standard deviations of the azimuth and elevation measurement noises are both set to σ A = 5 and σ E = 5 . The parameter settings of the simulation dataset are given in Table 1.
Three types of systematic error are considered: constant bias, linear drift, and saturating exponential drift. For measurement component d of sensor i, the systematic error is uniformly expressed as
u i , d ( t j ) = u i , d 0 + k i , d Δ t j + β i , d 1 exp Δ t j τ i , d c ,
where Δ t j = t j t 1 denotes the elapsed time from the first sampling instant, u i , d 0 denotes the constant-bias coefficient, k i , d denotes the linear-drift coefficient, β i , d denotes the asymptotic magnitude of the saturating exponential drift, and τ i , d c denotes the corresponding time constant.
To represent channel-dependent error characteristics in a heterogeneous multi-sensor system, a unique systematic-error type is assigned to each active observation channel. In the unified systematic-error model, this channel-wise configuration is implemented by setting the coefficients associated with the inactive error types to zero. The resulting error-type configuration is given in Table 2. This configuration defines the baseline systematic-error setting used in the controlled analysis of Section 4.2 and the comparative experiment of Section 4.3. Section 4.4 subsequently varies the parameter distribution, error functional form, channel–error assignment, and sensor availability to examine the robustness of the estimation methods beyond this baseline setting. Parameters associated with different observation channels are assigned independently, even when they have the same numerical value or sampling range. All angular systematic-error parameters are converted into radians before numerical calculation.

4.2. Controlled Analysis of Weak Identifiability

A paired controlled experiment with a correctly specified systematic-error model is conducted to examine empirically the mechanism underlying weak identifiability analyzed in Section 2.2. The experiment compares a noise-only reference with a scenario in which the prescribed systematic errors are present and jointly estimated with the B-spline trajectory. The same trajectories, random-noise realizations, and trajectory initializations are used in the paired runs. This design quantifies the additional reconstruction and parameter-estimation difficulty associated with the presence and joint estimation of systematic errors without introducing error–model mismatch. The resulting parameter, systematic-response, and trajectory statistics provide a controlled reference for the compensation experiments in Section 4.3.

4.2.1. Experimental Setup

The experiment uses the 11-sensor network described in Section 4.1, including seven radar sensors that provide range and range-rate measurements and four electro-optical sensors that provide azimuth and elevation measurements. All 22 observation channels are retained. The observation channels with active systematic errors and their fixed true parameter values are listed in Table 2 and Table 3. The standard deviations of the random measurement errors are 5 m for range, 0.3 m / s for range rate, and 5 for both azimuth and elevation.
Twenty deterministic three-dimensional trajectories are generated, and 30 independent Gaussian-noise realizations are used for each trajectory, resulting in 600 paired runs. In Scenario 1, the observations contain random noise only and the trajectory is estimated without active systematic-error parameters. In Scenario 2, the prescribed constant, linear, and saturating exponential errors are added simultaneously, and the B-spline coefficients and 16 active systematic-error parameters are estimated jointly. The same trajectory, random-noise realization, and initialization are used in both scenarios.
The position and velocity root mean square errors (RMSE) are calculated as
RMSE x = 1 m j = 1 m x ^ ( t j ) x ( t j ) 2 2 , RMSE x ˙ = 1 m j = 1 m x ˙ ^ ( t j ) x ˙ ( t j ) 2 2 .
The heterogeneous systematic-error parameters are summarized using the scale-normalized root mean square error (sNRMSE),
sNRMSE γ = 1 N γ a = 1 N γ γ ^ a γ a true s a true 2 , s a true = γ a true ,
where N γ = 16 is the number of active systematic-error parameters in Scenario 2, and all active true parameters are nonzero. The mean absolute normalized errors are calculated using the same parameter scale. The absorption ratio of the actual systematic-error response is defined as
η U = Π b U true P 2 U true P 2 × 100 % ,
where Π b U true denotes the component of the true systematic-error response that lies in the spline sensitivity space.

4.2.2. Experimental Results and Analysis

As shown in Table 4, relative to the paired noise-only reference, the joint-estimation scenario increases the mean position RMSE by approximately 18.8 % and the mean velocity RMSE by about 8.3 % . The larger relative degradation in position is consistent with the mechanism underlying weak identifiability analyzed in Section 2.2. Slowly varying systematic-error responses can be partially represented by smooth, low-frequency perturbations of the B-spline trajectory, so the trajectory and systematic-error terms compete to explain part of the same observation residual. This reduced separability primarily affects position reconstruction in the present experiment.
The smaller degradation in velocity is consistent with two properties of the present observation model. First, velocity is directly constrained by multiple range-rate channels, including channels without active systematic errors, which provide additional constraints that limit systematic-error-induced trajectory distortion. Second, the derivative-based velocity reconstruction is less sensitive than position to very low-frequency perturbations of the spline trajectory. Consequently, the effect of the joint-estimation scenario is also visible in velocity, but is weaker than that observed in position.
Overall, the experiment shows that weak identifiability primarily degrades position reconstruction and increases uncertainty in systematic-error estimation. Representative parameter-wise estimation statistics are further reported in Table 5. Its effect on velocity is smaller because range-rate measurements provide direct constraints and differentiation attenuates low-frequency position deviations. This behavior persists even when all observation channels are retained and the estimation model exactly matches the systematic-error generation model. The degradation therefore cannot be attributed to error–model mismatch and is consistent with the overlap between the trajectory and systematic-error sensitivity spaces analyzed in Section 2.2. The parameter uncertainty does not necessarily translate directly into an equally large discrepancy in the reconstructed systematic-error sequence. Over a finite observation interval, different parameter combinations can produce similar slowly varying responses, while the component aligned with the spline sensitivity space may be partially absorbed by the trajectory correction. Parameter recovery, systematic-error-sequence recovery, and trajectory reconstruction therefore describe related but distinct aspects of the estimation problem. Section 4.3 compares these quantities under randomized systematic-error parameters.

4.3. Systematic Error Compensation and Trajectory Reconstruction Under Matched Conditions

The controlled analysis in Section 4.2 shows that systematic-error responses can overlap with the B-spline trajectory representation during joint estimation. Building on this result, the following experiment compares systematic-error compensation and trajectory reconstruction under the baseline error model in Equation (92), with the nonzero error parameters randomized according to Table 3. All methods are evaluated using the same test trajectories, noise realizations, and systematic-error realizations. Section 4.4 then examines performance when the parameter distribution, error functional form, channel–error assignment, or sensor availability differs from this baseline setting.

4.3.1. Dataset Settings

The trajectory, sensor configuration, observation channels, and measurement noise settings are identical to those described in Section 4.1. Unlike the weak-identifiability experiment, the nonzero systematic-error parameters are independently sampled for each trajectory from the compensation ranges listed in Table 3. Therefore, different samples contain different amplitudes and temporal patterns of constant-bias, linear-drift, and saturating-exponential errors.
The 1000 generated trajectories are divided at the trajectory level into training, validation, and test sets at a ratio of 80%, 10%, and 10%, respectively. The training and validation sets are used only for training and model selection of the neural-network-based methods M5–M9. All methods are evaluated on the same matched-condition test set using identical test trajectories, systematic-error realizations, and random-noise realizations. The prescribed measurement-noise standard deviations used for residual normalization and loss weighting are fixed according to the sensor settings. Any additional data-dependent normalization statistics are calculated exclusively from the training set and then fixed.
The M9 configuration used in the main comparison follows the settings described in Section 3. The sensitivity experiments in Section 4.5 vary the normalization or decoder configuration while keeping the data partition and the remaining training settings unchanged. For the parameter-shift, error–model-mismatch, and sensor-dropout experiments in Section 4.4, the trained M9 parameters are held fixed. A separately trained model is used only in the Random→Random channel-assignment experiment.

4.3.2. Model Training Settings

For M5–M9, the network input is constructed using the residual initialization procedure in Section 3.1. Specifically, the initial trajectory is estimated without explicitly modeling systematic errors, and the normalized residual sequence defined in Equations (40) and (43) is used as the network input. The corresponding signed systematic-error sequence is used as the supervision target. Because the residual is computed from the estimated trajectory rather than the ground-truth trajectory, ground-truth trajectory information is not used as network input.
The ResCompFormer encoder and decoder contain N e = 4 and N d = 3 layers, respectively. The embedding dimension is d model = 512 , the number of attention heads is N h = 8 , and GELU is used as the activation function. The main M9 configuration uses the noise-standardized residual input in Equation (43) and the parallel decoder defined by Equations (65)–(71). Its start-token length is set to L start = 200 sampling epochs, denoted by L 0 in the sensitivity analysis of Section 4.5.3. The systematic-error prediction loss, trajectory reconstruction loss, and total loss follow Equations (73), (77), and (78), respectively. All neural models are implemented in PyTorch 2.6.0 and trained using AdamW. The batch size is set to 8, the initial learning rate is 5 × 10 5 , and the maximum number of training epochs is 100. A warm-up stage followed by cosine annealing is used for learning-rate adjustment, and the model with the lowest validation loss is retained for testing. The experiments are conducted on a computer equipped with an NVIDIA RTX 4070 GPU, 64 GB of memory, and an Intel Core i9-14900 processor.
During testing, the optimized network parameter set θ * is held fixed. Systematic-error prediction, observation compensation, and B-spline trajectory re-estimation are performed according to Equations (47)–(49). The iterative procedure is terminated when the convergence criteria in Equations (50) and (51) are satisfied.

4.3.3. Comparative Experiments

The standard cubic B-spline EMBET method [1], adaptive-knot B-spline method [19], Bayesian information criterion (BIC)-based free-knot B-spline method [18], and regularized B-spline method [7] are denoted by M1–M4, respectively. A bidirectional long short-term memory (BiLSTM) network [47], a temporal convolutional network (TCN) [48], a standard Transformer [42], and an iTransformer [38] are adapted to predict systematic-error sequences from the same residual inputs and are denoted by M5–M8, respectively. The proposed ResCompFormer is denoted by M9.
Two additional model-driven variants are constructed from M4 to examine the influence of the estimation schedule. M10 performs iterative compensation: the systematic-error parameters are estimated from the current trajectory, the original observations are compensated using the reconstructed systematic-error sequence, and the B-spline trajectory is re-estimated. The residuals are then reconstructed and the procedure is repeated until the outer convergence criteria in Equations (50) and (51) are satisfied. M11 uses the same iterative framework but estimates the systematic-error terms in two stages. Constant-bias terms are estimated and compensated first, followed by the linear and saturating-exponential terms and a new trajectory update. M10 and M11 use the same parametric error model as M4 and contain no learned parameters.
The model-driven methods M1–M4 do not require data-driven training and are applied independently to every trajectory in the test set. For each test trajectory, these methods jointly estimate the B-spline trajectory coefficients and the corresponding systematic-error parameters from the same noisy observations. The estimated systematic-error parameters are then substituted into Equation (92) to reconstruct the complete systematic-error sequences for evaluation. M10 and M11 use the same systematic-error parameterization, initialization, regularization settings, and observation weights as M4. Their outer stopping conditions are consistent with the convergence criteria used by the iterative compensation procedure. Comparisons among M4, M10, and M11 therefore separate one-shot joint estimation, iterative compensation, and stepwise parameter estimation. The neural-network-based methods M5–M9 use the same training, validation, and test partitions, residual inputs, supervision targets, and iterative trajectory re-estimation procedure. After training and model selection using the training and validation sets, respectively, the fixed models are evaluated on exactly the same test trajectories used for the model-driven methods. Consequently, M1–M11 are evaluated using identical test trajectories, systematic-error realizations, and random-noise realizations whenever the method is applicable, and their systematic-error estimates are compared in the same observation domain.
Although the true systematic-error parameters vary among the test samples, all compared methods are evaluated on a paired, sample-by-sample basis. For test trajectory , the trajectory and systematic-error sequence estimated by each method are compared with the corresponding sample-specific ground truth. The resulting sample-level errors are subsequently summarized over the complete test set. Therefore, the comparison reflects paired estimation errors under identical test conditions rather than differences in the absolute parameter values assigned to individual trajectories.
The position and velocity reconstruction errors are evaluated using RMSE x and RMSE x ˙ , respectively. To evaluate heterogeneous systematic-error sequences with different physical units, the noise-normalized root mean square error (nRMSE) of the systematic-error sequence produced by method r for test trajectory is defined as
nRMSE U ( , r ) = 1 N obs j = 1 m c = 1 C u ^ r , c ( ) ( t j ) u c ( ) ( t j ) 2 σ c 2 1 / 2 ,
where N obs = m C , u c ( ) ( t j ) denotes the true signed systematic error of channel c at time t j , and u ^ r , c ( ) ( t j ) is the corresponding final estimate produced by method r. The noise standard deviation σ c is identical to that used in Equation (73).
Unlike sNRMSE γ , which evaluates the estimated parametric coefficients, nRMSE U evaluates the complete systematic-error response in the observation domain. It is therefore applicable to both parameterized EMBET methods and neural-network methods that directly predict systematic-error sequences.
In the compensation dataset, several systematic-error parameters are sampled from intervals that include values close to zero. Normalizing the estimation error by the sample-specific true parameter magnitude, as in Equation (94), would therefore become unstable for these samples. For the parametric methods, the parameter error is instead normalized by the width of the sampling range. Let the sampling interval of parameter γ a in Table 3 be [ l a , u a ] , and define its range width as w a = u a l a . Let N test denote the number of test trajectories and N γ the number of active systematic-error parameters evaluated in the parameter domain. The range-normalized parameter RMSE is
pNRMSE γ ( r ) = 1 N test N γ = 1 N test a = 1 N γ γ ^ r , a ( ) γ a ( ) w a 2 1 / 2 ,
and the corresponding signed normalized bias and mean absolute normalized parameter error are
pBias γ ( r ) = 1 N test N γ = 1 N test a = 1 N γ γ ^ r , a ( ) γ a ( ) w a , pMAE γ ( r ) = 1 N test N γ = 1 N test a = 1 N γ γ ^ r , a ( ) γ a ( ) w a .
These range-normalized metrics are used for the compensation experiment because its randomized parameter intervals may include values close to zero. They are distinct from sNRMSE γ in the controlled weak-identifiability experiment, where the true parameters are fixed and nonzero and normalization by | γ a true | is well defined. The two parameter-domain summaries therefore serve complementary purposes and should not be compared numerically as if they used the same normalization. Because M5–M9 directly predict systematic-error sequences rather than the coefficients of Equation (92), parameter-domain metrics are reported only for the parametric model-driven methods.
Table 6 summarizes the overall comparison of trajectory reconstruction and systematic-error estimation performance under the matched test condition.
Table 7 provides a complementary view in the parameter domain. Relative to M4, M10 reduces the reported pNRMSE γ and pMAE γ by 9.33 % and 9.49 % , respectively, whereas M11 achieves larger reductions of 19.40 % and 20.44 % . The signed pBias γ remains close to zero for all model-driven methods and does not decrease monotonically, which is expected because positive and negative parameter errors can partially cancel in a signed average. Together with Table 6, these results show that iterative and stepwise estimation improve explicit parameter recovery, but parameter-domain accuracy should still be distinguished from observation-domain systematic-error recovery and downstream trajectory reconstruction.
This distinction is also consistent with the controlled weak-identifiability experiment in Table 4. Although sNRMSE γ and pNRMSE γ are based on different normalization schemes and therefore cannot be compared numerically, both experiments show that imperfect recovery of the explicit systematic-error parameters does not translate one-to-one into an equally large error in the reconstructed observation-domain systematic-error sequence. This behavior is expected under weak identifiability because different parameter perturbations can generate similar observation responses, while part of the systematic-error response can be absorbed by the B-spline trajectory representation. Consequently, the practical concern is not the exact recovery of every parametric coefficient but whether the remaining ambiguity degrades systematic-error compensation and trajectory reconstruction.
The temporal position and velocity RMSE results are further visualized in Figure 4.
As shown in Table 6, under the matched test condition, M9 achieves the lowest RMSE x , RMSE x ˙ , and nRMSE U among all compared methods. Compared with the best-performing one-shot model-driven method, M4, M9 reduces the position RMSE by 38.81 % . The iterative variants M10 and M11 progressively improve on M4; in particular, M11 reduces the position RMSE from 1.2383 m to 1.0829 m and the systematic-error nRMSE from 5.2811 to 4.7318 . Compared with the strongest data-driven baseline, M8, M9 also achieves lower errors across all three metrics. These results establish the matched-condition reference; Section 4.4 examines how the performance changes when the test distribution or sensor configuration departs from this setting.
Figure 4a shows that all methods exhibit relatively large position errors near the beginning and end of the observation interval, whereas the errors remain substantially lower over the central portion of the trajectory. Compared with all other methods, M9 suppresses both the boundary peaks and intermediate fluctuations more effectively, resulting in the lowest overall position RMSE.
A similar temporal pattern is observed in Figure 4b. The velocity errors are concentrated primarily near the two boundaries, whereas the reconstruction remains relatively stable over the central observation interval. M9 achieves the lowest overall velocity RMSE. The consistent improvements in both position and velocity reconstruction indicate that the predicted systematic-error sequences effectively correct the observations without introducing additional temporal inconsistency into the reconstructed trajectory.
Among the one-shot model-driven methods M1–M4, M4 provides the best overall performance, indicating that spline regularization and parameter alignment can improve both trajectory reconstruction and systematic-error estimation. Nevertheless, B-spline coefficients and systematic-error parameters are still optimized within the same estimation problem. Consequently, slowly varying systematic-error responses may continue to compete with the flexible spline representation for explaining the same observation residuals.
The data-driven baselines M5–M8 show progressively lower trajectory-reconstruction errors and nRMSE U within that group. However, trajectory accuracy and systematic-error-sequence recovery do not follow the same ranking across the model-driven and data-driven methods. For example, M5 attains a lower position RMSE than M4 ( 1.1757 m versus 1.2383 m) but a substantially larger nRMSE U ( 8.5554 versus 5.2811 ). Thus, improved trajectory reconstruction does not by itself imply more accurate recovery of the underlying systematic-error sequence. This discrepancy between the two domains is consistent with partial absorption of structured residual components by the estimated trajectory.
M9’s advantage under matched conditions reflects the combined effect of its residual-driven compensation strategy and task-oriented network design. First, systematic errors are predicted in the observation domain before trajectory re-estimation, so the network-predicted error sequence and B-spline coefficients are not estimated as a single joint parametric correction within the same normal-equation system. Second, multichannel temporal modeling allows the network to exploit consistency across sensors, measurement types, and sampling epochs when separating persistent or slowly varying patterns from local random fluctuations. Third, sensor-identity and measurement-type embeddings provide channel-specific information beyond normalized residual amplitudes alone; the dependence on the fixed sensor–error association is examined separately in Section 4.4.3. Finally, the trajectory reconstruction loss constrains the predicted error sequence according to its downstream effect on position and velocity estimation rather than solely through pointwise observation-domain agreement.
Accordingly, the performance advantage of ResCompFormer is interpreted first in terms of the change in estimation strategy: systematic errors are predicted in the observation domain rather than jointly estimated with the B-spline coefficients, thereby avoiding their direct competition within the same parametric estimation problem. Within this decoupled formulation, temporal and cross-channel regularities learned from the training data further improve systematic-error prediction over the considered data distribution. This decoupling does not create additional algebraic information or alter the structural identifiability conditions of the original observation model; rather, it avoids the specific weak-identifiability mechanism introduced by joint parametric estimation in the B-spline-constrained EMBET formulation.
The cross-domain comparison should be interpreted by distinguishing parameter recovery from error-sequence recovery. A relatively large parameter-space error can coexist with a smaller observation-domain discrepancy because different parameter combinations may generate similar slowly varying responses, particularly along weakly sensitive directions; in addition, the component overlapping the spline sensitivity space may be partially absorbed by the trajectory correction.

4.4. Robustness Under Distribution, Model, and Sensor Variations

The experiments in Section 4.2 and Section 4.3 use the systematic-error family in Equation (92) for both data generation and the parametric model-driven estimators. To examine performance beyond this matched setting, the test conditions are varied in four ways: parameter-distribution shift, functional-form mismatch, randomized channel–error assignment, and sensor dropout. Unless otherwise stated, the neural-network parameters obtained from the baseline training and validation sets are kept fixed in these experiments.

4.4.1. Parameter-Distribution Shift

Let the original sampling interval of parameter γ a in Table 3 be [ l a , u a ] , with center c a = ( l a + u a ) / 2 and half-width h a = ( u a l a ) / 2 . The shifted test samples draw the parameter from [ c a 1.5 h a , c a h a ] [ c a + h a , c a + 1.5 h a ] , while the training and validation sets retain the original intervals. Thus, the test parameters lie outside the training support without changing the error functional form. For M4, the numerical optimization bounds are expanded to include the shifted intervals. M9 is evaluated without retraining, so this experiment isolates parameter-distribution shift from functional-form mismatch.

4.4.2. Unseen Systematic-Error Form

Functional-form mismatch is evaluated by replacing the saturating-exponential drifts in the corresponding channels of Table 2 with continuous piecewise-linear drifts, while the constant-bias and linear-drift channels remain unchanged. The piecewise-linear error is defined as
u i , d pw ( t j ) = k 1 , i , d Δ t j , Δ t j t c , k 1 , i , d t c + k 2 , i , d ( Δ t j t c ) , Δ t j > t c .
The breakpoint and slopes are sampled so that the RMS magnitude of the resulting error sequence is comparable with that of the corresponding saturating-exponential error generated by Equation (92). M4 continues to use the parametric model in Equation (92), whereas M9 is evaluated without exposure to piecewise-linear errors during training.

4.4.3. Randomized Channel–Error Assignment

To examine the dependence of the learned representation on the fixed association between sensor identity and systematic-error type in Table 2, the active error types are randomly permuted among compatible sensor channels for each trajectory while preserving the number of constant, linear, and exponential errors and their parameter ranges. In the “Fixed→Random” setting, M9 is trained using the fixed assignment in Table 2 and evaluated directly on randomized assignments. In the “Random→Random” setting, a second ResCompFormer is trained using independently randomized assignments and evaluated on new randomized assignments. The latter setting removes a persistent association between a specific sensor identity and a specific error type across trajectories.

4.4.4. Dropout of Previously Known Sensors

The fixed channel ordering in Equation (55) is retained when evaluating sensor dropout. For each test trajectory, one, two, or three of the 11 known sensors are randomly selected as unavailable over the complete observation interval, corresponding to dropout ratios of approximately 9.1 % , 18.2 % , and 27.3 % . The normalized residual entries of the corresponding channels are set to zero to preserve the network input dimension, and the same channels are assigned zero statistical weight during the subsequent EMBET trajectory re-estimation. The trained network is used without retraining. In this experiment, nRMSE U is calculated only over the remaining available channels.
The results in Table 8 show that the tested methods respond differently to distribution and model variations. Under the parameter-distribution shift, both M4 and M9 exhibit increased errors, while M9 maintains lower errors in both trajectory reconstruction and observation-domain systematic-error estimation. The degradation of M4 becomes more pronounced under the piecewise-linear mismatch because the prescribed parametric error model no longer matches the data-generating process, whereas M9 also degrades but remains at a lower error level. Under randomized channel–error assignments, the Fixed→Random setting exhibits a clear performance degradation relative to the matched reference, indicating that the persistent sensor–error association contributes useful statistical information under the baseline training distribution. In contrast, Random→Random training recovers much of the lost accuracy even though no fixed one-to-one association between sensor identity and error type is retained across trajectories. This recovery indicates that, when assignment variability is represented during training, the model can rely more strongly on temporal residual structure, measurement-type information, and multichannel context rather than on a persistent identity–error association.
Table 9 shows a gradual increase in reconstruction error as additional known sensors become unavailable. With three of the 11 sensors removed, the position RMSE increases from 0.7577 m to 0.9856 m, and the velocity RMSE and nRMSE U , avail follow the same progressive trend. The absence of an abrupt failure indicates that masking unavailable channels while assigning them zero statistical weight allows the current architecture to accommodate the temporary loss of previously known sensors without changing the network input dimension. The remaining channels continue to provide useful information for compensation, although the increasing error and variability also show that the fixed-sensor representation becomes progressively less reliable as observation loss increases.
The behavior for newly introduced sensors is different from dropout of previously known sensors. The current architecture uses predefined sensor-identity embeddings in Equation (53) and a fixed-dimensional all-channel projection in Equation (56). A sensor identity that is absent from training has no learned identity embedding, and adding observation channels changes the input dimension and channel ordering assumed by W f . Direct insertion of previously unseen sensors is therefore not supported by the present formulation. A variable-sensor extension would require representations derived from sensor attributes or observation geometry together with a permutation-aware or set-based channel aggregation mechanism, rather than a fixed identity lookup and fixed-dimensional concatenation.
Together, Table 8 and Table 9 characterize four departures from the baseline condition: parameter extrapolation, error–model mismatch, variation in the sensor–error association, and loss of previously available sensors. These tests complement the matched-condition comparison in Section 4.3 by characterizing how the estimation accuracy changes when the test data depart from the conditions represented in the original training set.

4.5. Ablation and Sensitivity Analysis

4.5.1. Component Ablation

Four ablated variants are evaluated to quantify the contributions of the main ResCompFormer components. The complete model is denoted by RCF-Full.
The variants without sensor-identity embedding, measurement-type embedding, and trajectory reconstruction loss are denoted by RCF-NoSE, RCF-NoMTE, and RCF-NoTL, respectively. The encoder-only variant is denoted by RCF-Enc; in this variant, the Transformer decoder is removed and the systematic-error sequence is predicted directly from the encoder output. All variants use the same data partition, training settings, and iterative compensation procedure as RCF-Full.
As shown in Table 10, removing any of the examined components degrades ResCompFormer performance. This confirms that the sensor-identity embedding, measurement-type embedding, trajectory reconstruction loss, and Transformer decoder each contribute to the final estimation accuracy.
Removing the sensor-identity embedding increases the position RMSE, velocity RMSE, and systematic-error nRMSE, showing that sensor identity carries useful channel-specific information in the matched setting. This information can reflect differences in sensor location, observation geometry, and measurement characteristics, while the fixed baseline assignment also creates a persistent association between particular identities and error types. The randomized-assignment results in Table 8 distinguish these effects further: performance decreases when the fixed association is changed only at test time but largely recovers when assignment variability is also included during training.
Compared with RCF-NoSE, the RCF-NoMTE variant shows a larger degradation, particularly in systematic-error reconstruction. This result indicates that explicitly distinguishing measurement types is important because range, range-rate, azimuth, and elevation measurements retain distinct physical meanings and temporal characteristics even after channel-wise normalization.
Removing the trajectory reconstruction loss produces a larger relative increase in position and velocity RMSE than in systematic-error nRMSE. This pattern shows that an error sequence that closely matches the observation-domain target is not necessarily optimal for downstream trajectory reconstruction. The trajectory-consistency supervision therefore constrains the predicted systematic errors according to their effects on reconstructed position and velocity.
The encoder-only RCF-Enc variant shows the largest overall degradation among the ablated variants, indicating that the decoder is important for transforming multichannel residual features into temporally structured systematic-error sequences. Overall, the ablation results show that the four examined components make complementary contributions to systematic-error compensation and trajectory reconstruction.

4.5.2. Sensitivity to Residual Normalization

The main ResCompFormer configuration normalizes each residual channel by the prescribed measurement-noise standard deviation σ c , as defined in Equation (43). This scaling expresses residual magnitude relative to the random-noise level of each heterogeneous observation channel. Because the systematic-error component can exceed the corresponding random-noise standard deviation, the normalized residual magnitudes may exceed unity. To assess the sensitivity of the learned compensation mapping to this scaling choice, a training-set RMS normalization is used as an alternative.
For RCF-RMS, a fixed scale is computed separately for each observation channel c from the initial residuals of the training trajectories,
s c RMS = 1 N train m = 1 N train j = 1 m r c ( 0 , ) ( t j ) 2 ,
where N train = 800 is the number of training trajectories and m is the number of sampling epochs. Here, the superscript ( 0 , ) denotes the initial residual associated with training trajectory . The corresponding network input is r ¯ c ( k ) ( t j ) = r c ( k ) ( t j ) / s c RMS . The RMS scale is computed from the training set only and is then held fixed for validation, testing, and all outer compensation iterations.
RCF-NoiseStd denotes the baseline M9 configuration using σ c . Because the two normalization rules produce different input distributions, RCF-RMS is trained independently from scratch, while the data partition, network architecture, loss functions, optimizer, and iterative-compensation settings are kept unchanged. In both configurations, the network output remains the signed systematic-error sequence in the original observation units.
As shown in Table 11, RCF-RMS remains close to the baseline in all three metrics. Relative to RCF-NoiseStd, the mean position RMSE, velocity RMSE, and nRMSE U increase by 3.9%, 2.6%, and 3.6%, respectively. These modest changes indicate that the compensation accuracy is not highly sensitive to the residual scaling rule within the tested setting.
Noise standard-deviation normalization nevertheless gives consistently lower errors and is therefore retained in the main model. In addition to its slightly better empirical performance, scaling by σ c has a direct physical interpretation because each residual is expressed relative to the prescribed random uncertainty of its channel. By contrast, the training-set RMS scale contains both random-noise and systematic-error energy and can therefore compress channels with larger structured residuals more strongly. The comparison supports noise standard-deviation normalization as a stable choice for the heterogeneous-noise setting considered here, without implying that it is universally optimal.

4.5.3. Autoregressive Versus Parallel Decoding and Start-Token Length

ResCompFormer employs a non-autoregressive decoder to generate the predicted signed systematic-error values for all sampling epochs in parallel. For comparison, an autoregressive variant, denoted by RCF-AR, is constructed using the same encoder and a causal Transformer decoder with the same number of decoder layers, attention heads, and hidden dimension as the parallel decoder, denoted by RCF-NAR. A zero-valued start vector initializes the autoregressive decoder at the first sampling epoch; thereafter, the preceding C-dimensional systematic-error vector is projected to d model and used as the decoder input for the next sampling epoch. Full teacher forcing is used during training, whereas the previously predicted systematic-error vector is recursively fed back during inference.
RCF-AR and RCF-NAR are trained independently from scratch using the same training and validation split, residual input, loss functions, optimizer settings, and model-selection criterion. They are evaluated on the same 100 matched-condition test trajectories and use the same iterative trajectory-re-estimation procedure. The reported standard deviations are calculated across the test trajectories.
With the sampling interval T s = 0.1 s and m = 2001 sampling epochs, the baseline non-autoregressive model uses L start = L 0 = 200 , corresponding to 20 s of explicit decoder context and approximately 10% of the complete sequence. Start-token sensitivity is evaluated at L start { 100 , 200 , 400 } , corresponding to 10, 20, and 40 s, respectively. These settings span approximately 5%, 10%, and 20% of the complete sequence. In all three cases, the decoder retains access to the complete encoder memory H ( N e ) ; therefore, varying L start changes the amount of explicit start-token context without removing the globally encoded residual information.
As shown in Table 12, the parallel baseline with L start = 200 achieves the lowest mean errors among the tested decoder configurations. Relative to this baseline, RCF-AR increases the position RMSE, velocity RMSE, and nRMSE U by approximately 10.1%, 9.1%, and 10.5%, respectively. These results indicate that recursive generation does not improve systematic-error compensation in the present long-sequence setting. The degradation is consistent with the mismatch between teacher-forced training and recursive inference, together with the propagation of prediction errors through recursive feedback.
Parallel decoding, however, does not imply temporally independent prediction. Temporal dependencies are already represented by the attention-based encoder–decoder architecture, and every prediction position can use the complete encoder memory without conditioning on previously predicted errors. This allows the systematic-error sequence to be generated jointly while avoiding recursive error propagation.
The start-token sensitivity results show a moderate dependence on explicit decoder context. Reducing L start from 200 to 100 increases the three metrics by approximately 4.5%, 3.7%, and 4.7%, whereas increasing it from 200 to 400 increases them by only approximately 1.7%, 1.6%, and 1.6%, respectively, without improving accuracy. This pattern suggests that 200 sampling epochs provide sufficient start-token context for the present data, while a shorter segment loses useful context and a longer segment provides little additional benefit. Accordingly, L start = 200 is retained as the default setting within the tested range.

4.6. Computational Efficiency and Accuracy–Runtime Trade-Off for Offline Trajectory Refinement

Computational efficiency is evaluated during the testing stage after the parameters of the data-driven models have been fixed. All methods are evaluated on the same workstation described in Section 4.3.2, equipped with an NVIDIA RTX 4070 GPU, an Intel Core i9-14900 processor, and 64 GB of memory. The reported total runtime denotes the end-to-end processing time for one complete trajectory, including residual construction, systematic-error estimation, observation compensation, B-spline/EMBET trajectory reconstruction, and all required optimization or iterative compensation procedures. For the neural-network methods, the network prediction time is additionally recorded to separate the computational cost of systematic-error prediction from that of the complete trajectory-refinement pipeline.
The number of trainable parameters is reported for the neural-network methods as a measure of model size. This quantity is not applicable to M1–M4, M10, and M11 because these methods estimate trajectory and systematic-error parameters directly for each observation record rather than using a set of learned network parameters. For the one-shot model-driven methods M1–M4, N outer = 1 . For the iterative methods, N outer denotes the average number of compensation and trajectory re-estimation cycles required to satisfy the stopping criteria during testing.
As shown in Table 13, model size and prediction latency do not follow a strictly monotonic relationship across the neural-network methods because their computational costs also depend on the sequence representation and the degree of parallelism in the corresponding architectures. For example, M8 contains more trainable parameters than M7 but requires less prediction time. In M7, the Transformer encoder operates along the temporal dimension of the m = 2001 sampling epochs, whereas M8 represents the C = 22 observation channels as tokens and applies attention across the channel dimension. The shorter token sequence of M8 therefore reduces the attention-related computational cost despite its slightly larger parameter count.
M9 has approximately 27.57 million trainable parameters, substantially more than the other neural baselines, owing to its d model = 512 representation and four-layer-encoder–three-layer-decoder architecture. Despite its larger model size, M9 requires 44.8 ms to predict one complete residual sequence. With an average of 3.026 outer iterations, the accumulated network-prediction time is approximately 0.136 s per trajectory, which represents only about 1.3% of the 10.536 s end-to-end processing time. Thus, most of the computational cost of the complete M9 procedure arises from the repeated observation compensation and B-spline/EMBET trajectory re-estimation rather than from the ResCompFormer forward pass itself.
The comparison between parallel and autoregressive decoding further illustrates the influence of the inference strategy on computational efficiency. RCF-AR uses the same encoder–decoder dimensions as M9 and consequently has a comparable number of trainable parameters. However, the autoregressive decoder generates the systematic-error sequence sequentially, with each predicted C-dimensional error vector used to construct the input for the next sampling epoch. Its network prediction time therefore increases to approximately 5.86 s, compared with 44.8 ms for the parallel decoder of M9. With an average of 3.183 outer iterations, the accumulated network-prediction time of RCF-AR is approximately 18.66 s, accounting for a substantial portion of its 32.756 s end-to-end runtime. The marked latency difference between the two variants is therefore mainly associated with sequential autoregressive generation rather than with their model sizes.
The model-driven methods exhibit a different computational pattern. Among the one-shot methods, M1 has the lowest runtime, while M2–M4 require additional computation for their respective spline adaptation, regularization, and systematic-error estimation procedures. Introducing iterative refinement further increases the computational burden of the model-driven approach. M10 and M11 require 48.672 s and 63.418 s per trajectory, respectively, because systematic errors and trajectory parameters are repeatedly estimated over several compensation cycles. Although these iterative strategies improve the reconstruction performance of M4, their increased numerical optimization cost is considerably greater than that of M9.
Overall, M9 requires 10.536 s to process one complete trajectory and achieves the lowest position RMSE among the compared methods. Its computational cost is higher than those of the lightweight neural baselines M5–M8 but remains lower than those of the iterative model-driven methods M10 and M11 and the autoregressive RCF-AR variant. These results indicate that the parallel residual-driven compensation strategy provides a favorable balance between trajectory reconstruction accuracy and computational cost in the considered offline processing setting.
The proposed framework is intended for offline trajectory refinement after a complete multi-sensor observation arc has been collected, rather than for sample-by-sample real-time trajectory estimation. The current procedure uses residual information from the complete observation sequence and performs iterative batch compensation followed by B-spline/EMBET trajectory re-estimation. Consequently, its primary objective is to improve systematic-error compensation and trajectory reconstruction accuracy rather than to minimize online processing latency. The measured computational cost is therefore interpreted as the processing overhead required for high-accuracy post-processing of a complete trajectory record. Further development toward online operation would require a causal or streaming sequence-processing mechanism together with a more computationally efficient trajectory re-estimation strategy.

5. Conclusions

This study investigated the absorption of sensor systematic errors by flexible B-spline trajectory representations in multi-sensor trajectory reconstruction. The sensitivity-space analysis showed that the observation-domain responses of slowly varying systematic errors may overlap with the spline sensitivity space and consequently be partially absorbed into the spline-coefficient correction, thereby weakening the identifiability of the systematic-error parameters. To address this problem, a residual-driven ResCompFormer framework was developed to predict multichannel systematic-error sequences from observation residuals and iteratively refine the reconstructed trajectory. The simulation results show that ResCompFormer achieves more accurate systematic-error compensation and position and velocity reconstruction than the considered model-driven and data-driven methods. Among the model-driven variants, iterative compensation and stepwise parameter estimation progressively improve trajectory reconstruction and parameter recovery, while the remaining performance gap between M11 and ResCompFormer indicates that the advantage of the proposed method is not attributable to the iterative estimation schedule alone. Additional experiments further demonstrate the robustness of the proposed framework to variations in systematic-error characteristics and sensor availability.
Several limitations of the present study should nevertheless be acknowledged. The proposed framework avoids the weak-identifiability mechanism associated with jointly estimating B-spline coefficients and systematic-error parameters by replacing parametric systematic-error estimation with data-driven observation-domain error prediction. However, this change in estimation strategy does not alter the underlying algebraic identifiability conditions of the original observation model, and the accuracy of the predicted systematic errors remains dependent on the information contained in the residuals and on the data distribution represented during training. In addition, the current implementation assumes a predefined set and ordering of observation channels. Although the sensor-dropout experiments show gradual degradation when previously known sensors become unavailable, sensors absent during training cannot be directly incorporated without adapting the corresponding sensor representations and channel-processing modules. Finally, the iterative combination of systematic-error prediction and B-spline trajectory re-estimation makes the current framework more suitable for offline trajectory refinement than for sample-by-sample real-time estimation.
Future work will focus on systematic-error separation, sensor-configuration flexibility, and computational efficiency. Physics-informed constraints and uncertainty-aware priors will be investigated to improve robustness under more challenging weak-identifiability conditions. Flexible sensor representations and variable-set channel aggregation will be developed to accommodate changing sensor configurations and previously unseen sensors. More efficient sequence models and trajectory re-estimation algorithms, together with causal and streaming implementations, will also be explored to extend the current offline framework toward near-real-time and online multi-sensor trajectory reconstruction.

Author Contributions

Conceptualization, S.W., J.W., Z.H. and X.Z.; methodology, S.W., B.P., J.W. and Z.H.; software, S.W. and B.P.; validation, S.W. and B.P.; formal analysis, S.W., B.P., J.W. and Z.H.; investigation, S.W. and B.P.; resources, X.Z.; data curation, S.W. and B.P.; writing—original draft preparation, S.W. and B.P.; writing—review and editing, J.W., Z.H. and X.Z.; visualization, S.W. and B.P.; supervision, J.W., Z.H. and X.Z.; project administration, X.Z.; funding acquisition, X.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 62203458).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The simulation datasets generated and analyzed in this study are available from the corresponding author upon reasonable request. The data-generation procedure and the main simulation settings are described in Section 4 to facilitate the reproduction of the experiments.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
6-DOFSix degrees of freedom
BICBayesian information criterion
BiLSTMBidirectional long short-term memory
ECEFEarth-centered, Earth-fixed
EMBETError Model Best Estimate of Trajectory
ENUEast–north–up
FCFully connected layer
FFNFeed-forward network
GELUGaussian error linear unit
GPUGraphics processing unit
IMUInertial measurement unit
MEMSMicroelectromechanical systems
MHAMulti-head attention
NEDNorth–east–down
nRMSENoise-normalized root mean square error
pBiasSigned range-normalized parameter bias
pMAERange-normalized parameter mean absolute error
pNRMSERange-normalized parameter root mean square error
RCFResCompFormer
RCF-ARAutoregressive ResCompFormer variant
RCF-NARNon-autoregressive ResCompFormer variant
RMSERoot mean square error
sNRMSEScale-normalized root mean square error
TCNTemporal convolutional network
UAVUnmanned aerial vehicle

Appendix A. Notation and Symbol Definitions

The principal mathematical symbols used throughout the manuscript are summarized in Table A1. Symbols used only locally in individual derivations are defined at their first occurrence in the main text.
Table A1. Principal mathematical symbols used in the manuscript.
Table A1. Principal mathematical symbols used in the manuscript.
SymbolDefinition
t j The jth sampling epoch.
mNumber of sampling epochs in one observation trajectory.
nNumber of sensors in the heterogeneous sensor system.
D , D i Candidate set of measurement types and the subset available from sensor i, respectively.
CTotal number of available observation channels, with each channel corresponding to a sensor–measurement-component pair.
Ω Set of all available observation channels in the heterogeneous sensor system.
x ( t ) , x ˙ ( t ) Target position and velocity in the ECEF frame at time t, respectively.
α ( t ) Target state vector containing position and velocity at time t.
X Target-state vector obtained by stacking the states over all sampling epochs.
Y Global observation vector obtained by stacking all available multi-sensor measurements.
F ( · ) Nonlinear observation mapping from the target trajectory representation to the observation domain.
U ( t ; γ ) Signed systematic-error vector in the observation domain, parameterized by γ .
ϵ Random measurement-noise vector.
Σ Covariance matrix of the random measurement noise.
P Weighting matrix used in weighted least-squares estimation, with P = Σ 1 .
σ i , d , σ c Measurement-noise standard deviation for measurement component d of sensor i and its equivalent channel-indexed notation, respectively.
pB-spline degree; the corresponding basis-function order is p + 1 .
qNumber of B-spline basis functions, q = N + p + 1 , where N denotes the number of interior knots.
T Extended B-spline knot vector.
B τ , p + 1 ( t ) B-spline basis function of order p + 1 associated with basis index τ .
B ( t ) , B s B-spline state-mapping matrix at time t and its stacked form over all sampling epochs, respectively.
b B-spline coefficient vector used to represent the target trajectory.
γ Parameter vector of the prescribed systematic-error model.
n γ Dimension of the full prescribed systematic-error parameter vector γ .
N γ Number of active systematic-error parameters included in the parameter-domain evaluation metrics.
u i , d 0 , k i , d , β i , d , τ i , d c Constant-bias coefficient, linear-drift coefficient, saturating-exponential magnitude, and corresponding time constant for measurement component d of sensor i, respectively.
J b k , J γ k Sensitivity matrices with respect to the B-spline coefficients and systematic-error parameters at iteration k, respectively.
Π b k P -weighted orthogonal projector onto the spline sensitivity space.
M b k Complementary projection matrix of the spline sensitivity space, defined as I Π b k .
S γ k Profiled Schur-complement information matrix associated with the systematic-error parameters.
R k , R ¯ k Stacked observation-residual vector and the corresponding noise-standardized residual matrix at compensation iteration k, respectively.
N obs Number of observation elements in one complete trajectory, N obs = m C .
N test Number of trajectories in the test set used to summarize evaluation metrics.
d e Dimension of the residual, sensor-identity, and measurement-type embeddings.
d model Hidden feature dimension of the Transformer encoder and decoder.
N e , N d , N h Numbers of encoder layers, decoder layers, and attention heads, respectively.
θ , θ * Trainable ResCompFormer parameters and their optimized values, respectively.
L start Length of the encoded residual feature segment used as the decoder start-token sequence.
U ˜ k , U ^ k Raw ResCompFormer systematic-error prediction and the damped systematic-error estimate used for observation compensation, respectively.
η Damping factor used in the iterative systematic-error update.
η U Absorption ratio of the true systematic-error response projected onto the spline sensitivity space.
τ b , τ U Convergence thresholds for the B-spline coefficients and systematic-error estimate, respectively.
L e , L t Systematic-error prediction loss and trajectory reconstruction loss, respectively.
λ 1 , λ 2 Weighting coefficients of the systematic-error prediction and trajectory reconstruction losses, respectively.
α x , α x ˙ Relative weights of the position and velocity terms in the trajectory reconstruction loss.
σ x , σ x ˙ Fixed normalization scales for position and velocity reconstruction errors in the trajectory loss.
L Total training loss formed by combining the systematic-error prediction and trajectory reconstruction losses.

References

  1. Wang, Z.; Yi, D.; Duan, X.; Yao, J.; Gu, D. Measurement Data Modeling and Parameter Estimation; CRC Press: Boca Raton, FL, USA, 2011. [Google Scholar]
  2. Wu, Y.; Zhu, J. A fusion method for estimate of trajectory. Sci. China Ser. E Technol. Sci. 1999, 42, 149–156. [Google Scholar] [CrossRef] [Scilit]
  3. Yu, Y.; Liu, Z.Y.; Sun, Z.Y.; Liu, H. Development status and prospect of photoelectric measurement equipment in range. Acta Opt. Sin. 2023, 43, 0600002. [Google Scholar]
  4. Li, H. The exterior trajectory measuring method based on coordinate operation of radar and electro-optic theodolite. J. Proj. Rockets Missiles Guid. 2010, 30, 134–136. [Google Scholar]
  5. Pöppl, F.; Neuner, H.; Mandlburger, G.; Pfeifer, N. Integrated trajectory estimation for 3D kinematic mapping with GNSS, INS and imaging sensors: A framework and review. ISPRS J. Photogramm. Remote Sens. 2023, 196, 287–305. [Google Scholar] [CrossRef] [Scilit]
  6. Pöppl, F.; Ullrich, A.; Mandlburger, G.; Pfeifer, N. A flexible trajectory estimation methodology for kinematic laser scanning. ISPRS J. Photogramm. Remote Sens. 2024, 215, 62–79. [Google Scholar] [CrossRef] [Scilit]
  7. Li, D.; Gong, L. Sensor alignment for ballistic trajectory estimation via sparse regularization. Information 2018, 9, 255. [Google Scholar] [CrossRef] [Scilit]
  8. Xu, H.; Wang, Z.; Ma, X.; Cao, W.; Li, Y. Application of EMBET method with spline constraint in systematic error self-calibration of pulse radar. In Proceedings of the 2016 First IEEE International Conference on Computer Communication and the Internet, Wuhan, China, 13–15 October 2016; pp. 177–180. [Google Scholar]
  9. Qian, K.; Wan, Y.; Fan, Y.; Xiong, D. A method of measuring data fusion based on EMBET. In Proceedings of the 2021 IEEE 6th International Conference on Computer and Communication Systems, Chengdu, China, 23–26 April 2021; pp. 33–37. [Google Scholar]
  10. Bu, S.; Kirubarajan, T.; Zhou, G. Online sequential spatiotemporal bias compensation using multisensor multitarget measurements. Aerosp. Sci. Technol. 2021, 108, 106407. [Google Scholar] [CrossRef] [Scilit]
  11. Zhou, G.; Bu, S.; Kirubarajan, T. Simultaneous spatiotemporal bias compensation and data fusion for asynchronous multisensor systems. Chin. J. Inf. Fusion 2024, 1, 16–32. [Google Scholar] [CrossRef] [Scilit]
  12. Ge, T. Research on EMBET Method for Range Task Evaluation. Master’s Thesis, Harbin Institute of Technology, Harbin, China, 2017. [Google Scholar]
  13. Lu, Y.; Wang, J.; He, Z.; Zhou, H.; Xing, Y.; Zhou, X. System error iterative identification for underwater positioning based on spectral clustering. J. Syst. Eng. Electron. 2024, 35, 1028–1041. [Google Scholar] [CrossRef] [Scilit]
  14. Gong, Z.; Xu, X.; Duan, P.; Lei, H. Research on the positioning method of multi-optical theodolites based on Hermite function restriction. Acta Armamentarii 2014, 35, 2092–2097. [Google Scholar]
  15. You, H.; Zhu, H.; Tang, X. Joint systematic error estimation algorithm for radar and automatic dependent surveillance broadcasting. IET Radar Sonar Navig. 2013, 7, 361–370. [Google Scholar] [CrossRef] [Scilit]
  16. Janczak, D.; Sankowski, M. Data fusion for ballistic targets tracking using least squares. AEU Int. J. Electron. Commun. 2012, 66, 512–519. [Google Scholar] [CrossRef] [Scilit]
  17. Gong, Z.; Duan, P.; Yue, R.; Lv, H. Simulation of data fusion with multi-source heterogeneous measurement elements. J. Ballist. 2014, 26, 19–23. [Google Scholar]
  18. Gong, Z.; Zhou, H.; Guo, W.; Xu, X. Data fusion algorithm for target trajectory determination based on spline function representation. Acta Armamentarii 2014, 35, 120–126. [Google Scholar] [CrossRef]
  19. Li, D.; Liu, X. Trajectory estimation for aircraft with incomplete measurements. J. Natl. Univ. Def. Technol. 2020, 42, 117–124. [Google Scholar]
  20. Lü, J.; Lang, X.; Li, B.; Liu, Y. Review of continuous-time trajectory state estimation research based on B-splines. Robot 2024, 46, 743–752. [Google Scholar] [CrossRef]
  21. Ouyang, W.; Lin, W.; Sun, L. A dynamic and static combined camera-IMU extrinsic calibration method based on continuous-time trajectory estimation. Robot. Auton. Syst. 2025, 186, 104916. [Google Scholar] [CrossRef] [Scilit]
  22. Li, S.; Chen, S.; Li, X.; Zhou, Y.; Wang, S. Accurate and automatic spatiotemporal calibration for multi-modal sensor system based on continuous-time optimization. Inf. Fusion 2025, 120, 103071. [Google Scholar] [CrossRef] [Scilit]
  23. Brunson, B.; Wang, J. Analytical framework for online calibration of sensor systematic errors under the generic multisensor integration strategy. Sensors 2025, 25, 3239. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. Lu, Y.; Zhou, H.; He, Z.; Zhou, X.; Wei, J.; Wang, J. Uncertainty modeling and estimation for multi-sensor target localization systems based on a hybrid semiparametric framework. Measurement 2026, 261, 119980. [Google Scholar] [CrossRef] [Scilit]
  25. Guang, X.; Gao, Y.; Liu, P.; Li, T. IMU data and GPS position information direct fusion based on LSTM. Sensors 2021, 21, 2500. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Cohen, N.; Klein, I. Inertial navigation meets deep learning: A survey of current trends and future directions. Results Eng. 2024, 24, 103565. [Google Scholar] [CrossRef] [Scilit]
  27. Huang, F.; Wang, Z.; Xing, L.; Gao, C. A MEMS IMU gyroscope calibration method based on deep learning. IEEE Trans. Instrum. Meas. 2022, 71, 1–9. [Google Scholar] [CrossRef] [Scilit]
  28. Yuan, K.; Wang, Z.J. A simple self-supervised IMU denoising method for inertial aided navigation. IEEE Robot. Autom. Lett. 2023, 8, 944–950. [Google Scholar] [CrossRef] [Scilit]
  29. Pau, D.P.; Tognocchi, S.; Marcon, M. Learning online MEMS calibration with time-varying and memory-efficient Gaussian neural topologies. Sensors 2025, 25, 3679. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Alikhani, M.; Nikoofard, A. Long-term error compensation in inertial IEKF-based localization with transformer-adaptive noise tuning and IMU missing data handling. Measurement 2026, 257, 118928. [Google Scholar] [CrossRef] [Scilit]
  31. Liu, M.; Wang, W.; Shi, Z.; Xie, L.; Chen, W.; Yan, Y.; Yin, E. Deep learning-based IMU errors compensation with dynamic receptive field mechanism. In Advances in Guidance, Navigation and Control; Yan, L., Duan, H., Deng, Y., Eds.; Springer: Singapore, 2025; Volume 1341, pp. 95–105. [Google Scholar] [CrossRef] [Scilit]
  32. Ye, X.; Xing, W.; Yu, Z.; Chen, J.; Ma, Q. A robust Transformer-based error compensation method for gyroscope of IMUs. J. Field Robot. 2026, 43, 932–948. [Google Scholar] [CrossRef] [Scilit]
  33. Wang, S. Temporal–contextual self-supervised time-series learning for automated fault detection and diagnosis of air handling units in buildings. Build. Environ. 2026, 292, 114300. [Google Scholar] [CrossRef] [Scilit]
  34. Wang, S. Class-aware temporal and contextual contrastive framework for semi-supervised automated fault detection and diagnosis in air handling units. Energy Build. 2026, 358, 117233. [Google Scholar] [CrossRef] [Scilit]
  35. Zhou, H.; Zhang, S.; Peng, J.; Zhang, S.; Li, J.; Xiong, H.; Zhang, W. Informer: Beyond efficient Transformer for long sequence time-series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Virtual, 2–9 February 2021; Volume 35, pp. 11106–11115. [Google Scholar] [CrossRef] [Scilit]
  36. Wu, H.; Xu, J.; Wang, J.; Long, M. Autoformer: Decomposition Transformers with auto-correlation for long-term series forecasting. In Advances in Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2021; Volume 34, pp. 22419–22430. [Google Scholar]
  37. Nie, Y.; Nguyen, N.H.; Sinthong, P.; Kalagnanam, J. A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers. In Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda, 1–5 May 2023; Available online: https://openreview.net/forum?id=Jbdc0vTOcol (accessed on 13 August 2026).
  38. Liu, Y.; Hu, T.; Zhang, H.; Wu, H.; Wang, S.; Ma, L.; Long, M. iTransformer: Inverted Transformers are effective for time series forecasting. In Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria, 7–11 May 2024; Available online: https://openreview.net/forum?id=JePfAI8fah (accessed on 13 August 2026).
  39. Ilbert, R.; Odonnat, A.; Feofanov, V.; Virmaux, A.; Paolo, G.; Palpanas, T.; Redko, I. SAMformer: Unlocking the potential of Transformers in time series forecasting with sharpness-aware minimization and channel-wise attention. In Proceedings of the 41st International Conference on Machine Learning; PMLR: Cambridge, MA, USA, 2024; Volume 235, pp. 20924–20954. [Google Scholar]
  40. Das, A.; Kong, W.; Sen, R.; Zhou, Y. A decoder-only foundation model for time-series forecasting. In Proceedings of the 41st International Conference on Machine Learning; PMLR: Cambridge, MA, USA, 2024; Volume 235, pp. 10148–10167. [Google Scholar]
  41. Liu, Y.; Qin, G.; Shi, Z.; Chen, Z.; Yang, C.; Huang, X.; Wang, J.; Long, M. Sundial: A family of highly capable time series foundation models. In Proceedings of the 42nd International Conference on Machine Learning; PMLR: Cambridge, MA, USA, 2025; Volume 267, pp. 39295–39317. [Google Scholar]
  42. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention is all you need. In Advances in Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2017; Volume 30, pp. 5998–6008. [Google Scholar]
  43. Zhang, Y.; Yan, J. Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting. In Proceedings of the International Conference on Learning Representations, Kigali, Rwanda, 1–5 May 2023. [Google Scholar]
  44. Li, X.R.; Jilkov, V.P. Survey of maneuvering target tracking. Part II: Motion models of ballistic and space targets. IEEE Trans. Aerosp. Electron. Syst. 2010, 46, 96–119. [Google Scholar] [CrossRef] [Scilit]
  45. Beard, R.W.; McLain, T.W. Small Unmanned Aircraft: Theory and Practice; Princeton University Press: Princeton, NJ, USA, 2012. [Google Scholar]
  46. Løw-Hansen, B.; Hann, R.; Gryte, K.; Johansen, T.A.; Deiler, C. Modeling and identification of a small fixed-wing UAV using estimated aerodynamic angles. CEAS Aeronaut. J. 2025, 16, 501–523. [Google Scholar] [CrossRef] [Scilit]
  47. Graves, A.; Schmidhuber, J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 2005, 18, 602–610. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  48. Bai, S.; Kolter, J.Z.; Koltun, V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv 2018, arXiv:1803.01271. [Google Scholar] [CrossRef] [Scilit]
Figure 1. Schematic of the joint observation model for an aerial target observed by a heterogeneous multi-sensor system.
Figure 1. Schematic of the joint observation model for an aerial target observed by a heterogeneous multi-sensor system.
Sensors 26 05199 g001
Figure 2. Geometric decomposition of the systematic error response in the observation space Y .
Figure 2. Geometric decomposition of the systematic error response in the observation space Y .
Sensors 26 05199 g002
Figure 3. Schematic diagram of the ResCompFormer network architecture.
Figure 3. Schematic diagram of the ResCompFormer network architecture.
Sensors 26 05199 g003
Figure 4. Temporal comparison of trajectory reconstruction errors over the complete observation interval.
Figure 4. Temporal comparison of trajectory reconstruction errors over the complete observation interval.
Sensors 26 05199 g004
Table 1. Simulation parameter settings for the UAV trajectory dataset.
Table 1. Simulation parameter settings for the UAV trajectory dataset.
ParameterValue
Number of sensors n11
Total number of observation channels C22
Number of generated trajectories N traj 1000
Sampling interval T s 0.1 s
Simulation duration T max 200 s
Number of sampling instants m2001
Local north-coordinate range [ 5000 , 5000 ] m
Local east-coordinate range [ 5000 , 5000 ] m
Altitude range [ 2000 , 4000 ] m
Flight-speed range [ 35 , 90 ] m/s
Maximum nominal bank angle 35
Range-noise standard deviation σ R 5 m
Range-rate-noise standard deviation σ R ˙ 0.3 m/s
Azimuth-noise standard deviation σ A 5
Elevation-noise standard deviation σ E 5
Table 2. Channel-wise systematic-error type configuration for the heterogeneous multi-sensor system.
Table 2. Channel-wise systematic-error type configuration for the heterogeneous multi-sensor system.
SensorRadar MeasurementsOptical Measurements
R R ˙ A E
S 1 Constant biasNone
S 2 Linear driftNone
S 3 Exponential driftNone
S 4 NoneConstant bias
S 5 NoneLinear drift
S 6 NoneExponential drift
S 7 NoneNone
S 8 Constant biasNone
S 9 Linear driftConstant bias
S 10 Exponential driftLinear drift
S 11 NoneExponential drift
Table 3. Nonzero systematic-error parameters used in the weak-identifiability and compensation experiments.
Table 3. Nonzero systematic-error parameters used in the weak-identifiability and compensation experiments.
Sensor/ChannelParameterFixed Value
(Weak-Identifiability)
Sampling Range
(Compensation)
Constant-bias errors
S 1 / R u 1 , R 0 20 m U ( 30 , 30 ) m
S 4 / R ˙ u 4 , R ˙ 0 1.2 m / s U ( 1.8 , 1.8 ) m / s
S 8 / A u 8 , A 0 20 arcsec U ( 30 , 30 ) arcsec
S 9 / E u 9 , E 0 20 arcsec U ( 30 , 30 ) arcsec
Linear-drift errors
S 2 / R k 2 , R 0.173 m / s U ( 0.260 , 0.260 ) m / s
S 5 / R ˙ k 5 , R ˙ 1.04 × 10 2 m / s 2 U ( 1.56 , 1.56 ) × 10 2 m / s 2
S 9 / A k 9 , A 0.173 arcsec / s U ( 0.260 , 0.260 ) arcsec / s
S 10 / E k 10 , E 0.173 arcsec / s U ( 0.260 , 0.260 ) arcsec / s
Saturating exponential-drift errors
S 3 / R β 3 , R 25.1 m U ( 37.5 , 37.5 ) m
τ 3 , R c 50 s U ( 30 , 70 ) s
S 6 / R ˙ β 6 , R ˙ 1.51 m / s U ( 2.25 , 2.25 ) m / s
τ 6 , R ˙ c 50 s U ( 30 , 70 ) s
S 10 / A β 10 , A 25.1 arcsec U ( 37.5 , 37.5 ) arcsec
τ 10 , A c 50 s U ( 30 , 70 ) s
S 11 / E β 11 , E 25.1 arcsec U ( 37.5 , 37.5 ) arcsec
τ 11 , E c 50 s U ( 30 , 70 ) s
Table 4. Statistical results of the weak-identifiability experiment.
Table 4. Statistical results of the weak-identifiability experiment.
MetricMeanStd.Min.Max.
Noise-only position RMSE (m)2.07380.32641.31863.2147
Joint-estimation position RMSE (m)2.46370.43891.42693.9821
Noise-only velocity RMSE (m/s)0.57390.07180.39870.8264
Joint-estimation velocity RMSE (m/s)0.62160.08350.42130.9278
sNRMSE γ 0.42360.21870.09461.2478
Systematic-response absorption η U (%)26.41870.002426.415326.4221
Table 5. Estimation statistics of representative systematic-error parameters in the weak-identifiability experiment.
Table 5. Estimation statistics of representative systematic-error parameters in the weak-identifiability experiment.
Sensor/
Channel
Parameter
(Unit)
True
Value
Estimated Value
Mean ± Std.
Mean Absolute
Normalized Error
S 1 / R u 1 , R 0 (m)20.0000 20.0186 ± 0.4217 0.0168
S 2 / R k 2 , R (m/s)0.1730 0.172314 ± 0.011528 0.0533
S 3 / R β 3 , R (m)25.1000 27.1846 ± 7.2368 0.2395
S 3 / R τ 3 , R c (s)50.0000 56.4827 ± 14.8365 0.2864
S 4 / R ˙ u 4 , R ˙ 0 (m/s)1.2000 1.19891 ± 0.02314 0.0154
S 5 / R ˙ k 5 , R ˙ (m/s2)0.0104 0.010431 ± 0.000676 0.0519
S 6 / R ˙ β 6 , R ˙ (m/s) 1.5100 1.64218 ± 0.45173 0.2488
S 6 / R ˙ τ 6 , R ˙ c (s)50.0000 57.1364 ± 16.2478 0.3176
S 8 / A u 8 , A 0 (arcsec)20.0000 20.0127 ± 0.5086 0.0203
S 9 / A k 9 , A (arcsec/s)0.1730 0.173384 ± 0.013742 0.0634
S 10 / A β 10 , A (arcsec)25.1000 28.5364 ± 9.3187 0.3161
S 10 / A τ 10 , A c (s)50.0000 59.2741 ± 18.6352 0.3897
S 11 / E β 11 , E (arcsec) 25.1000 28.2471 ± 9.0476 0.3048
S 11 / E τ 11 , E c (s)50.0000 58.8163 ± 17.9246 0.3715
Table 6. Overall comparison of trajectory reconstruction and systematic-error estimation performance.
Table 6. Overall comparison of trajectory reconstruction and systematic-error estimation performance.
MethodPosition RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U
M1 2.4976 ± 0.4128 0.6283 ± 0.0936 5.4550 ± 0.8641
M2 1.8077 ± 0.3055 0.4093 ± 0.0714 5.4448 ± 0.8217
M3 1.3064 ± 0.2219 0.3658 ± 0.0603 5.4487 ± 0.7965
M4 1.2383 ± 0.1986 0.3278 ± 0.0517 5.2811 ± 0.7338
M5 1.1757 ± 0.2142 0.3293 ± 0.0548 8.5554 ± 1.2473
M6 1.0973 ± 0.1895 0.3073 ± 0.0496 7.2753 ± 1.0642
M7 1.0190 ± 0.1708 0.2854 ± 0.0442 6.0965 ± 0.8831
M8 0.9144 ± 0.1469 0.2561 ± 0.0387 4.8797 ± 0.6924
M9 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
M10 1.1546 ± 0.1863 0.3097 ± 0.0491 5.0124 ± 0.7095
M11 1.0829 ± 0.1761 0.2916 ± 0.0462 4.7318 ± 0.6742
Note: Bold values indicate the best performance for each evaluation metric.
Table 7. Range-normalized parameter-error metrics of the model-driven methods.
Table 7. Range-normalized parameter-error metrics of the model-driven methods.
Method/Setting pNRMSE γ pBias γ pMAE γ
M1 0.356 0.012 0.181
M2 0.321 0.008 0.164
M3 0.294 0.006 0.151
M4 0.268 0.005 0.137
M10 0.243 0.004 0.124
M11 0.216 0.003 0.109
Note: Bold values indicate the lowest pNRMSE and pMAE among the compared methods.
Table 8. Robustness under parameter-distribution shift, functional–form mismatch, and randomized channel–error assignment.
Table 8. Robustness under parameter-distribution shift, functional–form mismatch, and randomized channel–error assignment.
Test ConditionMethodPosition RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U
Matched referenceM4 1.2383 ± 0.1986 0.3278 ± 0.0517 5.2811 ± 0.7338
Matched referenceM9 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
Parameter shiftM4 1.3146 ± 0.2237 0.3459 ± 0.0578 5.5173 ± 0.8062
Parameter shiftM9 0.8612 ± 0.1398 0.2367 ± 0.0374 4.0186 ± 0.5927
Piecewise mismatchM4 1.5634 ± 0.2789 0.4046 ± 0.0708 6.4728 ± 0.9725
Piecewise mismatchM9 0.9179 ± 0.1573 0.2497 ± 0.0408 4.2145 ± 0.6538
Random assignmentM9 Fixed→Random 1.0189 ± 0.1815 0.2784 ± 0.0473 4.7265 ± 0.7421
Random assignmentM9 Random→Random 0.8297 ± 0.1372 0.2281 ± 0.0358 3.8619 ± 0.5654
Note: Bold values indicate the best performance under each test condition.
Table 9. Sensitivity of the trained ResCompFormer to dropout of previously known sensors.
Table 9. Sensitivity of the trained ResCompFormer to dropout of previously known sensors.
Dropped SensorsPosition RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U , avail
0/11 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
1/11 0.8048 ± 0.1315 0.2251 ± 0.0348 3.6816 ± 0.5427
2/11 0.8847 ± 0.1492 0.2463 ± 0.0398 3.9158 ± 0.6021
3/11 0.9856 ± 0.1736 0.2738 ± 0.0462 4.2879 ± 0.6814
Note: Bold values indicate the best performance for each evaluation metric across the sensor-dropout settings.
Table 10. Ablation results of ResCompFormer on the test set.
Table 10. Ablation results of ResCompFormer on the test set.
VariantPosition RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U
RCF-Full 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
RCF-NoSE 0.8259 ± 0.1276 0.2292 ± 0.0342 3.9440 ± 0.5668
RCF-NoMTE 0.8562 ± 0.1328 0.2377 ± 0.0354 4.1572 ± 0.5975
RCF-NoTL 0.8941 ± 0.1407 0.2483 ± 0.0369 3.7663 ± 0.5416
RCF-Enc 0.9395 ± 0.1494 0.2589 ± 0.0388 4.4414 ± 0.6387
Note: Bold values indicate the best performance among the full model and its ablated variants.
Table 11. Sensitivity to residual normalization on the matched-condition test set.
Table 11. Sensitivity to residual normalization on the matched-condition test set.
NormalizationPosition RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U
RCF-NoiseStd (baseline) 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
RCF-RMS 0.7869 ± 0.1236 0.2178 ± 0.0324 3.6826 ± 0.5261
Note: Bold values indicate the best performance among the compared normalization schemes.
Table 12. Decoder -strategy comparison and start-token-length sensitivity on the matched-condition test set.
Table 12. Decoder -strategy comparison and start-token-length sensitivity on the matched-condition test set.
Variant L start Position RMSE
(m)
Velocity RMSE
(m/s)
nRMSE U
RCF-AR 0.8346 ± 0.1379 0.2316 ± 0.0360 3.9264 ± 0.5812
RCF-NAR100 0.7918 ± 0.1267 0.2201 ± 0.0331 3.7216 ± 0.5407
RCF-NAR (baseline)200 0.7577 ± 0.1184 0.2122 ± 0.0315 3.5531 ± 0.5089
RCF-NAR400 0.7705 ± 0.1219 0.2155 ± 0.0322 3.6108 ± 0.5168
Note: Bold values indicate the best performance among the tested decoder configurations and start-token lengths.
Table 13. Computational efficiency, model size, and trajectory reconstruction accuracy of the compared methods. The total runtime denotes the end-to-end processing time for one complete trajectory.
Table 13. Computational efficiency, model size, and trajectory reconstruction accuracy of the compared methods. The total runtime denotes the end-to-end processing time for one complete trajectory.
MethodTrainable
Parameters (M)
Network
Prediction (ms)
N outer Total Runtime
(s/trajectory)
Position RMSE
(m)
M113.8422.4976
M219.6371.8077
M3112.4161.3064
M4115.7831.2383
M52.16193.9127.8641.1757
M61.3463.6847.2131.0973
M73.17323.4378.6471.0190
M84.19143.2189.2840.9144
M927.57453.02610.5360.7577
M103.14648.6721.1546
M113.42863.4181.0829
RCF-AR27.4758623.18332.7560.8346
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, S.; Wang, J.; Peng, B.; He, Z.; Zhou, X. A Residual-Driven ResCompFormer for Multi-Sensor Systematic Error Compensation and Target Trajectory Reconstruction. Sensors 2026, 26, 5199. https://doi.org/10.3390/s26165199

AMA Style

Wang S, Wang J, Peng B, He Z, Zhou X. A Residual-Driven ResCompFormer for Multi-Sensor Systematic Error Compensation and Target Trajectory Reconstruction. Sensors. 2026; 26(16):5199. https://doi.org/10.3390/s26165199

Chicago/Turabian Style

Wang, Sihua, Jiongqi Wang, Bingxin Peng, Zhangming He, and Xuanying Zhou. 2026. "A Residual-Driven ResCompFormer for Multi-Sensor Systematic Error Compensation and Target Trajectory Reconstruction" Sensors 26, no. 16: 5199. https://doi.org/10.3390/s26165199

APA Style

Wang, S., Wang, J., Peng, B., He, Z., & Zhou, X. (2026). A Residual-Driven ResCompFormer for Multi-Sensor Systematic Error Compensation and Target Trajectory Reconstruction. Sensors, 26(16), 5199. https://doi.org/10.3390/s26165199

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop