Abstract
To estimate the systems with one-step randomly delayed measurement and time-correlated heavy-tailed measurement noises, on the basis of robust Student’s t based unscented filter (RSTUF), an improved Student’s t based unscented filter (ISTUF) is proposed. Referring to the measurement differencing method, a reformed measurement model was built. Then, by augmenting the system state vector, the conditional probability distribution of the measurement noise with respect to delayed measurement was taken into consideration. Based on the reformed measurement model and the augment state vector, a novel estimator was designed to solve the one-step randomly delayed problem. Maneuvering target tracking systems were used for simulation. Compared with unscented Kalman filter (UKF) or RSTUF, ISTUF had higher accuracy.
1. Introduction
In recent years, as a state estimation tool, a Kalman filter (KF) has been successfully applied in the target tracking system. However, in practice, the Gaussian assumption of KF is an over-simplification. The unknown maneuverings or outliers will produce non-Gaussian noises. To estimate systems with non-Gaussian noises, Huber-based Gaussian filters (HGFs) have been proposed. This kind of filter obtains the optimal solution by minimizing a Huber cost function, such as a Huber-based divided difference filter [1], Huber-based unscented Kalman filter [2], Huber-based cubature Kalman filter [3]. However, the influence function does not redescend, which may affect the accuracy of HGFs. The maximum correntropy criterion based Gaussian filters (MCCGFs) are also common methods for non-Gaussian noise [4,5,6]. However, the development of estimation error covariance matrix of MCCGFs lacks a theoretical basis, and the estimation accuracy may be degraded [7]. Particle filter (PF) can also deal with non-Gaussian noise and the estimation accuracy is higher than the filters in a GF framework [8,9]. However, the particle degeneracy problem and the high computational cost restrict the application of PF in practical engineering. Moreover, the shadowing filter is a novel method to estimate the nonlinear system, in recent years [10,11,12], and it needs to obtain all the observations simultaneously to estimate the trajectory. The random time-delayed measurement may affect the accuracy of the shadowing filter. The Student’s t distribution (STD) is a generalized Gaussian distribution with a heavier tail. As a result, it is more suitable to describe heavy-tailed noises than Gaussian distribution. Many works about Student’s t based filters (STFs) are proposed [13,14,15] as well.
The STD can only describe the distribution of noises. To describe the time-correlation of noises, two approaches have been proposed. One assumes that the noise is Gaussian and time-correlated noise with known covariance, and augments the original state with the noise to adapt the standard KF [16]. In Reference [17], the algorithm has been improved to reduce the computational complexity. The other assumes that the noise is a linear recursive model, and uses a measurement differencing approach to eliminate the time-correlated part of the noise [18,19].
In addition, a randomly delayed measurement may occur, when the information is transferred to the system in practical application. To solve the randomly delayed problem, Hermoso-Carazo [20] proposed an unscented filter for two-step randomly delayed measurement. Wang [21] proposed a filter based on one-step delayed measurement, which expanded the state vector with measurement noises to contain the correlation information between the noise and the one-step delayed measurement state. Based on Gaussian mixture approximation, Gu [22] designed a filter to deal with the d-step state-delay problem. By state augmentation and projection theory, an optimal filter was designed for systems with one-step delayed measurement [23]. However, all the algorithms above mentioned are based on GF, and cannot handle the heavy-tailed noises.
Summarizing the above discussions, the objective of the work was to estimate the states of the systems with one-step delayed measurement and time-correlated heavy-tailed noises accurately. Firstly, we used the linear recursive model and STD to construct the measurement noise, and the Bernoulli random variables to describe the one-step delayed measurement. Secondly, based on the measurement differencing approach, the time-correlated part of noises was eliminated. Then, the state space was expanded, and the measurement noise was regarded as a new state. Finally, the unscented transform (UT) was applied to compute the Student’s t weighted integral.
2. Preliminaries and Problem Statement
2.1. Problem Statement
Consider the following classic discrete stochastic system with time-correlated measurement noise:
where is the state vector; is the measurement vector; , , and are known transition matrices; , and are the heavy-tailed process noise vector, the time-correlated heavy-tailed measurement noise vector respectively. The heavy-tailed noises are caused by system outliers, which are modeled as STD:
where is the Student’s t probability density function (PDF); is the mean value; is the scale matrix; is the dof parameter.
The initial state is also assumed to satisfy STD, and the PDF is as follows:
Furthermore, , and are assumed to be mutually independent. According to Reference [13], for STD, the conditional estimating vector and the corresponding covariance matrix can be approximated as:
where denotes the estimating error.
The one-step delayed measurement is described as:
where is a sequence of Bernoulli random variables with a value of 0 or 1, i.e.,
Here, is the probability of delay occurrence at time .
Remark 1.
Referring to Reference [13], for a vectorwith PDF, the corresponding covariance matrix satisfies, i.e.,.
2.2. Problem Statement
In Reference [13], a Student’s t based filter framework is designed. Firstly, there are two assumptions as follows:
Assumption 1.
The joint PDFsatisfies STD, i.e.,
Assumption 2.
The joint PDFsatisfies STD, i.e.,
The framework is shown:
1. Time prediction
where is the transpose operation, and are the one-step predicted vector and the corresponding covariance matrix, respectively.
2. Measurement update
where is the inverse operation, and are the estimating state and the corresponding covariance matrix, respectively, and are the predicting measurement and its covariance matrix, respectively, is the cross-covariance matrix of the state and measurement vectors. The formulas of them are as follows:
In practice, the time-correlation of the measurement noises often originates from a time-correlated noisy work environment or the dependence on the states. Otherwise, the STD is suitable to describe the heavy-tailed noises. The goal of the paper was to design an estimator for systems with Student’s t distributional time-correlated noises.
3. Main Results
The measurement noise is no longer time irrelevant. To solve the problem, according to Reference [24], the measurement differencing method was used. We defined the equivalent measurement and Equations (1)–(3) can be converted to the following form:
where , , and .
After transformation, has been rewritten as an equivalent measurement noise , which consists of Student’s t distributional noises and .
Theorem 1.
Denoting thatis the covariance of, andis the cross-covariance ofand, we can derive:
Proof.
Firstly, the expectation of is . As and are independent, . Then, we have
According to Remark 1, we can derive Equation (24).
Likewise, the cross-covariance in Equation (25) can be derived as follows:
Moreover, Equation (9) can be transformed into
From Equation (28), we find that the computation of also depends on the computation of . Therefore, according to Reference [21], we need to augment the state vector as follows:
□
Theorem 2.
Givenand, the posterior estimation ofand the corresponding covariance matrixare derived by
whereis the filtering gain of the measurement noise, and
Proof.
First, Equation (40) is derived by the definition of , and according to the definition of , we have
Then, the definition of and is as follows:
Using the Student’s t integral to approximate with the known and , we can obtain Equations (37) and (38).
Second, according to Equation (10), can be written as follows:
Then, by substituting Equation (45) to the definition of and , we can get Equations (35) and (36).
Finally, and can be derived a by similar method as and by Equation (30) and (31). □
Theorem 3.
Givenand, the posterior estimation of the augmented stateand the covarianceare given as follows:
where
whereis the filtering gain of states, and
Proof.
First, , , , , and can be obtained by definition. Then, substituting Equation (28) to the definition of , we can easily obtain Equation (51).
Second, according to the definition, is given as:
Then, according to the definition, can be obtained as:
Under the Student’s t approximation of with the known and , we can get Equation (56).
Finally, using Equations (30) and (48), we can get
Then, we can easily get Equation (52) by substituting Equation (59) into the definition of . □
Remark 2.
By augmenting the state with measurement noise, the following terms appear from Equations (38) and (56), i.e.,
The Equations (60) and (61) take the correlation between and into consideration. Therefore, the accuracy of the filtering algorithm for the one-step randomly delayed system will be improved.
4. Improved Student’s t-Based Unscented Filter
4.1. The Calculation of the Student’s t Integral
To implement ISTUF, we need the calculate the following weighted integrals:
Referring to Reference [13], we used UT to approximately compute the Student’s t weighted integrals. By UT, can be approximated as:
where denotes the Kronecker delta function, and are the sigma points and corresponding weights. The detail form is as follows:
where is a free parameter, is the column vector of a unit matrix.
Then, by substituting Equation (63) into Equation (62), we can obtain
4.2. Improved Student’s t-Based Unscented Filter
Assuming and are known, based on theorems 1–2, the calculation flow is as follows.
1. Initialization
2. Sigma points construction
According to Equation (64), we construct sigma points . Then, compute the propagated sigma points
3. Prediction
Equations (53) and (54) can be approximated as
Then, construct predicting sigma points and compute the propagated sigma points:
4. Update
Equations (37)–(38), (40)–(41), and (55)–(56) can be calculated as follows:
At time , by substituting Equations (71)–(76) into Equations (30)–(36) and (48)–(52), we can easily obtain and in Equations (46) and (47).
Remark 3.
The difference between ISTUF and RSTUF in Reference [8] can be summarized in Table 1.
Table 1.
The difference between improved Student’s t based unscented filter (ISTUF)and RSTUF.
5. Simulation
5.1. Case 1
In this section, two simulation examples were used to test the performance of ISTUF, one was a constant-turn (CT) target tracking system and the other was a Singer acceleration model-based target tracking system. The results were compared to improved UKF (IUKF) in Reference [21] and RSTUF in Reference [13].
The CT target tracking system was in two dimensional space [13]. The detailed model is as follows:
where ; and are the position values; and denote the velocity values; is the turn rate; and is the sampling interval of measurements, and . The values of and are given as:
where and . The initialization is given as:
The probability of was set as . The maneuvering target was estimated for by IUKF, RSTUF and ISTUF. The root mean square errors (RMSEs) of the estimation results were used as the testing standard of estimated accuracy, which were computed by 100 Monte-Carlo (MC) runs.
The comparison between the true trajectory and estimated trajectories is shown in Figure 1. It is obvious that IUKF failed to track the target and even diverged in some points. The estimated trajectory of ISTUF was more convergent to the true trajectory than that of RSTUF.
Figure 1.
Comparison of the trajectories.
The RMSEs of estimated results are shown in Figure 2, Figure 3 and Figure 4. From the figures, it could be seen that the RMSE of IUKF was much larger than that of RSTUF and ISTUF. Especially, the position RMSE of IUKF diverges in most points. The RMSEs of RSTUF and ISTUF were similar during the beginning 4 s, and then the RMSE of ISTUF is less than RSTUF.
Figure 2.
RMSE of estimating position.
Figure 3.
RMSE of estimating velocity.
Figure 4.
RMSE of estimating turn rate.
As the time-correlated heavy-tailed noises were against the assumption of the GF, IUKF cannot track the target well and the RMSEs diverge. As time goes on, the occurrence of the one-step random delay affects the estimating accuracy of RSTUF, so RSTUF cannot perform as well as the proposed ISTUF.
The averaged RMSE (ARMSE) and time-consuming of the three filters are listed in Table 2. From Table 2, we can observe that the ARMSE of ISTUF was less than IUKF and RSTUF, and the consumption time of calculation. of the three filters was similar. In summary, ISTUF was able to provide much accurate estimation with little increase in computational cost.
Table 2.
The ARMSE and time consuming of the three filters.
Remark 4.
From Figure 2, Figure 3 and Figure 4, it can be seen that the error values of RSTUF and ISTUF were similar because the probability of time-delayed measurement was small and the effect of it was not large enough. Moreover, the RSTUF was also robust to heavy-tailed noise. As a result, the two methods had a similar performance.
Remark 5.
From Table 2, we can find the estimation accuracy is higher than that in Reference [8] because the scale of noise affected the estimation accuracy of filters, and the scale of noise in this paper was less than that in Reference [8]. As a result, the estimation accuracy was higher than that in [8].
5.2. Case 2
The form of Singer acceleration model [25] is as follows:
where , , , and denote the same definition as in case 1. and are the acceleration values; The transition matrices and are given as follows:
where and the maneuver frequency . The initialization is selected as:
The variance matrix , and .
In case 2, the probability of was set as , i.e., the probability of the time-delayed measurement increased. Moreover, the noises have been enlarged. The comparison between the true trajectory and estimated trajectories is shown in Figure 5, and it is clear that the estimated trajectory of ISTUF was closest to the real trajectory. The trajectory of IUKF has been divergent, because of the effect of heavy-tailed noise.
Figure 5.
Comparison of the trajectories.
The RMSEs of the estimating results are shown in Figure 6, Figure 7 and Figure 8. The figures indicate that the RMSE of IUKF had been divergent, i.e., the enlarged heavy-tailed noise seriously affected the performance of filters under GF framework. The RMSE of RSTUF was also larger than that of ISTUF obviously. As the probability of time-delayed measurement had increased, the effect of the phenomenon was aggravated.
Figure 6.
RMSE of estimating position.
Figure 7.
RMSE of estimating velocity.
Figure 8.
RMSE of estimating acceleration.
The ARMSE of the three filters is listed in Table 3. It is clear that the ARMSE of ISTUF was less than IUKF and RSTUF, and the ARMSE of IUKF was too large. As a result, ISTUF was more suitable for a target tracking system with time-delayed measurement and time-correlated heavy-tailed noises.
Table 3.
The ARMSE of the three filters.
6. Conclusions
In the paper, a novel filter ISTUF has been designed for systems with one-step delayed measurement, and time-correlated heavy-tailed noises. The linear recursive model with STD was first used to construct the time-correlated heavy-tailed noises. Furthermore, augmenting the state with measurement noise can deal with the correlation problem caused by one-step delayed, and UT was applied to calculate the Student’s t weighted integral accurately. The simulation results illustrated that ISTUF reached a higher estimating accuracy than IUKF and RSTUF, and the computational cost of ISTUF is similar to IUKF and RSTUF.
Author Contributions
Conceptualization, X.W. and K.M.; methodology, X.W.; software, X.W.; validation, X.W.; formal analysis, X.W.; investigation, X.W.; resources, K.M.; data curation, X.W.; writing—original draft preparation, X.W.; writing—review and editing, K.M.; visualization, X.W.; supervision, K.M.; project administration, K.M.; funding acquisition, K.M.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Karlgaard, C.D.; Schaub, H. Huber-Based Divided Difference Filtering. J. Guid. Control Dyn. 2012, 30, 885–891. [Google Scholar] [CrossRef]
- Chang, L.; Hu, B.; Chang, G.; Li, A. Huber-based novel robust unscented Kalman filter. IET Sci. Meas. Technol. 2012, 6, 502–509. [Google Scholar] [CrossRef]
- Chien-Hao, T.; Lin, S.F.; Dah-Jing, J. Robust Huber-Based Cubature Kalman Filter for GPS Navigation Processing. J. Navig. 2016, 70, 527–546. [Google Scholar]
- Deng, Z.; Yin, L.; Huo, B.; Xia, Y. Adaptive Robust Unscented Kalman Filter via Fading Factor and Maximum Correntropy Criterion. Sensors 2018, 18, 2406. [Google Scholar] [CrossRef]
- Wang, Y.; Zheng, W.; Sun, S.; Li, L. Robust Information Filter Based on Maximum Correntropy Criterion. J. Guid. Control Dyn. 2016, 39, 1–6. [Google Scholar] [CrossRef]
- Chen, B.; Liu, X.; Zhao, H.; Principe, J.C. Maximum correntropy Kalman filter. Automatica 2017, 76, 70–77. [Google Scholar] [CrossRef]
- Huang, Y.; Zhang, Y.; Li, N.; Wu, Z.; Chambers, J.A. A novel Robust student’s t-based Kalman filter. IEEE Trans. Aerosp. Electron. Syst. 2017, 53, 1545–1554. [Google Scholar] [CrossRef]
- Gustafsson, F.; Gunnarsson, F.; Bergman, N.; Forssell, U.; Jansson, J.; Karlsson, R.; Nordlund, P.-J. Particle Filters for Positioning, Navigation and Tracking. IEEE Trans. Signal Process. 2002, 50, 425–437. [Google Scholar] [CrossRef]
- Míguez, J. Analysis of selection methods for cost-reference particle filtering with applications to maneuvering target tracking and dynamic optimization. Digit. Signal Process. 2007, 17, 787–807. [Google Scholar] [CrossRef]
- Zaitouny, A.; Stemler, T.; Algar, S.D. Optimal Shadowing Filter for a Positioning and Tracking Methodology with Limited Information. Sensors 2019, 19, 931. [Google Scholar] [CrossRef] [PubMed]
- Zaitouny, A.A.; Stemler, T.; Judd, K. Tracking Rigid Bodies Using Only Position Data: A Shadowing Filter Approach based on Newtonian Dynamics. Digit. Signal Process. 2017, 67, 81–90. [Google Scholar] [CrossRef]
- Judd, K. Tracking An Object with Unknown Accelerations Using A Shadowing Filter. arXiv 2015, arXiv:1502.07743. [Google Scholar]
- Huang, Y.; Zhang, Y.; Li, N.; Chambers, J. Robust Student’st based nonlinear filter and smoother. IEEE Trans. Aerosp. Electron. Syst. 2016, 52, 2586–2596. [Google Scholar] [CrossRef]
- Roth, M.; Özkan, E.; Gustafsson, F. A Student’s t filter for heavy tailed process and measurement noise. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Brighton, UK, 12–17 May 2019; pp. 5770–5774. [Google Scholar]
- Huang, Y.; Zhang, Y. Robust student’s t-based stochastic cubature filter for nonlinear systems with heavy-tailed process and measurement noises. IEEE Access 2017, 5, 7964–7974. [Google Scholar] [CrossRef]
- Bryson, A.; Johansen, D. Linear filtering for time-varying systems using measurements containing colored noise. IEEE Trans. Autom. Control 1965, 10, 4–10. [Google Scholar] [CrossRef]
- Liu, W. State estimation of discrete-time systems with arbitrarily correlated noises. Int. J. Adapt. Control Signal Process. 2014, 28, 949–970. [Google Scholar] [CrossRef]
- Bryson, A., Jr.; Henrikson, L. Estimation using sampled data containing sequentially correlated noise. J. Spacecr. Rocket. 1968, 5, 662–665. [Google Scholar] [CrossRef]
- Petovello, M.G.; O’Keefe, K.; Lachapelle, G.; Cannon, M.E. Consideration of time-correlated errors in a Kalman filter applicable to GNSS. J. Geod. 2009, 83, 51–56. [Google Scholar] [CrossRef]
- Hermoso-Carazo, A.; Linares-Pérez, J. Unscented filtering algorithm using two-step randomly delayed observations in nonlinear systems. Appl. Math. Model. 2009, 33, 3705–3717. [Google Scholar] [CrossRef]
- Wang, X.; Liang, Y.; Pan, Q.; Zhao, C. Gaussian filter for nonlinear systems with one-step randomly delayed measurements. Automatica 2013, 49, 976–986. [Google Scholar] [CrossRef]
- Gu, Y.; Li, J.; Feng, D. State filtering and parameter estimation for linear systems with d-step state-delay. IET Signal Process. 2014, 8, 639–646. [Google Scholar] [CrossRef]
- Li, M.; Zhang, L.; Chu, D. Optimal Estimation for Systems with Multiplicative Noises, Random Delays and Multiple Packet Dropouts. IET Signal Process. 2016, 10, 880–887. [Google Scholar] [CrossRef]
- Geng, H.; Wang, Z.; Cheng, Y.; Alsaadi, F.E.; Dobaie, A.M. State estimation under non-Gaussian Lévy and time-correlated additive sensor noises: A modified Tobit Kalman filtering approach. Signal Process. 2019, 154, 120–128. [Google Scholar] [CrossRef]
- Ding, Z.; Liu, Y.; Liu, J.; Yu, K.; You, Y.; Jing, P.; He, Y. Adaptive Interacting Multiple Model Algorithm Based on Information-Weighted Consensus for Maneuvering Target Tracking. Sensors 2018, 18, 2012. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).