This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).
A new filter named the maximum likelihood-based iterated divided difference filter (MLIDDF) is developed to improve the low state estimation accuracy of nonlinear state estimation due to large initial estimation errors and nonlinearity of measurement equations. The MLIDDF algorithm is derivative-free and implemented only by calculating the functional evaluations. The MLIDDF algorithm involves the use of the iteration measurement update and the current measurement, and the iteration termination criterion based on maximum likelihood is introduced in the measurement update step, so the MLIDDF is guaranteed to produce a sequence estimate that moves up the maximum likelihood surface. In a simulation, its performance is compared against that of the unscented Kalman filter (UKF), divided difference filter (DDF), iterated unscented Kalman filter (IUKF) and iterated divided difference filter (IDDF) both using a traditional iteration strategy. Simulation results demonstrate that the accumulated mean-square root error for the MLIDDF algorithm in position is reduced by 63% compared to that of UKF and DDF algorithms, and by 7% compared to that of IUKF and IDDF algorithms. The new algorithm thus has better state estimation accuracy and a fast convergence rate.
nonlinear state estimationdivided difference filtermaximum likelihood surfacetarget trackingIntroduction
The problem of estimating the state of a nonlinear stochastic system from noisy measurement data has been the subject of considerable research interest during the past few years. Up to now the extended Kalman filter (EKF) has unquestionably been the dominating state estimation technique [1,2]. The EKF linearizes both the nonlinear process and the measurement dynamics with a first-order Taylor series expansion about the current state estimate. However, its accuracy depends heavily on the severity of nonlinearities. The EKF may introduce large errors and even give a divergent estimate when the nonlinearities become severe [3,4]. To improve the estimation accuracy, the second-order EKF proposed retains the Taylor series expansion up to the second term. The second–order EKF generally improves estimation accuracy, but at the expense of an increased computational burden [5]. Another attempt to improve the performance of the EKF involves the use of an iterative measurement update; the resulting algorithm is called the Iterated Extended Kalman filter (IEKF) [6]. The basic idea of IEKF is to linearize the measurement model around the updated state rather than the predicted state. This is achieved iteratively, and it involves the use of the current measurement. The IEKF has been proven to be more accurate on the condition that the state estimate is close enough to the true value, however, this is rarely the case in practice [7]. It was pointed out in [8] that the sequence of iterations generated by the IEKF and that generated by the Gauss-Newton method were identical, thus globally convergence was guaranteed. However, the Gauss-Newton method does not ensure that it goes up the likelihood surface [9,10]. Furthermore, EKF and IEKF require Jacobians, and the second-order KF requires Jacobians and Hessians. Calculation of Jacobians and Hessians is often numerically unstable and computationally intensive. In some system, the Jacobians and Hessians do not exit, which limits the applications of EKF, second-order EKF and IEKF.
Recently, there has been development in derivative-free state estimators. The finite difference has been used in the Kalman filter framework and the resulting filter is referred to as the finite difference filter (FDF) [11]. The FDF uses the first-order difference to approximate the derivative of the nonlinear function; it may introduce large state estimation errors due to a high nonlinearity, similar to the EKF. The unscented Kalman filter (UKF) proposed in [12,13] uses a minimal set of deterministically chosen sample points to capture the mean and covariance of a Gaussian density. When propagated through a nonlinear function, these points capture the true mean and covariance up to a second-order of the nonlinear function. However, the parameters used in the UKF are required to tune finely in order to prevent the propagation of non-positive definite covariance matrix for a state vector's dimension higher than three. Another Gaussian filter, named the divided difference filter (DDF) was introduced in [14] using multidimensional Stirling's interpolation formula. It is shown in [15] that the UKF and DDF algorithms are commonly referred to as sigma point filters due to the properties of deterministic sampling and weighted statistical estimation [16], but the covariance obtained in the DDF is more accurate than that in the UKF. The iterated UKF with the variable step (IUKF-VS) in [10] proposed improved the accuracy of state estimation but its runtime was large due to its computation of the sigma points. Lastly, a relatively new technique called the particle filter (PF) uses a set of randomly chosen samples with associated weights to approximate the posterior density [17] and its variants are presented in [18]. The large number of samples required often makes the use of PF computationally expensive, and the performance of PF is crucially dependent on the selection of the proposal distribution. Table 1 lists the pro and cons of the above filters.
The DDF also shows its weakness in the state estimation due to the large initial error and high nonlinearity in the application for state estimation of maneuvering target in the air-traffic control and ballistic re-entry target. Emboldened by the superiority of DDF, the basic idea of the IEKF and the iteration termination condition based on maximum likelihood, we propose a new filter named the maximum likelihood based iterated divided difference Kalman filter (MLIDDF). The performance of the state estimation for MLIDDF is greatly improved when involving the use of the iteration measurement update in the MLIDDF and the use of the current measurement. The remainder of this paper is organized as follows: in Section 2, we develop the maximum likelihood surface based iterated divided difference Kalman filter (MLIDDF). Section 3 presents the applications of the MLIDDF to state estimation for maneuvering targets in air-traffic control and ballistic target re-entry applications and discuss the simulation results. Finally, Section 4 concludes the paper and presents our outlook on future work.
Development of Likelihood Surface Based Iterated Divided Difference FilterDivided Difference Filter
Consider the nonlinear function:
y=f(x)
Assuming that the random variable x ∈ ℝnx has Gaussian density with mean x̄ and covariance Px. The following linear transformation of x is introduced:
z=Sx−1x
The transformation matrix Sx is selected as a square Cholesky factor of the covariance matrix Px such that
Px=SxSxT, so the elements of z become mutually uncorrelated [14]. And the function f̃ is defined by:
y=f(Sxz)=f∼(z)
The multidimensional Stirling interpolation formula of Equation (3) about z̄ up to second-order terms is given by:
y≈f∼(z¯)+D∼Δzf∼+12!D∼Δz2f∼
The divided difference operators D̃Δzf̃,
D∼Δz2f∼ are defined as:
D∼Δzf∼=1l(∑j=1nxΔzjμjδj)f∼(z¯)D∼Δz2f∼=1l2(∑j=1nxΔzj2δj2+∑j=1nx∑i=1i≠jnxΔzjΔzi(μjδj)(μiδi))f∼(z¯)where Δz ≜ z - Z̄ and Δzj is the j-th element of Δz. l denotes a selected interval length, the optimal setting of l is selected as
3 under the assumption that the estimation error are Gaussian and unbiased.
The partial operators μ and δ are defined as:
μjf(z¯)=12[f∼(z¯+l2ej)+f∼(z¯−l2ej)]δjf(z¯)=f∼(z¯+l2ej)−f∼(z¯−l2ej)where ej is the unit column vector.
We can obtain the approximate mean, covariance and cross-covariance of y using Equation (4):
y¯=E[y]≈l2−nxl2f(x¯)+12l2∑j=1nx[f(x¯+lsx,j)+f(x¯−lsx,j)]Pyy=E[(y−y¯)(y−y¯)T]≈14l2∑j=1nx[f(x¯+lsx,j)−f(x¯−lsx,j)]×[f(x¯+lsx,j)−f(x¯−lsx,j)]T+l2−14l4∑j=1nx[f(x¯+lsx,j)+f(x¯−lsx,j)−2f(x¯)]×[f(x¯+lsx,j)+f(x¯−lsx,j)−2f(x¯)]TPxy=E[(x−x¯)(y−y¯)T]≈12l∑j=1nxsx,j(f(x¯+lsx,j)−f(x¯−lsx,j))Twhere sx,j is j-th column of Sx.
Consider the state estimation problem of a nonlinear dynamics system with additive noise, the nx-dimensional state vector xk of the system evolves according to the nonlinear stochastic difference equation:
xk=f(xk−1)+wk−1and the measurement equation is given as:
zk=h(xk)+vkwk−1 and vk are assumed i.i.d. and independent of current and past states, wk−1 ∼
(0, Qk−1), vk ∼
(0, Rk).
Suppose the state distribution at k-1 time instant is xk−1∼
(x̂k−1, Pk−1), and a square Cholesky factor of Pk−1 is Ŝx,k−1. The divided difference filter (DDF) obtained with Equations (9)–(11) can be described as follows:
Step 1. Time update
Calculate matrices containing the first- and second- divided difference on the estimated state x̂k−1 at k-1 time:
Sxx^,k(1)={12l[f(x^k−1+ls^x,j)−f(x^k−1−ls^x,j)]}Sxx^,k(2)={l2−12l2[f(x^k−1+ls^x,j)+f(x^k−1−ls^x,j)−2f(x^k−1)]}
Evaluate the predicted state and square root of corresponding covariance:
x¯k=l2−nxl2f(x^k−1)+12l2∑j=1nx[f(x^k−1+ls^x,j)+f(x^k−1−ls^x,j)]S¯x,k=Tria([Sxx^,k(1)Sw,k−1Sxx^,k(2)])ŝx,j is j-th column of Ŝx,k−1. Tria() is denoted as a general triagularization algorithm and Sw,k−1 denotes a square-root factor of Qk−1 such that
Qk−1=Sw,k−1Sw,k−1T.
Step 2. Measurement update
Calculate matrices containing the first- and second-divided difference on the predicted state x̄k:
Szx¯,k(1)={12l[h(x¯k+ls¯x,j)−h(x¯k−ls¯x,j)]}Szx¯,k(2)={l2−12l2[h(x¯k+ls¯x,j)+h(x¯k−ls¯x,j)−2h(x¯k)]}where s̄x,j is the j-th column of S̄x,k.
Evaluate the predicted measurement, square root of innovation covariance and cross-covariance:
z¯k=l2−nxl2h(x¯k)+12l2∑j=1nx[h(x¯k+ls¯x,j)+h(x¯k−ls¯x,j)]Szz,k=Tria([Szx¯,k(1)Sv,kSzx¯,k(2)])Pxz,k=S¯x,k(Szx¯,k(1))There Sv,k denotes a square root of Rk such that
Rk=Sv,kSv,kT.
Evaluate the gain, state estimation and square root of corresponding covariance at k time:
Kk=(Pxz,,k/Szz,kT)/Szz,kx^k=x¯k+Kk(zk−z¯k)S^x,k=Tria([[(S¯x,k−KkSzx¯,k(1))KkSv,kKkSzx¯,k(2)]])here, the symbol “/” represents the matrix right divide operator.
Refining the Measurement Update Based on Divided Difference
Consider x̄k and current measurement zk as realization of independent random vectors with multivariate normal distributions, e.g., x̄k ∼
(xk, P̄k) and zk ∼
(h(xk), Rk). For convenience, the two vectors are formed to a single augmented one Z = [zkx̄k]T. According to the independent assumption, we have:
Z∼N(g(xk),Q∼)
Here:
g(xk)=[h(x),xk]T,Q∼=[Rk00P¯k]
The update measurement problem becomes the one that computing the optimal state estimation and corresponding covariance given Z, g and Q̃.
Defining the objective function:
f(ξ)=12‖r(ξ)‖2where r(ξ) = S(Z − g(ξ)), and r(ξ) is the second-order differentiable. Then the above update measurement becomes clearly a non-linear least squares problem.
Assuming the i-iterate is
x^k(i+1), we can obtain the following equation [8]:
x^k(i+1)=x¯k+Kk(i)(zk−h(x^k(i))+Hk(i)(x¯k−x^k(i)))where
Kk(i)=P¯kHk(i)T(Hk(i)TP¯kHk(i)+Rk)−1.
We know the sequence of iterates generated by the IEKF and that generated by the Gauss-Newton method were identical, thus globally convergent was guaranteed. The initial state x̄k is included in the measurement update, the value of x̄k has a direct and large effect on the final state estimation. When the measurement model fully observes the state, the estimated state
x^k(i) is more approximate to the true state than the predicted state x̄k [7]. Substituting x̄k by
x^k(i) into Equation (29), hence, the following iterative formula is obtained:
xk(i+1)=xk(i)+Kk(i)(zk−h(xk(i)))
Compared to Equation (29), the Equation (30) is simpler, and the two equations are identical when there is a single iteration.
Now we consider the gain:
Kk(i)=P¯kHk(i)T(Hk(i)TP¯kHk(i)+Rk)−1where the terms
Hk(i)TP¯kHk(i)+Rk and
P¯kHk(i)T are approximate innovation covariance and cross-covariance obtained by linearizing the measurement equation:
Pzz,k(i)=Hk(i)P¯k(Hk(i))T+RkPxz,k(i)=P¯k(Hk(i))T
The terms of Equations (32) and (33) are achieved by expanding the measurement Equation (13) up to a first-order Taylor term so that the linearized error is introduced due to the high-order truncated terms. As for the highly nonlinear measurement equation, the accuracy for state estimation is decreased if the linearized error is only propagated in the Equation (30). To decrease the propagated error, we can recalculate Equations (18)–(22) to obtain the terms
Pzz(i),
Pxz(i) in the following way:
Szx,k(1)(i)={12l[h(x^k(i)+ls^x,j(i))−h(x^k(i)−ls^x,j(i))]}Szx,k(2)(i)={l2−12l2[h(x^k(i)+ls^x,j(i))+h(x^k(i)−ls^x,j(i))−2h(x^k(i))]}Szz,k(i)=Tria([Szx,k(1)(i)Sv,kSzx,k(2)(i)])Pzz,k(i)=Szz,k(i)Szz,k(i)TPxz,k(i)=Sk(i)Szx,k(1)(i)where
Sk(i) is a square Cholesky factor of the covariance
Pk(i).
Hence, we can obtain the following iterative formula:
x^k(i+1)=xk(i)+Pxz(i)(Pzz(i))−1[zk−h(x^k(i))]
Maximum Likelihood Based Iteration Termination Criterion
In the measurement update step of the IEKF algorithm, the inequality
‖x^k(i+1)−x^k(i)‖≤ε is used as the criterion to terminate the iteration procedure, where ε is the predetermined threshold. The threshold ε is crucial to successfully using the IEKF algorithm, but selecting a proper value of ε is difficult [10]. The sequence of iterations generated according to the above termination condition has the property of global convergence; however, it is not guaranteed to move up the likelihood surface, so an iteration termination criterion based on maximum likelihood surface is introduced.
Consider
x^k(i) and zk as the realization of independent random vectors with multivariate normal distributions, i.e.,
x^k(i)∼N(xk,Pk(i)), zk ∼
(h(xk),Rk). The likelihood function of the two vectors xk and zk is defined as:
Λ(xk,yk)=const•exp{−0.5[(xk−x^k(i))TPk(−i)(xk−x^k(i))+(zk−h(xk))TRk−1(zk−h(xk))]}where
Pk(−i)=(Pk(i))−1.
Meanwhile, the likelihood surface is defined as follows:
J(xk)=(x^k(i)−xk)TPk(−i)(x^k(i)−xk)+(zk−h(xk))TRk−1(zk−h(xk))
We know that the solution that maximizes the likelihood function is equivalent to minimizing the cost function J(xk). The optimal value of J(xk) is difficult to obtain, but the following inequality holds:
J(x^k(i+1))<J(x^k(i))
We say that
J(x^k(i+1)) is close to the maximum likelihood surface than
J(x^k(i+1)), equivalently,
x^k(i+1) has a more accurate approximation than
x^k(i) to the minimum value of J(xk) [10]. Extending Equation (42) and using
Pk(i)=Sk(i)Sk(i)T, we immediately obtain the following inequality:
(x∼k(i+1))T(Sk(i)Sk(i)T)−1x∼k(i+1)+(z∼k(i+1))TRk−1z∼k(i+1)<(z∼k(i))TRk−1z∼k(i)where
x∼k(i+1) and
z∼k(i+1) and are defined as:
x∼k(i+1)=x^k(i+1)−x^k(i)z∼k(i+1)=zk−h(x^k(i+1))
The sequence generated is guaranteed to go up the likelihood surface using Equation (43) as the criterion to iteration termination.
Maximum Likelihood Based Iterated Divided Difference Filter
We have now arrived at the central issue of this paper, namely, the maximum likelihood based iterated divided difference filter. Enlightened by the development of IEKF and the superiority of DDF, we can derive the maximum likelihood based iterated divided difference filter (MLIDDF) which involves the use of the iteration measurement update and the current measurement. But in view of the potential problems exhibited by the IEKF, we shall refine the covariance and cross-covariance based on divided difference and use the termination criterion which guarantees the sequence obtained moves up the maximum likelihood surface. The MLIDDF is described as follows:
Step 1. Time update
Evaluate the predicted state x̄k and square Cholesky factor S̄k of the corresponding covariance P̄k using the Equations (14)–(17).
Step 2. Measurement update
Let
x^k(0)=x¯k and
Sk(0)=S¯k. Suppose that the i-th iterates are
x^k(i) and
Sk(i).
Evaluate the first- and second-order difference matrices using Equation (34) and (35).
Evaluate the square root of innovation covariance and cross-covariance:
Szz,k(i)=Tria([Szx,k(1)(i)Sv,kSzx,k(2)(i)])Pxz,k(i)=Sk(i)Szx,k(1)(i)
Evaluate the gain:
Kk(i)=Pxz(i)/Szz,k(i)T/Szz,k(i)
Evaluate the state and the square root of corresponding covariance:
x^k(i+1)=x^k(i)+Kk(i)[zk−h(x^k(i))]Sk(i+1)=Tria([(S¯x,k−Kk(i)Szx,k(1)(i))Kk(i)SvKk(i)Szx,k(2)(i)])where
s^x,j(i) is the j-th column of
Sk(i).
Step 3. If the following inequality holds:
(x∼k(i+1))T(Sk(i)Sk(i)T)−1x∼k(i+1)+(z∼k(i+1))TRk−1z∼k(i+1)<(z∼k(i))TRk−1z∼k(i)
The iteration returns to Step 2; otherwise continue to Step 4.
x∼k(i+1),
z∼k(i+1) are defined in the Equations (44) and (45).
Step 4. If the inequality is not satisfied or if i is too large (i > Nmax), and the ultimate state estimation and square root of corresponding covariance at k time instant are:
x^k=x^k(Nmax)Sk=Sk(Nmax)
The MLIDDF algorithm has the virtues of free-derivative and better numerical stability. The measurement update of MLIDDF algorithm is transformed to a nonlinear least-square problem; the optimum state estimation and covariance are solved using Gauss-Newton method, so the MLIDDF algorithm has the same global convergence as the Gauss-Newton method. Moreover, the iteration termination condition that makes the sequence move up the maximum likelihood surface is used in the measurement update process.
Simulation and Analysis
In this section, we reported the experimental results obtained by applying the MLIDDF to the nonlinear state estimation of a maneuvering target in an air-traffic control scenario and a ballistic target re-entry scenario. To demonstrate the performance of the MLIDDF algorithm we compared its performance against the UKF, DDF, and the iterated UKF (IUKF) and iterated DDF (IDDF), both using a traditional iteration strategy.
Maneuvering Target Tracking in the Air-Traffic Control Scenario
We consider a typical air-traffic control scenario, where an aircraft executes a maneuvering turn in a horizontal plane at a constant, but unknown turn rate Ω. The kinematics of the turning motion can be modeled by the following nonlinear process equation [2,19]:
xk=(1sinΩTΩ0−1−cosΩTΩ00cosΩT0−sinΩT001−cosΩTΩ1sinΩTΩ00sinΩT0cosΩT000001)xk−1+wk−1where the state of the aircraft x = [x ẋ y ẏ Ω]; x and y denote positions, and ẋ and ẏ denote velocities in the x and y directions, respectively; T is the time-interval between two consecutive measurements;
The process nose wk−1∼
(0, Q) with a nonsingular covariance:
Q=(q1π000q1π000q2T),π=(T3/3T2/2T2/2T)
The parameters q1 and q2 are related to process noise intensities. A radar is fixed at the origin of the place and equipped to measure the range, r and bearing, θ. Hence, the measurement equation is written:
(rkθk)=(xk2+yk2tan−1(yk/xk))+vkwhere the measurement noise vk ∼
(0, R) and
R=diag([σr2σθ2]).
The parameters used in this simulation were the same as those in [19]. To tracking the maneuvering aircraft we use the proposed MLIDDF algorithm and compare its performance against the DDF. We use the root-mean square error (RMSE) of the position, velocity and turn rate to compare the performances of two nonlinear filters. For a fair comparison, we make 250 independent Monte Carlo runs. The RMSE in position at time k is defined as:
RMSEp(k)=1N∑i=1N(xk(i)−x^k(i))2+(yk(i)−y^k(i))2where
(xk(i),yk(i)) and
(x^k(i),y^k(i)) are the true and estimated positions at the i-th Monte Carlo run. Similarly to RMSE in position, we may also write formulas of RMSE in velocity and turn rate.
Owing to the fact that the filters is sensitive to initial state estimation, Figures 1–3 show the RMSEs in position, velocity and turn rate, respectively for DDF and MLIDDF in an interval of 50–100 s. As can be seen in Figures 1–3, the MLIDDF significantly outperforms the DDF.
In order to analyze the impact of iteration numbers on performance of the MLIDDF algorithm, the MLIDDFs with various iteration numbers are applied to position estimation of maneuvering target. Figure 4 shows the RMSEs of DDF and MLIDDFs with various numbers in position. From Figure 4, the RMSE in position for the MLIDDF with iteration number 2 begins to decrease largely comparable to that of DDF. The RMSE in position for MLIDDF with iteration number 5 significantly reduce, and the MLIDDF algorithm has very fast convergence rate. The RMSE of the position for MLIDDF decreases slowly when the iteration number is greater than 8; the reason is that the sequence generated has basically reached the maximum likelihood surface when the iteration termination condition is met.
State Estimation of Reentry Ballistic TargetSimulation Scene
The relative location of the ballistic target re-entry (BTR) and the radar are shown in Figure 5. The inertial coordinate system (ECI-CS) OxIyIzI shown in Figure 5 is a right-handed system with the origin O at the Earth's center, axis OxI pointing in the vernal equinox direction, axis OzI pointing in the direction of the North Pole N. Its fundamental plane OxIyI coincides with the Earth's equatorial plane.
Assume that the radar is situated at the surface of the Earth and considering the orthogonal coordinate reference system named East-North-Up coordinates system (ENU-CS) Osxyz has its origin at the location of the radar. In this system, z is directed along the local vertical and x and y lie in a local horizontal plane, with x pointing east and y pointing north. Assuming that the Earth is spherical and non-rotating and the forces acting on the target are only gravity and drag [20], we can derive the following state equation according to the kinematics of the ballistic re-entry object in the reentry phase in ENU-CS:
xk=Φxk−1+Gψ(xk−1)+wk−1where xk = [xk ẋk yk ẏk zk żk βk]T is the state of ballistic target re-entry, and:
Φ=[ϕ0000ϕ0000ϕ00001],ϕ=[1T01]G=[τ000τ000τ000],τ=[T2/2T]ψ(xk−1)=[−ρ(hk−1)2βk−1Vk−1x˙k−1−μxk−1rk−13−ρ(hk−1)2βk−1Vk−1y˙k−1−μyk−1rk−13−ρ(hk−1)2βk−1Vk−1z˙k−1−μ(zk−1+Re)rk−13]where
{rk−1=xk−12+yk−12+(zk−1+Re)2Vk−1=x˙k−12+y˙k−12+z˙k−12hk−1=rk−1−ReT is the time interval between radar measurements, β is the ballistic coefficient (kg/m2), μ and Re are the Earth's gravitational constant and average Earth radius, respectively. Below 90 km at height, the air density ρ(h) is approximately modeled as an exponentially decaying function of height, ρ(h) = c1e−c2h (c1, c2 are constant, specifically, c1 = 1.227, c2 = 1.093 × 10−4 for h < 9,144 m, and c1 = 1.754, c2 = 1.49 × 10−4 for h ≥ 9,144 m) [21].
Process noise wk is assumed to be white noise with zero mean; its covariance is approximately modeled as [2]:
Qk=[q1θ10000q1θ10000q1θ10000q2T],θ=[T3/3T2/2T2/2T]where q1 (in m2/s3) and q2 (in kg2/m4s) are the intensity of noise.
According to relative geometry, the measurement equation in the ENU-CS is described as:
zk=h(xk)+vkhere zk = [Rk Ek Ak]T, and:
Rk=xk2+yk2+zk2+vREk=tan−1zk/xk2+yk2+vEAk=tan−1yk/xk+vA
The measurement noise vk is assumed to be white noise with zero mean and covariance:
Nk=diag([σR2σE2σA2])where σR, σE, σA, are the error standard deviations of range, elevation and azimuth, respectively. It is independent of the process noise wk and initial state x0.
Numerical Results and Analysis
The parameters used in simulation were: T = 0.1 s, q1 = 5 m2/s3, q2 = 5 kg2/m4s. The initial position and magnitude of the velocity: x0 = 232 km, y0 = 232 km, z0 = 90 km and v0 = 3,000 m/s, and the initial elevation and azimuth angle: E0 = 7π/6 and A0 = π/4. The ballistic coefficient was selected as β = 4,000 kg/m2. The error standard deviations of the measurements were selected as σR = 100 m, σE = 0.017 rad, and σA = 0.017 rad. A threshold ε = 10 was set in the IUKF and IDDF, and a maximum iteration number Nmax = 8 was predetermined.
From the above parameters given, we can obtain the initial true state:
x0=[232km−1837m/s232km−1837m/s90km−1500m/s4000kg/m2]and we select the corresponding covariance as: P0 = diag[1002 502 1002 502 1002 502 2002].
To compare the performance of the various filter algorithms, we also use RMSE in the position, velocity and ballistic coefficient. The position RMSE at k time of the ballistic target re-entry is defined as:
RMSEp(k)=1N∑i=1N((xk(i)−x^k(i))2+(yk(i)−y^k(i))2+(zk(i)−z^k(i))2)where
(xk(i),yk(i),zk(i)) and
(x^k(i),y^k(i),z^k(i)) are the true and estimated position at the i-th Monte Carlo run, N is the Monte Carlo runs. Similarity to the RMSE in position we may also write formulas of the RMSE in velocity and ballistic coefficient.
Figures 6–8 shows the position, velocity and ballistic coefficient RMSEs, respectively, for the various filters in an interval of 15–58 s. The initial state estimate x̂0 is chosen randomly from x̂0 ∼
(x0, P0) in each run. All the filters are initialized with the same condition in each run. We make 100 independent Monte Carlo runs.
From Figure 6 we can see that the position RMSE of the MLIDDF is much less than the UKF and DDF because of the use of the current measurement in the step of the iteration measurement update of the MLIDDF, and is less than the IUKF and IDDF owing to involving the proposed iteration strategy, so the estimates provided by the MLIDDF are markedly better than those of the UKF and DDF algorithms, and are better than those of IUKF and IDDF algorithms. The MLIDDF also shows a significant improvement over the other filters in the estimation of the velocity, as evidenced by Figure 7.
As to the estimation of the ballistic coefficient, in the Figure 8, we can see that there is no improvement in the RMSE in the initial interval of the observation period (t < 35 s) because there is no effective information about it, while in the remaining period (35 s < t < 58 s) the ballistic coefficient RMSE is decreased because the effective information about the ballistic coefficient from the latest measurement is fully used. Especially, Figure 8 illustrates that toward the end of the trajectory the estimates provided by the MLIDDF are markedly better than those of the UKF, DDF, IUKF and IDDF algorithms.
Meanwhile, we observe from Figures 6–8 that the UKF and DDF have almost the same performance in the problem and the performance of IUKF and IDDF algorithms are almost identical.
For further comparison of performance for the various filters, the average accumulated position mean-square root error (AMSRE) is defined as follows:
AMSREp=1N∑i=1N[1M∑k=1M[(xk(i)−x^k(i))2+(yk(i)−y^k(i))2+(zk(i)−z^k(i))2]]where M is the total number of measurement data points. The formulas of the velocity and ballistic coefficient AMSREs can be written similar to the AMSREp. The position, velocity and ballistic coefficient AMSREs for the various filters are listed in Table 2. Table 3 lists the runtimes of the various filters.
From Table 2, it is seen that the position AMSRE for the MLIDDF algorithm is reduced by 62% compared to the UKF and DDF, by 7% compared to IUKF and IDDF. The velocity AMSRE for the MLIDDF algorithm is reduced by 23% compared to the UKF and DDF algorithms. The ballistic coefficient AMSRE for the MLIDDF algorithm is reduced by 7% compared to the UKF and DDF algorithms. Although the ballistic coefficient AMSRE for the MLIDDF algorithm has no significant reduction, we can see that it is reduced significantly compared to the UKF, DDF, IUKF and IDDF algorithms, hence, the MLIDDF is preferred over the other filters in the light of position, velocity and ballistic coefficient AMSREs.
From Table 3, we can see the runtime of MLIDDF is less than that of the IUKF algorithm, and is more than those of UKF, DDF, and IDDF algorithms, so the accuracy of the MLIDDF algorithm is improved at the cost of an increased computational burden. Meanwhile, we can observe the AMSREs for the UKF and DDF in position, velocity and ballistic coefficient are almost identical, and the AMSREs of the IUKF and IDDF are almost the same. Therefore, on the basis of the simulation results presented in Figures 6–8 and Table 2, one can draw the conclusion that the MLIDDF yields a superior performance over the other filters.
Conclusions and Future Work
In this study, we provide the maximum likelihood based iterated divided difference filter which inherits the virtues of the divided difference filter and contains the iteration process in the measurement update step. The sequence obtained is guaranteed to move up the likelihood surface using the iteration termination condition based on the maximum likelihood surface. The maximum likelihood based iterated divided difference is implemented easily and is derivative-free. We apply the new filter to state estimation for a ballistic target re-entry scenario and compare its performance against the unscented Kalman filter, divided difference filter, iterated unscented Kalman filter and iterated divided difference filter with the traditional termination criteria. Simulation results demonstrate that the maximum likelihood-based iterated divided difference is much more effective than the other filters. The maximum likelihood-based iterated divided difference greatly improves the performance of state estimation and has a shorter convergence time.
Future work may focus on the applications of the maximum likelihood iteration divided difference filter to remove the outliers which is a serious deviation from the sample and caused by blink and subjective eye movement in video nystagmus signal samples of pilot candidates.
This work was partially supported by Grants No. 30871220 from National Natural Science Foundation of China and No. 2007AA010305 from Subprojects of National 863 Key Projects.
ReferencesGrewalM.S.AndrewsA.P.Kalman Filtering: Theory and Practice Using Matlab3rd ed.John Wiley & Sons, IncHoboken, NJ, USA2008169201Bar-ShalomY.LiX.R.KirubarajanT.Estimation with Applications to Tracking and NavigationJohn Wiley &Son, IncHoboken, NJ, USA2001371420JazwinskiA.H.Stochastic Process and Filtering TheoryAcademic PressWaltham, MA, USA1970332365JulierS.J.UhlmannJ.K.Unscented filtering and nonlinear estimationProc. IEEE20049240142210.1109/JPROC.2003.823141AthansM.WishnerR.P.BertoliniA.Suboptimal state estimation for continuous-time nonlinear system from discrete noisy measurementsIEEE Trans. Autom. Control19681350451410.1109/TAC.1968.1098986GelbA.Applied Optimal EstimationThe MIT PressCambridge, MA, USA1974180228LefebvreT.BruyninckxH.de SchutterJ.Kalman filters for non-linear systems: A comparison of performanceInt. J. Control20047763965310.1080/00207170410001704998BellB.M.CatheyF.W.The iterated Kalman filter update as a Gauss-Newton methodIEEE Trans. Autom. Control19933829429710.1109/9.250476JohnstonL.A.KrishnamurthyV.Derivation of a sawtooth iterated extended Kalman smoother via the AECM algorithmIEEE Trans. Signal Proc.2001491899190910.1109/78.942619ZhanR.WanJ.Iterated unscented Kalman filter for passive target trackingIEEE Trans. Aerosp. Electron. Syst.2007431155116310.1109/TAES.2007.4383605ScheiT.S.A finite-difference method for linearization in nonlinear estimation algorithmsModeling Identif. Control19981914115210.4173/mic.1998.3.2JulierS.UhlmannJ.Durrant-WhyteH.F.A new method for the nonlinear transformation of means and covariances in filters and estimationsIEEE Trans. Autom. Control20004547748210.1109/9.847726JulierS.J.UhlmannJ.K.Durrant-WhyteH.F.A New Approach for Filtering Nonlinear SystemsProceedings of the American Control ConferenceSeattle, WA, USA199516281632NørgaardM.PoulsenN.K.RavnO.New developments in state estimation for nonlinear systemsAutomatica2000361627163810.1016/S0005-1098(00)00089-3NørgaardM.PoulsenN.K.RavnO.Advances in Derivative-Free State Estimation for Nonlinear SystemsTechnical ReportTechnical University of DenmarkLyngby, Denmark2000van der MerweR.WanE.Sigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models2004Available online: http://en.scientificcommons.org/42640909 (accessed on 26 June 2012)GordonN.SalmondD.J.SmithA.F.M.Novel approach to nonlinear non-Gaussian Bayesian state estimationIEEE Proc.1993140107113ArulampalamM.S.MaskellS.GordonN.ClappT.A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian trackingIEEE Trans. Signal Proc.20025017418810.1109/78.978374ArasaratnamI.HaykinS.Cubature Kalman filtersIEEE Trans. Autom. Control2009541254126910.1109/TAC.2009.2019800LiX.R.JilkovV.P.A survey of maneuvering target tracking-part II: Ballistic target modelsProc. SPIE20014473559581FarinaA.RisticB.BenvenutiD.Tracking a ballistic target: Comparison of several nonlinear filtersIEEE Trans. Aerosp. Electron. Syst.20023885486710.1109/TAES.2002.1039404Figures and Tables
RMSE in position for DDF and MLIDDF.
RMSE in velocity for DDF and MLIDDF.
RMSE in turn rate for DDF and MLIDDF.
RMSE in position for MLIDDFs with various iterate numbers (MLIDDF1 with iterate numbers 2, MLIDDF2 with 5, MLIDDF3 with 8, MLIDDF4 with 10).