Next Article in Journal
Influence of Various Types of Office Desk Chair for Dynamizing the Operation Assessed by Raster Stereography
Previous Article in Journal
Environmental Footprint Assessment of a Cleanup at Hypothetical Contaminated Site
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Sensor Fusion Positioning Method Based on Batch Inverse Covariance Intersection and IMM

1
School of Electronic Engineering, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Beijing 100876, China
2
School of Artificial Intelligence, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Beijing 100876, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(11), 4908; https://doi.org/10.3390/app11114908
Submission received: 26 April 2021 / Revised: 25 May 2021 / Accepted: 25 May 2021 / Published: 26 May 2021
(This article belongs to the Section Electrical, Electronics and Communications Engineering)

Abstract

:
For mass application positioning demands, the current single positioning sensor cannot provide reliable and accurate positioning. Herein, we present batch inverse covariance intersection (BICI) and BICI with interacting multiple model (BICI-IMM) multi-sensor fusion positioning methods, which are based on the batch form of the sequential inverse covariance intersection (SICI) fusion method. Meanwhile, it is proved that the BICI is robust. Compared with SICI, BICI-IMM reduces estimation error variance of the motion model and has less conservativeness. The BICI-IMM algorithm improves the accuracy of local filtering by interacting with multiple models and realizes global fusion estimation based on BICI. The validity of the BICI and BICI-IMM algorithm are demonstrated by two simulations and experiments in the open and semi-open scenes, and its positioning accuracy relations are shown. In addition, it is demonstrated that the BICI-IMM algorithm can improve the positioning accuracy in the actual scenes.

1. Introduction

With the advent of the era of Internet of everything, indoor and outdoor positioning information with high accuracy, high reliability, large capacity and low delay has became indispensable, which is vital for intelligent robots, unmanned driving and other unmanned platforms. The sensor positioning algorithm usually adopts time of arrival (ToA), difference of arrival (TDoA), angle of arrival (AoA), direction of arrival (DoA), frequency difference of arrival (FDoA), time of flight (ToF) and received signal strength indication (RSSI) [1,2,3,4]. The sensor measurement for positioning comes from global navigation satellite systems (GNSS), Wi-Fi [5], RFID [6], Bluetooth [7], vision [8], UWB [9], etc. GNSS has been widely applied in various scenes; unfortunately, it is difficult to position in indoor and canyon environments due to its inherent fragility [10]. Although many other sensors are available, they have are defects such as a small coverage and high cost. Therefore, a single sensor is hard to position with high precision, high reliability and availability in challenging scenarios.
Compared with a single sensor, multiple-sensor fusion can improve coverage, estimation accuracy and reliability because it combines the advantages of each information source. Multi-sensor fusion algorithms usually adopt Kalman filtering, support vector machine (SVM), Bayesian inference, Dempster–Shafer theory of evidence and artificial neural networks (ANN) [11]. The Kalman filter is frequently chosen for real-time fusion positioning in robotic applications because of its high computational efficiency. Multi-sensor fusion methods are mainly divided into centralized and distributed methods, where the difference is whether the original measurements are capable of direct fusion. The former can obtain a global optimal state estimation by expanded measurement equations and covariance matrix, but there are some drawbacks such as its computational complexity, fault tolerance and flexibility. The latter accesses a global optimal estimation from local filters. Distributed fusion methods include diagonal matrix, scalar weighted fusion and minimum covariance determinant (MCD) [12,13], etc., which need covariance among local filters. However, it is difficult to obtain covariance in the actual scene. For the multi-sensor fusion estimation problem with an unknown covariance, Julier and Uhlmann proposed a covariance intersection (CI) method, which uses the conservative error variance upper bound to avoid covariance calculation [14]. The accuracy of fusion positioning algorithms of batch covariance intersection (BCI) [15], sequential covariance intersection (SCI) [16] and parallel covariance intersection (PCI) [17] is limited because of the more conservative CI method. Sijs et al. showed an ellipsoid intersection (EI) algorithm, which used a common error to model the unknown correlation. The estimation accuracy of EI is better than CI [18]. However, EI has a worse robustness of fusion estimation because of its inconsistent estimation [19,20]. Noack et al. changed the parameters of EI to ensure consistency, and proposed an inverse covariance intersection (ICI) method [21]. Based on the ICI method, Chen et al. designed a sequential inverse covariance intersection (SICI) fusion method for packet dropouts, which solved the fusion problem with unknown covariances and had good estimation performance [22]. Tang et al. showed an information geometric fusion method [23], which adopted the information center of local posterior densities and had a high computational burden.
The current research on fusion positioning with an unknown motion model mainly focuses on model uncertainty and has precise noise variance. However, sensor noise variance is time-varying and unknown due to the signal blocking, electromagnetic interference, working temperature, etc., in actual scenes. Moreover, the limited number of models and uncertain noise variance reduce positioning reliability and accuracy in actual scenes. The multiple models’ estimation (MME) algorithm is a research hotspot at present. However, it is hard to realize real-time positioning, because the rapid growth in computational complexity over time. The interacting multiple model (IMM) [24] has the same positioning accuracy and computational complexity as second-order and first-order pseudo Bayesian, respectively. It makes real-time high-precision reliable positioning feasible. Nevertheless, existing IMM filters [25,26] and variants [27,28] require process and measurement variance which cannot be accurately obtained in the actual scene [29].
The BICI-IMM multi-sensor positioning algorithm is presented for unknown covariance among local filters, uncertain time-varying noise variance and unknown motion models in challenging environments. The estimation accuracy is increased by the IMM algorithm. Meanwhile, we deduced the batch form of the ICI method which had less conservativeness. Then, the accuracy of global estimation is improved by BICI. The positioning accuracy of the BICI and BICI-IMM multi-sensor fusion positioning algorithms is demonstrated by simulations and experiments in open and semi-open areas.

2. Local Filter

Considering the multi-sensor fusion positioning discrete system with uncertain time-varying noise variance, this is defined as
x k + 1 = F k x k + B k w k
z k h = C k h x k + v k h , h = 1 , 2 , , H
where k R represents discrete time, x k R n represents the state of fusion positioning system. F k , B k and C k h represent the time-varying state transition matrix, input noise matrix and observation matrix with known appropriate dimensions, respectively. H is the number of sensors. z k h represents the measurement of h-th sensor at time k. w k and v k h are model and observation noise of the h-th sensor, respectively. w k and v k h have unknown noise variance Q ¯ k = E ( w k w k T ) and R ¯ k h = E ( v k h ( v k h ) T ) , respectively, and the conservative upper bound of Q ¯ k and R ¯ k h are Q k and R k h , respectively.
Q ¯ k Q k , R ¯ k h R k h , h = 1 , 2 , , H k R .
Based on the minimax estimation [30,31] and linear unbiased minimum variance rule, the local filters under time-varying noise variance one-step predictors are given by [31]
x ^ k h = ψ k h x k 1 h + K k h z k h , h = 1 , 2 , , H
where the filtering gains K k h are
K k h = P k | k 1 h ( C k h ) T [ C k h P k | k 1 h ( C k h ) T + R k h ] 1
the estimation error covariance matrices are
P k + 1 | k h = C k h P k | k 1 h ( C k h ) T + B k Q k B k T
P k | k h = [ I K k h C k h ] P k | k 1 h
where ψ k h = [ I K k h C k h ] F k , I represents the identity matrix. The local estimation variance matrix satisfies the Lyapunov equation to ensure the robustness [32]
P k + 1 | k + 1 h = ψ k + 1 h P k | k h ( ψ k + 1 h ) T + [ I K k + 1 h C k + 1 h ] B k Q k B k T [ I K k + 1 h C k + 1 h ] T + K k + 1 h R k + 1 h ( K k + 1 h ) T .
The key issue of multi-sensor fusion positioning algorithm with an unknown motion model, unknown covariance and uncertain time-varying noise variance is how to realize the track fusion efficiency of local filters and design an accurate smoother.

3. Fusion Algorithms Considering Accuracy and Robustness

Different from [33], the multi-sensor fusion positioning method with unknown covariance is more practical, because covariance is inessential. The fusion method with unknown covariance is mainly based on the CI method, which is a conservative global estimation method for local filters. Although it can guarantee a robust estimation, the accuracy of positioning is poor.
Inspired by SCI and BCI, we deduced the batch form of the ICI fusion positioning algorithm. Then the BICI fusion positioning algorithm is proposed and the robustness is certified. Meanwhile, the robustness of SICI is also verified. The BICI and SICI algorithms are divided into two phases: local filtering and global fusion. In the local filtering phase, the local optimal result x ^ k h and variance P k h of each sensor are obtained by a local filter in Section 2. Then, the global fusion is employed for the local result x ^ k h and P k h , which is described in detail as follows.

3.1. SICI Fusion Algorithm

The SICI multi-sensor fusion algorithm is realized by the ( H 1) two-sensor ICI method. The structure of the SICI fusion algorithm is displayed in Figure 1 as follows.
The SICI multi-sensor fusion estimator is given by [22]
x ^ k S I C I ( h ) = K k S I C I ( h ) x ^ k S I C I ( h 1 ) + I K k S I C I ( h ) x ^ k ( h + 1 ) P k | k S I C I ( h ) 1 = P k | k S I C I ( h 1 ) 1 + P k | k ( h + 1 ) 1
ω h P k | k S I C I ( h 1 ) + ( 1 ω h ) P k | k ( h + 1 ) 1
x ^ k S I C I = x ^ k S I C I ( H 1 )
where x ^ k ( h + 1 ) are local filters. The initial values are
x ^ k S I C I ( 0 ) = x ^ k ( 1 ) , P k | k S I C I ( 0 ) 1 = P k | k ( 1 ) 1
where the filtering gains K k S I C I ( h ) are obtained by
K k S I C I ( h ) = P k | k S I C I ( h ) P k | k S I C I ( h 1 ) 1 ω h ω h P k | k S I C I ( h 1 ) + ( 1 ω h ) P k | k ( h + 1 ) 1
the optimal ω h minimizes trace of covariance matrix P k | k S I C I ( h ) as
o b j e c t i v e : min 0 ω h 1 t r ( P k | k S I C I ( h ) )
where t r ( · ) represents the matrix traces. It is necessary to solve the H 1 one-dimensional optimization problems in one filtering cycle for SICI. The optimization problem can be solved by the MATLAB f m i n b n d function [16].
Theorem 1.
SICI fusion algorithm x ^ k S I C I can be represented as the batch form of a weighted mean
x ^ k S I C I = h θ h ( H ) x ^ k h
h θ h ( H ) = I
where x ^ k h are local filters. Weighting coefficients θ h ( H ) can be obtained recursively as
θ h ( l ) = K l 1 θ h ( l 1 ) , h = 1 , 2 , , l 1
θ h ( l ) = I K l 1 , l = 2 , 3 , , H
with initial values are
θ 1 ( 2 ) = K 1 , θ 2 ( 2 ) = I K 1
where K l 1 and ω l 1 can be calculated from Equations (13) and (14), respectively.
Proof of Theorem 1.
We chose mathematical induction to prove the Theorem 1.
Step 1: For H = 2 , according to Equations (9)–(12), we can obtain
x ^ k S I C I ( 2 ) = K 1 x ^ k ( 1 ) + ( I K 1 ) x ^ k ( 2 ) .
Therefore, when the number of sensors is 2, Theorem 1 holds.
Step 2: Assuming that Theorem 1 holds when the number of sensors is H 1 , then
x ^ k S I C I ( H 1 ) = h = 1 H 1 θ h ( H 1 ) x ^ k h .
We have to prove that Theorem 1 holds when the number of sensors is H. The fusion of the x ^ k S I C I ( H 1 ) and x ^ k ( H ) can be determined by
x ^ k S I C I = K H 1 x ^ k S I C I ( H 1 ) + ( I K H 1 ) x ^ k H = K H 1 h = 1 H 1 θ h ( H 1 ) x ^ k h + ( I K H 1 ) x ^ k H = h = 1 H 1 θ h ( H ) x ^ k h + θ h ( H ) x ^ k H = h = 1 H θ h ( H ) x ^ k h .
It can be seen that when the number of sensors is H, Theorem 1 still holds. The proof is completed. □

3.2. BICI Fusion Algorithm

The batch forms of ICI method and the BICI multi-sensor fusion positioning algorithm are proposed based on two-sensor ICI. Meanwhile, the noise variance upper bound of error variance matrix is derived to prove the robustness of BICI. The structure of the BICI fusion algorithm is displayed in Figure 2 as follows.
Inspired by Theorem 1, the batch form of ICI is a convex combination of local filters, given as
x ^ k B I C I = h = 1 H K h x ^ k ( h )
where x ^ k ( h ) is local filter, h = 1 H K h = I . The error variance matrix is
P k B I C I 1 = h ( P k h ) 1 h ω h P k h 1
where filtering gains K h are
K h = P k B I C I ( P k h ) 1 ω h h ω h P k h 1
where ω h fulfills the condition 0 ω h 1 , h ω h = 1 . The selection of the coefficients ω h is the minimum trace of the variance matrix P k B I C I as [15]
o b j e c t i v e : min ω t r ( P k | k B I C I ( h ) ) , s . t : 0 ω h 1 , h ω h = 1 .
The above optimization problem can also be solved by the f m i n c o n function in the MATLAB optimization toolbox.
Theorem 2.
The error variance matrix of BICI fusion algorithm is P ˜ k B I C I = E x ˜ k B I C I x ˜ k B I C I T = m n K m P k m n K n T , x ˜ k = x k x ^ k B I C I , and noise variance upper bound is P B I C I .
Proof of Theorem 2.
E x ˜ k B I C I x ˜ k B I C I T = E h K h x ^ k ( h ) x k h K h x ^ k ( h ) x k T = E h K h x ˜ k ( h ) h K h x ˜ k ( h ) T = m n K m P k m n K n T .
Using the inequality is
K m P m n K n T + K n P n m K m T r K m P m K m T + 1 r K n P n K n T
where r > 0 . The noise variance matrix upper bound P k B I C I can be subtracted by
E x ˜ k B I C I x ˜ k B I C I T h K h P k h K h T + m n m r m K m P k m K m T + 1 r m K n P k n K n T = P B I C I .
The proof is completed. □
Using Theorem 2, we demonstrated that the BICI multi-sensor fusion positioning method with unknown covariance is robust. Combined with Theorem 1, the robustness of the SICI fusion positioning method is indirectly verified as
Corollary 1.
The error variance matrix of the SICI fusion algorithm is P ˜ k S I C I = E x ˜ k S I C I x ˜ k S I C I T   =   m n θ m ( H ) P k m n θ m ( H ) T , x ˜ k = x k x ^ k S I C I , and noise variance upper bound is
P S I C I = h θ h ( H ) P k h θ h ( H ) T + m n m r m θ m ( H ) P k m θ m ( H ) T + 1 r m θ n ( H ) P k n θ n ( H ) T .

3.3. Simulation

The goal of this section is to evaluate the performance of the BICI with uncertain time-varying noise variance and unknown covariance. The numerical example provides two representative cases, which are fixed and time-varying noise. The SCI, BCI, SICI and BICI multi-sensor positioning algorithms are taken for comparison. In the presentation of the simulation result, the root mean square (RMS) of positioning error is utilized for positioning accuracy and robustness evaluation.
The simulation trajectory is shown in Figure 3, and the simulation time is 100 s. A 3-sensor fusion positioning system with uncertain time-varying noise variance can be represented as
x k + 1 = F k x k + B k w k
z k h = C k h x k + v k h , h = 1 , 2 , 3
B k = T 2 / 2 0 0 T 0 0 0 T 2 / 2 0 0 T 0 0 0 T 2 / 2 0 0 T
F k = 1 T 0 0 0 0 0 1 0 0 0 0 0 0 1 T 0 0 0 0 0 1 0 0 0 0 0 0 1 T 0 0 0 0 0 1
C k h = 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0
where T = 100 ms is the sampling period of sensor, x k = p x , v x , p y , v y , p z , v z T is the positioning system state. p x , p y and p z are the position of X, Y and Z directions, respectively. v x , v y and v z are the velocity of X, Y and Z directions, respectively. w k and v k h are white Gaussian noise with zero mean and variance matrix Q ¯ k , R ¯ k h , respectively. In the simulation, we take Q = 3 I , Q ¯ k = 0.8 and the conservative accuracy of three sensors as 1 m, 2 m and 3 m, respectively. The observation and process noise of sensors 1 and 2 have random correlation coefficients of ρ k ω k and ρ k v k ( 1 , 2 ) , respectively. ρ k ω k [ 0.1 , 0.3 ] , ρ k v k ( 1 , 2 ) [ 0.1 , 0.2 ] .
The true trace of the fixed noise variance matrix of about three sensors is 0.8 m, 1.6 m and 2.5 m, respectively. The trace of the time-varying noise variance matrix is 0.8 + 0.2 sin ( 2 π k T / 50 ) m, 1.6 + 0.4 sin ( 2 π k T / 50 ) m and 2.5 / 3 + 0.5 / 3 sin ( 2 π k T / 50 ) m. The time-varying trace of three sensors is shown in Figure 4.
Through 50 Monte Carlo simulations, the cumulative distribution functions (CDF) of SCI, BCI, SICI, BICI, SCI (fix), BCI (fix), SICI (fix) and BICI (fix) with uncertain time-varying noise are shown in Figure 5. It is indicated that SCI, BCI, SICI, and BICI multi-sensor fusion positioning algorithms have the same positioning accuracy under uncertain fixed and time-varying noise variance, respectively. Therefore, the four algorithms have good robustness under the time-varying noise variance. The positioning accuracy relation is S I C I < B C I S C I < B I C I in Table 1. BICI has less conservativeness and improved the positioning accuracy by at least 26.7% compared with the other three algorithms.

4. Multi-Sensor Fusion Positioning Algorithm Based on BICI and IMM

The motion pattern of platform is typically hard to obtain in actual scene. The filter based on a single model sharpens the deterioration of positioning accuracy and divergences when motion model noise variance exceeds the conservative upper bound in the strong mobility scenario. The accurate estimation can be obtained by a multi-model algorithm with known covariance in actual scene. There are few studies on the estimation with uncertain time-varying noise variance. Combined with BICI and IMM, BICI-IMM multi-sensor fusion positioning algorithm improves the positioning accuracy.
The process of the traditional IMM algorithm is divided into four steps: model reinitialization, model filter, model probability updating and estimation fusion [34]. The model filter designs for a single sensor cannot meet the multi-sensor fusion positioning. Therefore, we introduced a local model and global filter to replace model filter based on BICI algorithm. Meanwhile, a sequential method was employed for the likelihood function in the model probability updating phase.

4.1. BICI-IMM Algorithm

The structure of the BICI-IMM fusion algorithm is shown in Figure 6.
Consider a multi-sensor fusion positioning system with an unknown motion model and uncertain time-varying noise variance as
x k + 1 i = F k i x k i + B k i w k i , i = 1 , 2 , , M
z k h = C k h x k + v k h , h = 1 , 2 , , H
where M represents the number of models, H represents the number of sensors. During one filtering update cycle, the BICI-IMM algorithm assumes that the motion model is transferred from model i to j with an a priori transfer probability π i j defined as
π i j = P { m k j | m k i , s k M }
where M = { m k i , i = 1 , 2 , , M } is the model set, j π i j = 1 . It is assumed that the local estimation of h-th sensor of j-th model at time k 1 is x ^ k 1 | k 1 j , h , the corresponding estimation error variance matrix is P k 1 | k 1 j , h . The global estimation of j-th model is x ^ k 1 | k 1 j and error variance matrix is P k 1 | k 1 j . The model probability is u k 1 j . The process of BICI-IMM algorithm at time k is
(1) Model reinitialization
For i = 1 , 2 , , M , the model prediction probability is defined as
u k | k 1 i = P m k i | z k 1 = j π j i u k 1 j .
The interaction weight is defined as
u k 1 j | i = P m k 1 j | m k i , z k 1 = π j i u k 1 j / u k | k 1 i .
The interaction state estimation and variance matrix are
x ¯ k 1 | k 1 i , h = E x k 1 | m k i , M k 1 , z k 1 = j u k 1 j | i x ^ k 1 | k 1 j , h = 1 , 2 , , H
P ¯ k 1 | k 1 i , h = j P k 1 | k 1 j , h + x ¯ k 1 | k 1 i , h x ^ k 1 | k 1 j x ¯ k 1 | k 1 i , h x ^ k 1 | k 1 j T u k 1 j | i .
(2) Model local filter
For h-th sensor ( h = 1 , 2 , , H ), the local state estimation process is
u k | k 1 i = P m k i | z k 1 = j π j i u k 1 j .
The state prediction is
x ^ k | k 1 i , h = F k i , h X ^ k 1 | k 1 i , h = 1 , 2 , , H
where the variance of positioning prediction error is
P k | k 1 i , h = F k i , h P ¯ k 1 | k 1 i , h F k i , h T + B k i Q k a B k i T .
The measurement residual is
z ˜ k i , h = z k h C k h x ^ k | k 1 i , h .
The measurement noise variance matrix is
S i , h = C k h P k | k 1 h C k h T + R k h .
The filtering gain is
G k i , h = C k h P k | k 1 i , h ( S i , h ) 1 .
Update the state estimation and variance matrix to
x ^ k | k i , h = x ^ k | k 1 i , h + G k i , h z ˜ k i , h
P k | k i , h = ( I G k i , h C k h ) P k | k 1 i , h .
(3) Global filter
The global estimation of j-th model based on the BICI algorithm is
x ^ k j = h = 1 H K h j x ^ k + 1 j , h
with error variance matrix is
( P k j ) 1 = h P k j , h 1 h ω h j P k j , h 1
where K h j , ω h j are determined by Equations (14) and (26), respectively.
(4) Calculation model likelihood probability function
For i-th model ( i = 1 , 2 , , M ), h-th sensor ( h = 1 , 2 , , H ), the updated probability of model m k i probability is
Λ k i , h = p z ˜ k i , h | m k i , z k 1 i , h .
The likelihood function is obtained through multi-dimensional normal distribution distribution by
Λ k i , h = p z ˜ k i , h | m k i , z k 1 i , h = 2 π H S i , h 1 2 e 1 2 z ˜ k i , h T S k i , h 1 z ˜ k i , h .
The recursive formula of updating the model probability at time k through the model likelihood function based on the sequential method is
U k i , h = U k | k 1 i , h 1 Λ k i , h j U k | k 1 j , h 1 Λ k j , h
U k | k 1 i , h = j π j i U k j , h , h = 1 , 2 , , H 1
where the initial value is
U k | k 1 i , 0 = u k i , 1 , i = 1 , 2 , , M .
The probability of the updated model is
u k i = U i , H 1 .
(5) Estimation fusion
The weighted sum of state estimation of model filters is taken as the global estimation, so the global estimation and noise variance matrix are
x ^ k | k = i x ^ k | k i u k i
P k | k = i u k i P k | k i + x ^ k x ^ k | k i x ^ k x ^ k | k i T .

4.2. Simulation

In order to evaluate the positioning accuracy of the BICI-IMM multi-sensor fusion positioning algorithm with uncertain noise variance, unknown covariance and motion model, we simulated the unmanned platform with constant velocity (CV) and constant turn (CT) models. The positioning accuracy evaluation is the same as in Section 3.3. The multi-sensor positioning system model is shown as
x k + 1 i = F k i x k i + B k i w k i , i = 1 , 2
z k h = C k h x k + v k h , h = 1 , 2 , 3 .
(1) The CV model
It is assumed that the unmanned platform moves in a straight line with constant speed and the system state is x k = p x , v x , p y , v y T ; then
F C V = 1 T 0 0 0 1 0 0 0 0 1 T 0 0 0 1
B C V = T 2 / 2 0 T 0 0 T 2 / 2 0 T .
(2) The CT model
It is assumed that unmanned platform moves in a turning motion at constant angular speed ψ and the system state is x k = p x , v x , p y , v y T , then
F C T = 1 sin ψ T ψ 0 1 cos ψ T ψ 0 cos ψ T 0 sin ψ T 0 1 cos ψ T ψ 1 sin ψ T ψ 0 sin ψ T 0 cos ψ T
B C T = T 2 / 2 0 T 0 0 T 2 / 2 0 T .
The trajectory of the unmanned platform is displayed in Figure 7, which contains CV and CT models in Table 2. The initial state is X 0 = [ 10 , 5 , 10 , 0 ] T . In the simulation, we take Q = 3 I , Q ¯ k = 0.8 , and the conservative noise variance upper bounds of the three sensors are 1 m, 2 m and 3 m, respectively. The actual positioning accuracies of the three sensors are 0.8 m, 1.2 m and 2 m, respectively. The correlation coefficients of sensor 1 and 2 are the same as in Section 3.3.
Through 50 Monte Carlo simulations, the positioning results of BICI, SICI and BICI-IMM are exhibited in Figure 8. Figure 9 is the positioning error CDF of algorithms. It is indicated that BICI has a higher positioning accuracy compared with other single model algorithms. In contrast, the BICI-IMM has higher positioning accuracy. The algorithm based on CV model positioning accuracy is slightly higher than the model based on CT in Table 3.
The error variance of system model based on CV is relatively, small because 71% and 29% of the motion model are CV and CT. Therefore, the positioning accuracy is also slightly higher. The positioning accuracy of BICI-IMM algorithm is about 14.3% and 52%, increased by the BICI and SICI algorithm, respectively.

5. Experiment

In order to verify the positioning accuracy of the BICI-IMM and BICI fusion positioning algorithms, we designed a multi-sensor fusion positioning equipment and carried out the fusion positioning algorithms experiments in the open and semi-open areas. As shown in Figure 10, the multi-sensor fusion positioning equipment includes two GPS, IMU, co-processor and embedded CPU. The two GPS receivers adopt ZED-F9P and MAX-7Q of u-blox company. The IMU sensor is the ADIS16470. The co-processor adopts the STM32F407 with uC/OS-III for data acquisition and time synchronization between sensors. The collected sensors data are sent to the embedded processor through rosserial. The embedded CPU is Allwinner H6 and carries a Linux operating system with a robot operating system. Allwinner H6 is the sensors’ data-processing unit for data recording and fusion processing. During the experiment, we used the high-precision real-time kinematic (RTK) receiver of CHCNV E91 as the reference positioning and the continuously operating reference stations (CORS) adopted the FindCM service of Qianxun.

5.1. Open Area Experiment

We carried out the positioning accuracy of multi-sensor fusion positioning experiment based on fusion positioning equipment in the playground, as in Figure 11 of Beijing University of Posts and Telecommunications. We walked around the playground with positioning equipment and CHCNV E91. The fusion positioning results of SICI(CV), SICI(CT), BICI(CV), BICI(CT) and BICI-IMM algorithms are presented in Figure 12. The RMS positioning errors of SICI(CV), SICI(CT), BICI(CV), BICI(CT) and BICI-IMM fusion positioning algorithms are 1.559 m, 1.561 m, 1.49 m, 1.484 m and 1.27 m as shown in Table 4 and Figure 13. Compared with single model BICI and SICI algorithms, the positioning accuracies of the BICI-IMM multi-sensor fusion algorithm are improved by 18.5% and 14.4%, respectively. Therefore, the BICI-IMM multi-sensor fusion algorithm has better positioning accuracy in open area.

5.2. Semi-Open Area Experiment

We demonstrated the fusion positioning accuracy of the experiment under the semi-open area as in Figure 14, in front of the 4th teaching building of Beijing University of Posts and Telecommunications. The positioning results of SICI(CV), SICI(CT), BICI(CV), BICI(CT) and BICI-IMM algorithms are shown in Figure 15. The positioning errors are statistically analyzed in Figure 16. The RMS positioning errors of SICI(CV), SICI(CT), BICI(CV), BICI(CT) and BICI-IMM fusion positioning algorithms are 1.838 m, 1.839 m, 1.564 m, 1.563 m and 1.44 m in Table 5. Compared with other algorithms, the accuracy of the BICI fusion positioning algorithm decreases the least, so BICI has better robustness and positioning accuracy. However, the performance of BICI-IMM is limited by the precision motion model, which is hard to obtain.

6. Discussion

With respect the local filter, the sensor subsystem is a linear system. For the nonlinear system, the extending Kalman is one of the solutions. The robustness and other research need to be further improved for complex scenarios.
The H 1 dimension optimization is inevitable for BICI. The fast calculation method of the CI method can be used as a reference [35], which reduces the computational complexity of the BICI algorithm and fits the real-time positioning and navigation for the embedded platform with computing and power consumption limitation.
In multi-model algorithm, BICI-IMM utilizes a fixed model set. The size of the model set will be very large in the actual scene. It will boost the computational complexity and positioning error due to the conflicts among the motion models. The variable-structure multi-model algorithm can achieve a balanced positioning accuracy, model set size and computational complexity. Therefore, it is necessary for the further study of a fusion positioning algorithm based on a variable-structure multiple-model, in order to enhance positioning accuracy in challenging scenes.

7. Conclusions

A BICI multi-sensor fusion positioning algorithm is proposed based on the batch form of ICI. Compared with SICI, BCI and SCI algorithm, the positioning accuracy of the BICI algorithm increases by 26.7%, at least in the simulation. We presented the BICI-IMM algorithm with unknown motion model, uncertain time-varying noise variance and unknown covariance based on an IMM algorithm structure. The positioning accuracy increased by 14.3% compared with BICI. The BICI-IMM multi-sensor fusion algorithm has better positioning accuracy than SICI in the open and semi-open scenes. The BICI-IMM can provide a robust positioning for the distributed control of robots and assist in the rapid construction of dynamical network topologies [36]. It helps to decrease the average time taken to organize the group in a coordinated behavior and increase the moving speed of robots in real applications.

Author Contributions

Conceptualization, Y.L. and Z.D.; Investigation, Y.L.; Methodology, Y.L. and Z.D.; Validation, Y.L., Z.D. and E.H.; Visualization, Y.L.; Writing—original draft, Y.L.; Writing—review and editing, Z.D. and E.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China (No. 2016YFB0502003).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The study did not report any data.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
GNSSGlobal Navigation Satellite Systems
CICovariance Intersection
CVConstant Velocity
CTConstant Turn
BCIBatch Covariance Intersection
SCISequential Covariance Intersection
PCIParallel Covariance Intersection
ICIInverse Covariance Intersection
SICISequential Inverse Covariance Intersection
BICIBatch Inverse Covariance Intersection
IMMInteracting Multiple Model
RMSRoot Mean Square
CDFCumulative Distribution Function
RTKReal-Time Kinematic

References

  1. Cheng, L.; Huang, S.; Xue, M.; Bi, Y. A Robust Localization Algorithm Based on NLOS Identification and Classification Filtering for Wireless Sensor Network. Sensors 2020, 20, 6634. [Google Scholar] [CrossRef]
  2. Kułakowski, P.; Vales-Alonso, J.; Egea-López, E.; Ludwin, W.; García-Haro, J. Angle-of-arrival localization based on antenna arrays for wireless sensor networks. Comput. Electr. Eng. 2010, 36, 1181–1186. [Google Scholar] [CrossRef]
  3. Xue, W.; Qiu, W.; Hua, X.; Yu, K. Improved Wi-Fi RSSI measurement for indoor localization. IEEE Sens. J. 2017, 17, 2224–2230. [Google Scholar] [CrossRef]
  4. Wu, P.; Su, S.; Zuo, Z.; Guo, X.; Sun, B.; Wen, X. Time difference of arrival (TDoA) localization combining weighted least squares and firefly algorithm. Sensors 2019, 19, 2554. [Google Scholar] [CrossRef] [Green Version]
  5. Yu, X.M.; Wang, H.Q.; Wu, J.Q. A method of fingerprint indoor localization based on received signal strength difference by using compressive sensing. Eurasip. J. Wirel. Commun. Netw. 2020, 2020, 72. [Google Scholar] [CrossRef]
  6. Shirehjini, A.A.N.; Yassine, A.; Shirmohammadi, S. An RFID-Based Position and Orientation Measurement System for Mobile Objects in Intelligent Environments. IEEE Trans. Instrum. Meas. 2012, 61, 1664–1675. [Google Scholar] [CrossRef]
  7. Zhou, S.; Pollard, J.K. Position measurement using Bluetooth. IEEE Trans. Consum. Electr. 2006, 52, 555–558. [Google Scholar] [CrossRef]
  8. Qin, T.; Li, P.; Shen, S. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator. IEEE Trans. Robot 2018, 34, 1004–1020. [Google Scholar] [CrossRef] [Green Version]
  9. Xu, H.; Wang, L.; Zhang, Y.; Qiu, K.; Shen, S. Decentralized Visual-Inertial-UWB Fusion for Relative State Estimation of Aerial Swarm. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May–31 August 2020; pp. 8776–8782. [Google Scholar] [CrossRef]
  10. Han, Y. Optical Flow/INS Navigation System in Four-rotor. In Proceedings of the 2019 5th International Conference on Systems, Control and Communications, Wuhan, China, 21–23 December 2019; pp. 1–5. [Google Scholar]
  11. Fung, M.L.; Chen, M.Z.; Chen, Y.H. Sensor fusion: A review of methods and applications. In Proceedings of the 2017 29th Chinese Control And Decision Conference (CCDC), Chongqing, China, 28–30 May 2017; pp. 3853–3860. [Google Scholar]
  12. Hubert, M.; Debruyne, M.; Rousseeuw, P.J. Minimum covariance determinant and extensions. Wiley Interdiscip. Rev. Comput. Stat. 2018, 10, e1421. [Google Scholar] [CrossRef] [Green Version]
  13. Kalina, J. The minimum weighted covariance determinant estimator revisited. Commun. Stat. Simul. Comput. 2020, 1–13. [Google Scholar] [CrossRef]
  14. Julier, S.J.; Uhlmann, J.K. A non-divergent estimation algorithm in the presence of unknown correlations. Proc. Am. Control Conf. 1997, 4, 2369–2373. [Google Scholar]
  15. Munz, M.; Mahlisch, M.; Dietmayer, K. Generic Centralized Multi Sensor Data Fusion Based on Probabilistic Sensor and Environment Models for Driver Assistance Systems. IEEE Intell. Transp. Syst. Mag. 2010, 2, 6–17. [Google Scholar] [CrossRef]
  16. Deng, Z.; Zhang, P.; Qi, W.; Liu, J.; Gao, Y. Sequential covariance intersection fusion Kalman filter. Inf. Sci. Int. J. 2012, 189, 293–309. [Google Scholar] [CrossRef]
  17. Zhang, P.; Qi, W.J.; Deng, Z.L. Parallel Covariance Intersection Fusion Optimal Kalman Filter. Appl. Mech. Mater. 2013, 475, 436–441. [Google Scholar] [CrossRef]
  18. Sijs, J.; Lazar, M. State fusion with unknown correlation: Ellipsoidal intersection. Automatica 2012, 48, 1874–1878. [Google Scholar] [CrossRef] [Green Version]
  19. Zarei-Jalalabadi, M.; Malaek, S.M.B.; Kia, S.S. A Track-to-Track Fusion Method for Tracks With Unknown Correlations. IEEE Control Syst. Lett. 2017, 2, 189–194. [Google Scholar] [CrossRef]
  20. Noack, B.; Sijs, J.; Hanebeck, U.D. Algebraic analysis of data fusion with ellipsoidal intersection. In Proceedings of the IEEE International Conference on Multisensor Fusion & Integration for Intelligent Systems, Baden-Baden, Germany, 19–21 September 2017. [Google Scholar]
  21. Noack, B.; Sijs, J.; Reinhardt, M.; Hanebeck, U.D. Decentralized data fusion with inverse covariance intersection. Automatica 2017, 79, 35–41. [Google Scholar] [CrossRef]
  22. Chen, L.; Yu, K.; Wu, K.; Gao, Y.; Huo, Y.; Ran, C.; Dou, Y. Sequential Inverse Covariance Intersection Fusion Kalman Filter for Multi-sensor Systems with Packet Dropouts and Multiplicative Noise. In Proceedings of the 2020 Chinese Automation Congress (CAC), Shanghai, China, 6–8 November 2020; pp. 1335–1340. [Google Scholar]
  23. Tang, M.; Rong, Y.; Zhou, J.; Li, X.R. Information geometric approach to multisensor estimation fusion. IEEE Trans. Signal Process. 2018, 67, 279–292. [Google Scholar] [CrossRef]
  24. Blom, H.A. An efficient filter for abruptly changing systems. In Proceedings of the 23rd IEEE Conference on Decision and Control, Las Vegas, NV, USA, 12–14 December 1984; pp. 656–658. [Google Scholar]
  25. Visina, R.; Bar-Shalom, Y.; Willett, P.; Dey, D. On-demand track-to-track fusion using local IMM inside information. In Proceedings of the Signal Processing, Sensor/Information Fusion, and Target Recognition XXVIII, Baltimore, MD, USA, 15–17 April 2019; International Society for Optics and Photonics: Bellingham, WA, USA, 2019; Volume 11018, p. 1101804. [Google Scholar]
  26. Li, W.; Jia, Y. An information theoretic approach to interacting multiple model estimation. IEEE Trans. Aerosp. Electron. Syst. 2015, 51, 1811–1825. [Google Scholar] [CrossRef]
  27. Li, L.; Wu, S.; Li, X. Multi-Object Tracking Based on Deep Probability Fusion with Holistic Feature Reprentation and IMM-JIPDA. In Proceedings of the 2019 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, Chengdu, China, 14–15 December 2019; pp. 295–302. [Google Scholar]
  28. Ma, Y.; Zhao, S.; Huang, B. Multiple-model state estimation based on variational Bayesian inference. IEEE Trans. Autom. Contrl 2018, 64, 1679–1685. [Google Scholar] [CrossRef]
  29. Wang, N.; Li, Y.; Cong, J.; Sheng, A. Sequential covariance intersection-based Kalman consensus filter with intermittent observations. IET Signal Process 2020, 14, 624–633. [Google Scholar] [CrossRef]
  30. Huber, P.J. Robust Statistics; John Wiley & Sons: Hoboken, NJ, USA, 2004; Volume 523. [Google Scholar]
  31. Qi, W.J.; Zhang, P.; Nie, G.H.; Deng, Z.L. Robust weighted fusion Kalman predictors with uncertain noise variances. Digit. Signal Process. 2014, 30, 37–54. [Google Scholar] [CrossRef]
  32. Kailath, T.; Sayed, A.H.; Hassibi, B. Linear Estimation; Number Book; Prentice Hall: Hoboken, NJ, USA, 2000. [Google Scholar]
  33. Zhu, C.; Xia, Y.; Xie, L.; Yan, L. Optimal linear estimation for systems with transmission delays and packet dropouts. IET Signal Process 2013, 7, 814–823. [Google Scholar] [CrossRef]
  34. Kirubarajan, T.; Bar-Shalom, Y.; Pattipati, K.R.; Kadar, I. Ground target tracking with variable structure IMM estimator. IEEE Trans. Aerosp. Electron. Syst. 2000, 36, 26–46. [Google Scholar] [CrossRef]
  35. Niehsen, W. Information fusion based on fast covariance intersection filtering. In Proceedings of the Fifth International Conference on Information Fusion, FUSION 2002 (IEEE Cat. No. 02EX5997), Annapolis, MD, USA, 8–11 July 2002; Volume 2, pp. 901–904. [Google Scholar]
  36. Buscarino, A.; Fortuna, L.; Frasca, M.; Rizzo, A. Dynamical network interactions in distributed control of robots. Chaos Interdiscip. J. Nonlinear Sci. 2006, 16, 015116. [Google Scholar] [CrossRef]
Figure 1. SICI multi-sensor fusion algorithm structure.
Figure 1. SICI multi-sensor fusion algorithm structure.
Applsci 11 04908 g001
Figure 2. BICI multi-sensor fusion algorithm structure.
Figure 2. BICI multi-sensor fusion algorithm structure.
Applsci 11 04908 g002
Figure 3. The simulation trajectory of three-dimensional motion.
Figure 3. The simulation trajectory of three-dimensional motion.
Applsci 11 04908 g003
Figure 4. The true trace of time-varying noise variance matrix.
Figure 4. The true trace of time-varying noise variance matrix.
Applsci 11 04908 g004
Figure 5. The positioning error CDF of three-dimensional motion.
Figure 5. The positioning error CDF of three-dimensional motion.
Applsci 11 04908 g005
Figure 6. BICI-IMM multi-sensor fusion algorithm structure.
Figure 6. BICI-IMM multi-sensor fusion algorithm structure.
Applsci 11 04908 g006
Figure 7. The simulation trajectory of two-dimensional motion.
Figure 7. The simulation trajectory of two-dimensional motion.
Applsci 11 04908 g007
Figure 8. Comparison of positioning results.
Figure 8. Comparison of positioning results.
Applsci 11 04908 g008
Figure 9. The positioning error CDF of two-dimensional motion.
Figure 9. The positioning error CDF of two-dimensional motion.
Applsci 11 04908 g009
Figure 10. The hardware of multi-sensor fusion positioning equipment.
Figure 10. The hardware of multi-sensor fusion positioning equipment.
Applsci 11 04908 g010
Figure 11. Open area scene.
Figure 11. Open area scene.
Applsci 11 04908 g011
Figure 12. Comparison of positioning results in the open area (local Cartesian coordinates coordinate system).
Figure 12. Comparison of positioning results in the open area (local Cartesian coordinates coordinate system).
Applsci 11 04908 g012
Figure 13. The CDF of positioning error in open area.
Figure 13. The CDF of positioning error in open area.
Applsci 11 04908 g013
Figure 14. Semi-open area scene.
Figure 14. Semi-open area scene.
Applsci 11 04908 g014
Figure 15. Comparison of positioning results in the semi-open area (local Cartesian coordinates coordinate system).
Figure 15. Comparison of positioning results in the semi-open area (local Cartesian coordinates coordinate system).
Applsci 11 04908 g015
Figure 16. The CDF of positioning error in the semi-open area.
Figure 16. The CDF of positioning error in the semi-open area.
Applsci 11 04908 g016
Table 1. RMS of positioning error.
Table 1. RMS of positioning error.
AlgorithmsPositioning Error (m)
SCI0.88
BCI0.88
SICI0.90
BICI0.71
SCI (fix)0.88
BCI (fix)0.88
SICI (fix)0.90
BICI (fix)0.71
Table 2. Motion model settings.
Table 2. Motion model settings.
Time (s)Motion Model
[ 0 , 50 ) CV
[ 50 , 70 ) CT
[ 70 , 120 ) CV
[ 120 , 140 ) CT
[ 140 , 190 ) CV
[ 190 , 210 ) CT
Table 3. RMS position error (m).
Table 3. RMS position error (m).
AlgorithmRMS Positioning Error (m)
BICI-IMM0.47
BICI (CV)0.53
BICI (CT)0.56
SICI (CV)0.70
SICI (CT)0.71
Table 4. RMS position error in open area.
Table 4. RMS position error in open area.
AlgorithmsPositioning Error (m)
BICI-IMM1.27
BICI (CV)1.49
BICI (CT)1.484
SICI (CV)1.559
SICI (CT)1.561
Table 5. RMS position error in the semi-open area.
Table 5. RMS position error in the semi-open area.
AlgorithmsPositioning Error (m)
BICI-IMM1.44
BICI (CV)1.564
BICI (CT)1.563
SICI (CV)1.838
SICI (CT)1.839
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, Y.; Deng, Z.; Hu, E. Multi-Sensor Fusion Positioning Method Based on Batch Inverse Covariance Intersection and IMM. Appl. Sci. 2021, 11, 4908. https://doi.org/10.3390/app11114908

AMA Style

Liu Y, Deng Z, Hu E. Multi-Sensor Fusion Positioning Method Based on Batch Inverse Covariance Intersection and IMM. Applied Sciences. 2021; 11(11):4908. https://doi.org/10.3390/app11114908

Chicago/Turabian Style

Liu, Yanxu, Zhongliang Deng, and Enwen Hu. 2021. "Multi-Sensor Fusion Positioning Method Based on Batch Inverse Covariance Intersection and IMM" Applied Sciences 11, no. 11: 4908. https://doi.org/10.3390/app11114908

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop