Next Article in Journal
A Hierarchical Machine Learning Solution for the Non-Invasive Diagnostic of Autonomic Dysreflexia
Next Article in Special Issue
Few-Shot Learning with Collateral Location Coding and Single-Key Global Spatial Attention for Medical Image Classification
Previous Article in Journal
A Review of Improvements in Power System Flexibility: Implementation, Operation and Economics
Previous Article in Special Issue
A Novel Progressive Image Classification Method Based on Hierarchical Convolutional Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evolutionary Optimization Based Set Joint Integrated Probabilistic Data Association Filter

1
Academy of Advanced Interdisciplinary Research, Xidian University, Xi’an 710071, China
2
School of Computer Science, Shaanxi Normal University, Xi’an 710119, China
3
School of Electronic Engineering, Xidian University, Xi’an 710071, China
*
Authors to whom correspondence should be addressed.
Electronics 2022, 11(4), 582; https://doi.org/10.3390/electronics11040582
Submission received: 10 January 2022 / Revised: 8 February 2022 / Accepted: 10 February 2022 / Published: 15 February 2022
(This article belongs to the Special Issue Applications of Computational Intelligence)

Abstract

:
The joint integrated probabilistic data association (JIPDA) algorithm is widely used for the automatic tracking of multiple targets, but it has the well-known problem of track coalescence. By optimizing the posterior density, the accuracy of the target state estimation can be improved. Motivated by this idea, we developed a novel evolutionary optimization based joint integrated probabilistic data association (EOJIPDA) filter to overcome the coalescence problem of the JIPDA filter. The trace for the covariance matrix of the posterior density is used as the objective function for the above optimization problem. It is shown that the accuracy of the target state estimation can be improved by reducing the trace. Evolutionary optimization was employed to minimize the trace and optimize the posterior density. More specifically, we enumerated all the possible permutations of the targets and assign a unique index to each permutation. The resulting indices were randomly assigned to all possible association hypothesis events. Each assignment indicated one possible gene in the evolutionary algorithm. This process was repeated several times to arrive at the initial population. An illustrative example shows that the EOJIPDA filter can effectively improve the accuracy of state estimation. Numerical studies are presented for two challenging multi-target tracking scenarios with clutter and missed detections. The experimental results demonstrate that the EOJIPDA filter provides better tracking accuracy than traditional coalescence-avoiding methods.

1. Introduction

Multi-target tracking (MTT) is one of the most important low-level techniques used in radar, computer vision, Internet of things [1,2], and other surveillance systems [1,2,3,4,5]. Traditional MTT methods usually regard the MTT problem as the tracking of multiple single-targets. Examples of such methods are the multiple hypothesis tracking (MHT) [6,7] and joint probabilistic data association (JPDA) [8] filters. The essence of these filters is the association between the measurements and the targets being tracked. The MHT filter propagates all possible association hypothesis events over time. The target states can be estimated accurately from sufficient events. However, the main drawback of the MHT filter is its heavy computation. Compared with the MHT filter, the JPDA filter requires less computation and is effective at MTT. Nevertheless, the JPDA filter has the track coalescence problem, whereby tracks tend to coalesce when the targets are closely spaced. The JPDA filter has a well-known drawback in that it assumes that the number of targets and their initial states are known a priori. Furthermore, the number of targets remains constant during tracking.
In practice, the number and states of targets are usually unknown in advance and the number of targets may vary with time. The automatic tracking system is a natural choice to track targets in this situation. Both target and clutter measurements are used by the automatic tracking system to initiate tracks. To distinguish between false and true tracks, it is necessary to measure the quality of each track. The joint integrated probabilistic data association (JIPDA) filter uses the probability of target existence to measure the quality of the track and is effective for automatic tracking [9]. However, the JIPDA filter also suffers from the track coalescence problem.
To overcome the track coalescence problem of the JIPDA filter and further improve the tracking accuracy, we combine the advantages of the RFS theory and the standard JIPDA filter and propose a novel filter, named evolutionary optimization based joint integrated probabilistic data association (EOJIPDA). The essential reason for the track coalescence is that the overlap of the tracking gates leads to the association uncertainty problem. In this case, the posterior density becomes multimodal and the estimation of the multi-target state becomes less accurate. The trace of the covariance matrix is a measure of the multimodality of the posterior density [10,11]. To improve the accuracy of the multi-target state estimation, we used the evolutionary computation approach to minimize the trace of the covariance matrix and optimize the posterior density. First, it is necessary to define a population of possible solutions in the search space for the optimization problem. We enumerated all the possible permutations of the targets and assigned a unique index to each permutation. The resulting indices were randomly assigned to all the possible data association events. Each assignment indicated one possible gene in the evolutionary algorithm. This process was repeated several times until we obtained the initial population. Each candidate solution was assigned a fitness value based on the cost function. Fitter individuals have a higher chance of mating, producing more “fitter” individuals. The crossover and mutation are then applied to the population to generate the new offspring. This process is repeated until the stopping criterion is reached. The main contributions of the proposed EOJIPDA filter are summarized as follows.
(1)
Although the JIPDA filter is effective for automatic MTT, few improvements have been proposed to overcome its coalescence problem. We propose to optimize the posterior density of the JIPDA filter using the RFS theory, when target identity is irrelevant.
(2)
To the best of our knowledge, this is the first work to use the computational intelligence technique to improve the performance of the data association based filter. We model the optimization of the posterior density as an evolutionary optimization problem, improving the accuracy of the state estimation.
(3)
The illustrative example shows that the EOJIPDA filter can effectively improve the accuracy of the state estimation. Simulation results obtained from two challenging MTT scenarios demonstrate the effectiveness of the EOJIPDA filter in terms of the optimal sub-pattern assignment (OSPA) multi-target miss distance.
The organization of this paper is as follows. Section 2 introduces the target and measurement models, and the necessary background on the JIPDA filter. In Section 3, the proposed EOJIPDA filter is described in detail. Section 4 evaluates the performance of the EOJIPDA filter using two different tracking scenarios. Finally, Section 5 presents concluding remarks.

2. Related Work

To date, several approaches have been proposed to overcome track coalescence, such as the exact nearest-neighbor JPDA (ENNJPDA) filter [12], the JPDA* filter [13], the set JPDA (SJPDA) filter [10], the Kullback–Leibler SJPDA (KLSJPDA) filter [10], the multi-objective JPDA (MOJPDA) [14], and the nearest-neighbor SJPDA (NNSJPDA) filter [15]. Motivated by the JPDA* filter [13], the JIPDA* filter [16] has also been proposed to overcome the track coalescence problem of the traditional JIPDA filter. In the JIPDA* filter, the target states are estimated by selecting one association hypothesis event and the other association hypothesis events are pruned. The track coalescence problem can be avoided effectively by the JIPDA* filter, but the association hypothesis events being pruned may contain some useful information. Our recent work [11] proposes to use the information contained in all the association hypothesis events by optimizing the posterior density. The proposed algorithm strongly depends on initializations and improper initializations may result in bad local minima.
Finite set statistics (FISST)-based MTT algorithms [17], such as the probability hypothesis density (PHD) filter [18], the cardinalized PHD (CPHD) filter [19], the multi-Bernoulli (MB) filter [20], the label multi-Bernoulli (LMB) filter [21], and the generalized label multi-Bernoulli (GLMB) filter [22,23], have attracted significant attention in recent years. These filters use the random finite set (RFS) theory to model the uncertainty in systems. Among them, the PHD and CPHD filters are the moment approximations of the Bayes multi-target filter and have no analytical expression for the posterior multi-target density. Unlike the PHD and CPHD filters, the MB filter propagates parameters of the multi-Bernoulli RFS instead of the posterior multi-target density. By using the labeled RFS, the LMB and GLMB filters have also been proposed as approximations of the multi-target Bayes filter. These filters can be implemented by the Gaussian mixture (GM) method or the sequential Monte Carlo (SMC) method, depending on the characteristics of the tracking system. In Table 1, we list all the above-mentioned existing MTT methods.

3. Background

3.1. Target and Measurement Assumptions

We consider the nearly constant velocity model in this paper. Assuming that the target state at time k is denoted as x k , the target motion is modelled as follows
x k + 1 = F k x k + u k
where F k is the transition matrix and u k ~ N ( 0 , Q k ) is zero-mean Gaussian distributed process noise with covariance Q k . If the number of all potential targets (tracks) at time k is n k , the augmented vector of labeled target states is
X k = [ ( x k 1 ) T , ( x k 2 ) T , , ( x k n k ) T ] T
At time k, the relation between the target x k and its measurement z k is described as
z k = H k x k + w k
where H k is the observation matrix and w k ~ N ( 0 , R k ) denotes that w k follows the Gaussian distribution with zero-mean and covariance R k . The target-originated measurements are detected with the probability of detection P D . Measurements may also originate from clutters. It is assumed that the number of clutter measurements follows the Poisson distribution and the average number of clutter measurements at each time step is r = λ | FoV | , where λ is the intensity of clutter and | FoV | denotes the sensor’s field-of-view. The set of the validated measurements received at time k is given by
Z k = { z k 1 , z k 2 , , z k m k }
where m k denotes the number of measurements. The sequence of measurement sets accumulated up to time k is described as Z 1 : k = { Z 1 , Z 2 , , Z k } .

3.2. Joint Integrated Probabilistic Data Association Filter

In the JIPDA filter, association hypothesis events are formed by assigning the validated measurements to the targets being tracked. From this, the target state x k t and covariance P k t are estimated for each track t at time k. What’s more, the estimation of the probability of target existence r k t is also taken into considered. Therefore, a track t can be completely described by the parameter set { r k t , N ( x k t , P k t ) ) } , where N ( x k t , P k t ) is a Gaussian PDF with mean x k t and covariance P k t . At time k + 1, the main steps used to estimate the parameter set are as follows.
  • Step 1: Predicting the target state x k + 1 | k t , the covariance P k + 1 | k t , and the probability of target existence r k + 1 | k t for each track t.
The predicted target state x k | k 1 t and covariance P k | k 1 t are estimated using the Kalman filter. The propagation of the target’ existence probability follows the Markov chain one,
r k + 1 | k t = p 11 r k t + p 21 ( 1 r k t )
where p 11 and p 21 are the Markov chain coefficients.
  • Step 2: The tracking gate is generated for each target to select the validated measurements.
After the prediction, gating is performed for each track by defining an area around the predicted track. The area is named as “gate” and only the measurements falling within the gate are regarded as the validated measurements and are used to update the track. The authors of [24] present various gating techniques, among which the ellipsoidal gate [25] is widely used. The ellipsoidal gating area for track t at time k is defined as follows,
k t = { z k j d z | d t ( z k j ) G }
where
d t ( z k j ) = v ( k , t , j ) T ( S k t ) 1 v ( k , t , j ) T
denotes the distance between predicted measurement z k | k 1 t and received measurement z k j , v ( k , t , j ) = z k j z k | k 1 t denotes the difference between z k | k 1 t and z k j , S k t is the innovation covariance, d z is the measurement dimension, and G is the threshold that leads to a specified gating probability P W .
  • Step 3: Association hypothesis events are formed by associating the validated measurements with the tracks.
The posterior probability of the association hypothesis event θ h is computed as
P ( θ h ) = C 1 t T 0 h ( 1 P D P W r k 1 t ) × t T 1 h ( P D P W r k 1 t p h t V k m ^ k )
where C is the normalization constant; p h t = f t ( z k t | Z 1 : k 1 ) / P W with P W denoting the gating probability and Z 1 : k 1 is the set of measurements accumulated up to time k − 1; P D is the probability of detection; V k is the cluster volume; m ^ k is the number of clutter measurement; T 0 h denotes the set of tracks associated with no measurement; and T 1 h denotes the set of tracks associated with one measurement.
Using the posterior probability P ( θ h ) , the target existence probability of track t in θ h is computed as
r k t | h = ( 1 i = 1 m k ξ i t | h ) r k , 0 t | h + i = 1 m k ξ i t | h r k , i t | h
where r k , 0 t | h denotes the probability that track t is not associated with any measurement, r k , i t | h denotes the probability that track t is associated with measurement z k i in θ h , and the parameter ξ i t | h indicates whether the track t is associated with a measurement, i.e.,
ξ i t | h = 1   ,     if   track   t   is   associated   with   measuremt   z k i   ξ i t | h = 0   ,     otherwise
The probabilities r k , 0 t | h and r k , i t | h are computed as follows
r k , 0 t | h = ( 1 P D t P W t ) r k | k 1 t 1 P D t P W t r k | k 1 t P ( θ h ) ,   r k , i t | h = P ( θ h )
Using the posterior probability P ( θ h ) and the target existence probability r k t | h , the target state and the error covariance of track t in θ h are estimated as
x k t | h = ( 1 i = 1 m k ξ i t | h ) x k | k 1 t + i = 1 m k ξ i t | h x k , i t
P k t | h = ( 1 i = 1 m k ξ i t | h ) P k | k 1 t + i = 1 m k ξ i t | h [ P k | k 1 t K k t S k t ( K k t ) T ]
where x k , i t is the updated target state using z k i and K k t is the filter gain.
  • Step 4: The target existence probability, the target state, and the error covariance for track is approximated as [11]
r k t = h = 1 N r k t | h
x k t = 1 r k t h = 1 N r k t | h x k t | h
P k t = 1 r k t h = 1 N r k t | h [ P k t | h + x k t | h ( x k t | h ) T x k t ( x k t ) T ]
where N denotes and the number of all association hypothesis events.

4. Evolutionary-Optimization-Based Joint Integrated Probabilistic Data Association

4.1. Motivations

In automatic tracking systems, the target number may vary with time. In this paper, we assume that the targets are not discriminated from each other. Under these assumptions, the target states can be described as RFSs, in which the points are unordered and random [17]. It was shown that the posterior density can be changed into the other density within its RFS family [10]. Therefore, we propose to optimize the ordered posterior density within its RFS family to improve the tracking accuracy.
By reducing the error covariance, the problem of overlapping tracking gates can be effectively alleviated [11]. A scalar measure of the error covariance is the trace for the covariance matrix, as follows [11]
C k = t = 1 n k trace ( P k t ) = t = 1 n k h = 1 N r k t | h r k t trace ( P k t | h + x k t | h ( x k t | h ) T x k t ( x k t ) T ) = t = 1 n k 1 r k t h = 1 N r k t | h [ trace ( P k t | h ) + x k t | h x k t 2 ]
To alleviate the problem of overlapping tracking gates and improve the tracking accuracy, the trace for the covariance matrix Equation (17) is used as the cost function for the optimization of the posterior density.

4.2. Evolutionary Optimization of the Posterior Density

For the optimization of the posterior density, the target permutations under different association hypothesis events are reordered to minimize the cost function using Equation (17). We use the evolutionary algorithm [26,27] to implement the optimization. The specific steps of the proposed EOJIPDA method are as follows.
  • Step 1: It is necessary to generate the initial population for the evolutionary optimization.
We enumerate all the possible permutations of the targets and assign a unique index to each permutation. For example, when the number of targets is n k = 3 , the number of all possible permutations of the targets is N P = n k ! = 3 ! = 6 . The set of the indexes for these permutations is denoted as
I = { I 1 , I 1 , , I n k ! }
The indices within the set I are randomly assigned to each association hypothesis event. An assignment indicates a possible solution for the evolutionary algorithm. Such a solution is named as a chromosome, as follows
c h r o m o s o m e = [ C 1 , C 2 , C N ]
where the element C j I and j = 1 , 2 , , N . We randomly perform the assignments and generate N p o p chromosomes. These chromosomes are used as the initial population, i.e., the first generation, for the evolutionary optimization.
  • Step 2: The value of the cost function forms the fitness value for each solution.
The fitness function is used to test how well the chromosome solves the problem. All the solutions in the population are sorted based on their fitness values.
  • Step 3: The offspring solutions are generated using the selection, crossover and mutation operators.
The selection operator chooses some of the chromosomes for reproduction. For the crossover operator, we use the single-point crossover. The genes of the two-parent chromosome are interchanged after a random selected point. Along with the crossover, the mutation is performed. We random select one point and change it into a random selected point from the set using Equation (18).
The new population with all the parents and offspring is sorted again based on their fitness values and the population size is decreased to N p o p by eliminating all the lower rank solutions.
  • Step 4: Back to Step 3 and the cycle repeats.
For each generation, we record the chromosome with the highest fitness (along with the value of the fitness). The cycle is repeated until the fitness value of the “best-so-far” chromosome stabilizes.

4.3. Illustrative Example

To illustrate the procedure of the proposed EOJIPDA method, a one-dimensional example is used in this subsection. We assume that two Gaussian distributed targets generate two detections and there are two association hypothesis events θ 1 and θ 2 . The density of target t corresponding to θ h is denoted as p t | h ( x ) = { r t | h ,   N ( x t | h , P t | h ) } . The initial posterior probability density is given as
θ 1 : p 1 | 1 ( x ) = { 0.1 ,   N ( 1.0 , 1.0 ) } ,   p 2 | 1 ( x ) = { 0.4 ,   N ( 5.0 , 1.0 ) } θ 2 : p 1 | 2 ( x ) = { 0.5 ,   N ( 4.0 , 1.0 ) } ,   p 2 | 2 ( x ) = { 0.5 ,   N ( 2.0 , 1.0 ) }
Using Equations (14)–(16), the approximated probability density for each track is described by
p 1 ( x ) = { 0.60 ,   N ( 3.50 , 2.25 ) } ,   p 2 ( x ) = { 0.9 ,   N ( 3.33 , 3.22 ) }
The posterior probability density of the joint track state and its approximated probability density of the estimated track state are shown in Figure 1a and Figure 1b, respectively. Obviously, Figure 1b is very different with Figure 1a. Therefore, the approximation is less accurate and the trace of the covariance matrix in Equation (17) of the estimated covariance matrix is C 0 = 2.25 + 3.22 = 5.47 .
To improve the accuracy of the approximation, we perform the evolutionary optimization of the posterior probability density. Five iterations are performed and the resulting posterior probability density is given as
θ 1 : p 1 | 1 ( x ) = { 0.1 ,   N ( 1.0 , 1.0 ) } ,   p 2 | 1 ( x ) = { 0.4 ,   N ( 5.0 , 1.0 ) } θ 2 : p 1 | 2 ( x ) = { 0.5 ,   N ( 2.0 , 1.0 ) } ,   p 2 | 2 ( x ) = { 0.5 ,   N ( 4.0 , 1.0 ) }
Using Equations (14)–(16), the approximated probability density for each track is described by
p 1 ( x ) = { 0.60 ,   N ( 1.83 , 1.14 ) } ,   p 2 ( x ) = { 0.9 ,   N ( 4.44 , 1.25 ) }
The resulting posterior probability density and its approximated probability density are plotted in Figure 2a,b, respectively. It is obvious that the similarity between Figure 2a,b is much higher than that between Figure 1a,b. The trace of the covariance matrix in Equation (17) of the estimated covariance matrix is reduced to C 0 = 1.14 + 1.25 = 2.39 . This indicates that the accuracy of the approximation and the state estimation is greatly improved. The results show a good agreement with the theoretical analysis.

5. Numerical Simulation and Results

We demonstrate the performance of the proposed EOJIPDA filter using two challenging MTT scenarios in the two-dimensional surveillance area. At time k, the state of the moving target is represented by the state vector
x k = [ x k , x ˙ k , y k , y ˙ k ] T
where [ x k , y k ] T is the target position and [ x ˙ k , y ˙ k ] T is the target velocity. The transition matrix of the motion model in Equation (1) is
F = I 2 [ 1           T s 0           1 ]  
where is the Kroneker product, I 2 is a 2 × 2 identity matrix, and   T s is the sampling interval. The covariance of the Gaussian process noise u k is
Q = I 2 q [ T s 3 3           T s 2 2 T s 2 2               T s ]  
where q is a tuning parameter. In both scenarios, a sensor is used to collect the measurements in the surveillance area. For simplicity, it is assumed that the measurements collected by the sensor represent the positions of the targets. Therefore, the observation matrix of the measurement model in Equation (3) is
H = [ 1       0       0       0 0       0       1       0 ]
The covariance of the Gaussian measurement noise w k is
R = [ σ x 2 0 0 σ y 2 ]
where σ x and σ y are the standard deviations of the measurement noise in x and y coordinates, respectively.
The sampling interval of the sensor is fixed as   T s = 1   s and the detection probability is   P D = 0.92 . The gating threshold is G = 9.21 [28], which corresponds to a two-dimensional gating probability of P W = 0.99 . The coefficients of the Markov chain one model in Equation (5) are borrowed from [9], where p 11 = 0.98 and p 21 = 0 . The tracks are terminated if the target existence probability falls below the termination threshold and are confirmed if the probability exceeds the confirmation threshold. The confirmation and termination thresholds are P C = 0.83 and P T = 0.0909 [9], respectively. The tracking performance of the filter is measured by the optimal sub-pattern assignment (OSPA) [29] multi-target miss distance, which measures the error between the estimated and true state and is widely used [17,18,19,20,30]. If X = { x 1 , x 2 , , x n } , Y = { y 1 , y 2 , , y m } , and n m , the OSPA multi-target miss distance is defined as [29]
d p , c OSPA ( X , Y ) : = ( 1 n ( min π Π n i = 1 m d ( c ) ( x i , y π ( i ) ) p + c p ( n m ) ) ) 1 / p
where d ( c ) ( x , y ) : = min ( c , x y ) , c > 0 is the cut-off parameter, p 1 is an order parameter and π is a permutation function in the set of permutations Π n . If n < m , d p , c OSPA ( X , Y ) : = d p , c OSPA ( Y , X ) . All the experiments are tested in MATLAB R2010a and implemented on a computer with a 3.40 GHz processor.

5.1. Scenario 1

We consider the tracking of two targets in this scenario, whose trajectories are shown in Figure 3. The track coalescence of the JPDA and JIPDA filters can be clearly observed using this scenario; hence, this scenario has been widely used [10,11,12,13,14,15]. In Figure 3, the parameters are selected as: ϕ = π / 3 , d = 0.5   m , and l 1 = l 2 = 10   m . It is assumed that the speed of the target stays constant as v = 1   m / s . The parameters for the clutter measurements are λ = 0.36 × 10 3   m 2 and | FOV | = 1.4 × 10 3   m 2 , giving an average of five clutter returns per scan. The standard deviations of the measurement noise are σ x = σ y = 0.1   m .
The estimated target positions for a single run of the JIPDA and EOJIPDA filters are shown in Figure 4a and Figure 4b, respectively. It can be observed that the serious track coalescence problem happens in Figure 4a. When the targets are closely spaced, their position estimates coalesce. Although the targets move away from each other later, the JIPDA fails to detect their separation. Compared with the JIPDA filter, the EOJIPDA filter can accurately estimate the target positions, as shown in Figure 4b.
The average OSPA distances over 100 Monte Carlo trails for the JIPDA, exact nearest neighbor JIPDA (ENNJIPDA), JIPDA*, and EOJIPDA filters are shown in Figure 5. Due to the track coalescence problem, the OSPA distance of the JIPDA filter is worse than in the comparative algorithms. Although the ENNJPDA filter was proposed to overcome the coalescence problem, it is sensitive to clutter and missed detections. Compared with the JIPDA* filter, the EOJIPDA filter uses more information about the posterior density and performs better in terms of the OSPA error.

5.2. Scenario 2

The tracking of three targets is studied in this scenario. The trajectories of the targets cross each other at a crossing point, as shown in Figure 6. Each target keeps a constant speed, v = 1   m / s . The parameters used in the simulations are ϕ 1 = ϕ 2 = π / 8 and l 1 = l 2 = 100   m , σ x = σ y = 10   m , λ = 2.5 × 10 3   m 2 , and | FOV | = 2 × 10 3   m 2 . The two-point difference [24] is used to initiate tracks automatically and the maximum possible speed is assumed to be 200 m/s.
The estimated target positions for a single run of the JIPDA and EOJIPDA filters are shown in Figure 7a and Figure 7b, respectively. It can be observed from Figure 7 that it takes some time for the JIPDA and EOJIPDA filters to localize targets. When the targets are spaced close to each other, the JIPDA filter cannot accurately estimate the target positions and the tracks tend to coalesce. Compared with the JIPDA filter, the EOJIPDA filter can effectively overcome the track coalescence problem and provide position estimates that are close to the true values.
The average OSPA distances for the different tracking methods are shown in Figure 8. The tracking errors of all the methods are high at the initial time steps because the initial states of the targets are assumed to be unknown in this scenario. Since the track coalescence problem happens in the JIPDA filter, it can be observed that the tracking error of the JIPDA filter is high after the crossing point (at time k = 11). The ENNJIPDA and JIPDA* filters can effectively reduce the tracking error of the JIPDA filter. Nevertheless, the error performance of the proposed EOJIPDA filter is better than that of other filters for almost the entire scenario.
Table 2 shows the accumulated number of confirmed tracks at the end point of the tracking by 100 MC trails for the JIPDA filter, the ENNJIPDA filter, the JIPDA* filter and the EOJIPDA filter. The results for the different clutter rates are provided. It can be seen that the challenging tracking environment makes all the filters lose some tracks. Nevertheless, the performance of the EOJIPDA filter is superior to others under different clutter rates. In other words, the better tracking performance of the EOJIPDA filter makes the detection of target existence more reliable.

6. Conclusions

The JIPDA filter an effective method for MTT, but it suffers from the serious track coalescence problem. To improve the tracking performance of the JIPDA filter, a novel MTT filter, named EOJIPDA, was proposed in this paper. We first attempted to use the evolutionary computation technique to optimize the posterior density of the JIPDA filter. When the target identity was irrelevant, we modeled the posterior density optimization problem as an evolutionary computation problem and the trace of the covariance matrix is used as the cost function. Through an indicative example, it was shown that the evolutionary computation can effectively reduce the value of the cost function, improving the accuracy of the Gaussian approximation and the state estimation.
The simulation results show that the EOJIPDA filter effectively avoids track coalescence and performs better than the traditional algorithms in terms of the OSPA error. Future work will investigate the application of more computational intelligence strategies, such as particle swarm optimization and the Cuckoo search algorithm, to improving the performances of traditional tracking methods.

Author Contributions

Conceptualization, S.L. and Y.Z.; methodology, S.L.; validation, Y.Z.; investigation, S.L.; writing—original draft preparation, S.L.; writing—review and editing, S.L., H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

In this work, we have used the free RFS MATLAB code at http://ba-tuong.vo-au.com/codes.html.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China, under grant numbers 62007022 and 61906146; the Natural Science Foundation of Shaanxi Province, under grant number 2021JQ-209; and the Fundamental Research Funds for the Central Universities, under grant numbers GK202103082 and JB210210.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
MTTmulti-target tracking
MHTmultiple hypothesis tracking
JPDAjoint probabilistic data association
ENNJPDAexact nearest-neighbor JPDA
ENNJIPDAexact nearest-neighbor JIPDA
SJPDAset JPDA
NNSJPDAnearest-neighbor SJPDA
JIPDAjoint integrated probabilistic data association
FISSTfinite set statistics
PHDprobability hypothesis density
CPHDcardinalized PHD
MBmulti-Bernoulli
LMBlabel multi-Bernoulli
GLMBgeneralized label multi-Bernoulli
RFSrandom finite set
GMGaussian mixture
SMCsequential Monte Carlo
EOJIPDAjoint integrated probabilistic data association
OSPAoptimal sub-pattern assignment
List of mathematical symbols
x k state vector at time k
F   k transition matrix at time k
N ( m , P ) Gaussian probability density with mean m and covariance P
z k measurement vector at time k
H k observation matrix at time k
P D detection probability
P k covariance matrix at time k
r k target existence probability at time k
p 11 , p 21 Markov chain coefficients
z k | k 1 predicted measurement vector from time k-1 to time k
S k innovation covariance
d z measurement dimension
Ggating threshold
θ h association hypothesis event
P W gating probability
V k cluster volume
K k filter gain
N number of all association hypothesis events
trace ( P ) trace for the covariance matrix P

References

  1. Anjos, J.C.S.D.; Gross, J.L.G.; Matteussi, K.J.; González, G.V.; Geyer, C.F.R. An algorithm to minimize energy consumption and elapsed time for IoT workloads in a hybrid architecture. Sensors 2021, 21, 2914. [Google Scholar] [CrossRef] [PubMed]
  2. Martins, J.A.; Ochôa, I.S.; Silva, L.A.; Mendes, A.S.; González, G.V.; Santana, J.D.; Leithardt, V.R.Q. PRIPRO: A comparison of classification algorithms for managing receiving notifications in smart environments. Appl. Sci. 2020, 10, 502. [Google Scholar] [CrossRef] [Green Version]
  3. Baser, E.; McDonald, M.; Kirubarajan, T.; Efe, M. A joint multitarget estimator for the joint target detection and tracking filter. IEEE Trans. Signal Process. 2015, 63, 3857–3871. [Google Scholar] [CrossRef]
  4. Mallick, M.; Vo, B.N.; Kirubarajan, T.; Arulampalam, S. Introduction to the issue on multitarget tracking. IEEE J. Sel. Top. Signal Process. 2013, 7, 373–375. [Google Scholar] [CrossRef]
  5. Severson, T.A.; Paley, D.A. Distributed multitarget search and track assignment with consensus based coordination. IEEE Sens. J. 2015, 15, 864–875. [Google Scholar] [CrossRef]
  6. Reid, D. An algorithm for tracking multiple targets. IEEE Trans. Autom. Cont. 1979, 24, 843–854. [Google Scholar] [CrossRef]
  7. Kurien, T. Issues in the design of practical multitarget tracking algorithms. In Multitarget-Multisensor Tracking: Advanced Applications; Bar-Shalom, Y., Ed.; Artech House: Norwood, MA, USA, 1990; pp. 43–83. [Google Scholar]
  8. Fortmann, T.E.; Bar-Shalom, Y.; Scheffe, M. Sonar tracking of multiple targets using joint probabilistic data association. IEEE J. Ocean. Eng. 1983, 8, 173–184. [Google Scholar] [CrossRef] [Green Version]
  9. Mušicki, D.; Evans, R. Joint integrated probabilistic data association: JIPDA. IEEE Trans. Aerosp. Electron. Syst. 2004, 40, 1093–1099. [Google Scholar] [CrossRef]
  10. Svensson, L.; Svensson, D.; Guerriero, M.; Willett, P. Set JPDA filter for multitarget tracking. IEEE Trans. Signal Process. 2011, 59, 4677–4691. [Google Scholar] [CrossRef] [Green Version]
  11. Zhu, Y.; Wang, J.; Liang, S.; Wang, J. Covariance control joint integrated probabilistic data association filter for multi-target tracking. IET Radar Sonar Nav. 2019, 13, 584–592. [Google Scholar] [CrossRef]
  12. Fitzgerald, R.J. Development of practical PDA logic for multitarget tracking by microprocessor. In Multitarget-Multisensor Tracking: Advanced Applications; Bar-Shalom, Y., Ed.; Artech House: Norwood, MA, USA, 1990; pp. 1–23. [Google Scholar]
  13. Blom, H.; Bloem, E. Probabilistic data association avoiding track coalescence. IEEE Trans. Autom. Cont. 2000, 45, 247–259. [Google Scholar] [CrossRef]
  14. Zhu, Y.; Wang, J.; Liang, S. Efficient joint probabilistic data association filter based on Kullback-Leibler divergence for multi-target tracking. IET Radar Sonar Nav. 2017, 11, 1540–1548. [Google Scholar] [CrossRef]
  15. Zhu, Y.; Liang, S.; Wu, X.J.; Yang, H.H. A random finite set based joint probabilistic data association filter with non-homogeneous Markov chain. Front. Inf. Technol. Electron. Eng. 2021, 22, 1114–1126. [Google Scholar] [CrossRef]
  16. Blom, H.; Bloem, E.; Mušicki, D. JIPDA*: Automatic target tracking avoiding track coalescence. IEEE Trans. Aerosp. Electron. Syst. 2015, 51, 962–974. [Google Scholar] [CrossRef]
  17. Mahler, R. Statistical Multisource Multitarget Information Fusion; Artech House: Norwood, MA, USA, 2007. [Google Scholar]
  18. Mahler, R. Multitarget Bayes filtering via first-order multitarget moments. IEEE Trans. Aerosp. Electron. Syst. 2003, 39, 1152–1178. [Google Scholar] [CrossRef]
  19. Mahler, R. PHD filters of higher order in target number. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 1523–1543. [Google Scholar] [CrossRef]
  20. Vo, B.T.; Vo, B.N.; Cantoni, A. The cardinality balanced multi-target multi-Bernoulli filter and its implementations. IEEE Trans. Signal Process. 2009, 57, 409–423. [Google Scholar] [CrossRef] [Green Version]
  21. Reuter, S.; Vo, B.T.; Vo, B.N.; Dietmayer, K. The labeled multi-Bernoulli filter. IEEE Trans. Signal Process. 2014, 62, 3246–3260. [Google Scholar] [CrossRef]
  22. Vo, B.N.; Vo, B.T.; Phung, D. Labeled random finite sets and the Bayes multi-target tracking filter. IEEE Trans. Signal Process. 2014, 62, 6554–6567. [Google Scholar] [CrossRef] [Green Version]
  23. Vo, B.T.; Vo, B.N. Labeled random finite sets and multi-target conjugate priors. IEEE Trans. Signal Process. 2013, 61, 3460–3475. [Google Scholar] [CrossRef]
  24. Blackman, S.; Popoli, R. Design and Analysis of Modern Tracking Systems; Artech House: Norwood, MA, USA, 1999. [Google Scholar]
  25. Breidt, F.J.; Carriquiry, A.L. Highest density gates for target tracking. IEEE Trans. Aerosp. Electron. Syst. 2000, 36, 47–55. [Google Scholar] [CrossRef]
  26. Abraham, A.; Nedjah, N.; Mourelle, L.M. Evolutionary computation: From genetic algorithms to genetic programming. In Genetic Systems Programming: Theory and Experiences; Springer: Berlin/Heidelberg, Germany, 2006; Volume 13, pp. 1–20. [Google Scholar] [CrossRef]
  27. Gong, M.G.; Li, H.; Meng, D.Y.; Miao, Q.G. Decomposition-Based Evolutionary Multi-objective Optimization to Self-paced Learning. IEEE Trans. Evolut. Comput. 2019, 23, 288–302. [Google Scholar] [CrossRef]
  28. Bar-Shalom, Y.; Chang, K.C.; Blom, H.A.P. Automatic Track Formation in Clutter with a Recursive Algorithm. Multitarget-Multisensor Tracking; Artech House: Norwood, MA, USA, 1990; pp. 25–42. [Google Scholar]
  29. Schuhmacher, D.; Vo, B.T.; Vo, B.N. A consistent metric for performance evaluation of multi-object filters. IEEE Trans. Signal Process. 2008, 56, 3447–3457. [Google Scholar] [CrossRef] [Green Version]
  30. Zhu, Y.; Wang, J.; Liang, S. Multi-Objective Optimization Based Multi-Bernoulli Sensor Selection for Multi-Target Tracking. Sensors 2019, 19, 980. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. The posterior probability density and its approximated probability density of iteration 0: (a) posterior probability density of iteration 0 (b) approximated probability density of iteration 0.
Figure 1. The posterior probability density and its approximated probability density of iteration 0: (a) posterior probability density of iteration 0 (b) approximated probability density of iteration 0.
Electronics 11 00582 g001
Figure 2. The posterior probability density and its approximated probability density of iteration 5: (a) posterior probability density of iteration 5 (b) approximated probability density of iteration 5.
Figure 2. The posterior probability density and its approximated probability density of iteration 5: (a) posterior probability density of iteration 5 (b) approximated probability density of iteration 5.
Electronics 11 00582 g002
Figure 3. Simulated scenario 1.
Figure 3. Simulated scenario 1.
Electronics 11 00582 g003
Figure 4. Estimated target positions for Scenario 1, in which circles represent estimated positions and dotted lines represent true trajectories: (a) Output of the JIPDA filter; (b) output of the EOJIPDA filter.
Figure 4. Estimated target positions for Scenario 1, in which circles represent estimated positions and dotted lines represent true trajectories: (a) Output of the JIPDA filter; (b) output of the EOJIPDA filter.
Electronics 11 00582 g004
Figure 5. Average OSPA distances for Scenario 1. JIPDA* denotes a coalescence-avoiding version of JIPDA, as shown in [16].
Figure 5. Average OSPA distances for Scenario 1. JIPDA* denotes a coalescence-avoiding version of JIPDA, as shown in [16].
Electronics 11 00582 g005
Figure 6. Simulated scenario 2.
Figure 6. Simulated scenario 2.
Electronics 11 00582 g006
Figure 7. Estimated target positions for Scenario 2, in which circles represent estimated positions and dotted lines represent true trajectories: (a) Output of the JIPDA filter; (b) output of the EOJIPDA filter.
Figure 7. Estimated target positions for Scenario 2, in which circles represent estimated positions and dotted lines represent true trajectories: (a) Output of the JIPDA filter; (b) output of the EOJIPDA filter.
Electronics 11 00582 g007
Figure 8. Average OSPA distances for Scenario 2.
Figure 8. Average OSPA distances for Scenario 2.
Electronics 11 00582 g008
Table 1. Existing MTT methods.
Table 1. Existing MTT methods.
JPDA-Based Multi-Target Tracking
ReferenceFilterCharacteristic
[8]JPDAThe number of targets and their initial states are known a priori.
The number of targets remains constant during tracking.
[12]ENNJPDAAfter a measurement-to-target assignment is performed, tracks are only updated by a single measurement.
[13]JPDA*The best data association hypothesis is chosen to calculate the measurement-to-target probabilities.
[10]SJIPDAWhen all hypotheses are combined together for full optimization, the computation burden can be huge.
[10]KLSJPDAThe optimal Gaussian approximations are provided in the Kullback–Leibler sense.
[14]MOJPDAThe cost function is a linear combination of multiple objective functions.
[15]NNSJPDAA pair selection criterion is used for the iterative optimization.
JIPDA-Based Multi-Target Tracking
ReferenceFilterCharacteristic
[9]JIPDAThe number of targets can be unknown and time-varying.
Measurements are used to initiate tracks.
[16]JIPDA*It combines the JIPDA filter with the JPDA* scheme.
The hypothesis events being pruned may contain some useful information.
[11]CCJIPDAIt strongly depends on initializations and improper initializations may result in bad local minima.
RFS Based Algorithms
ReferenceFilterCharacteristic
[18]PHDMoment approximation of the Bayes multi-target filter.
It has no analytical expression for the posterior multi-target density.
[19]CPHDBesides the moment approximation, the filter also propogates the cardinality distribution.
[20]MBA set of multi-Bernoulli parameters are used to characterize the posterior multi-target RFS.
[21]LMBA generalization of the multi-Bernoulli filter.
[22,23]GLMBThe GLMB density is closed under the multi-target prediction and update operations.
JPDA* denotes a coalescence-avoiding version of JPDA, as shown in [13].
Table 2. Number of confirmed targets.
Table 2. Number of confirmed targets.
Clutter RateJIPDAENNJIPDAJIPDA*EOJIPDA
r = 3241287293299
r = 6238281290297
r = 9230279283294
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liang, S.; Zhu, Y.; Li, H. Evolutionary Optimization Based Set Joint Integrated Probabilistic Data Association Filter. Electronics 2022, 11, 582. https://doi.org/10.3390/electronics11040582

AMA Style

Liang S, Zhu Y, Li H. Evolutionary Optimization Based Set Joint Integrated Probabilistic Data Association Filter. Electronics. 2022; 11(4):582. https://doi.org/10.3390/electronics11040582

Chicago/Turabian Style

Liang, Shuang, Yun Zhu, and Hao Li. 2022. "Evolutionary Optimization Based Set Joint Integrated Probabilistic Data Association Filter" Electronics 11, no. 4: 582. https://doi.org/10.3390/electronics11040582

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop