Abstract
In this paper, an adaptive collaborative Gaussian Mixture Probability Hypothesis Density (ACo-GMPHD) filter is proposed for multi-target tracking with automatic track extraction. Based on the evolutionary difference between the persistent targets and the birth targets, the measurements are adaptively partitioned into two parts, persistent and birth measurement sets, for updating the persistent and birth target Probability Hypothesis Density, respectively. Furthermore, the collaboration mechanism of multiple probability hypothesis density (PHDs) is established, where tracks can be automatically extracted. Simulation results reveal that the proposed filter yields considerable computational savings in processing requirements and significant improvement in tracking accuracy.
1. Introduction
In multi-target tracking (MTT) in clutters, the correspondence between the targets and the measurements is unknown, while the target number is unknown and even time-varying. The objective of MTT is to recursively estimate the target number and target states from a sequence of noisy and cluttered measurement sets [,].
One common approach for multi-target tracking is the combination of state estimation and data association, along with track initialization and termination []. In fact, data association and state estimation are coupled issues, i.e., the association risk triggers the measurement misuse and the estimation error increases the association risk. In other words, their direct combination above is in principle not suitable to the high uncertainty case; for example, dense targets/dense clutter [].
Another approach is to apply random finite sets (RFSs) to represent the collection of individual targets and measurements, and hence recast the MTT problem as the Bayesian estimation problem based on finite set statistics so as to avoid data association risk []. However, the propagation of the multi-target posterior probability density function (PDF) is computationally intensive, which stems from the high-dimension integrations in multi-target state space. Mahler [] proposed the first-order moment called the probability hypothesis density (PHD) of the PDF of the random set of state vectors. Vo and Ma [] proved that the PHD surface is a Gaussian mixture (GM) in both the linear and Gaussian cases. Clark and Vo [] analyzed the convergence property of the Gaussian Mixture Probability Hypothesis Density (GMPHD) filter. Up to now, PHD-related applications have been extended to many fields including visual target tracking [], maneuvering target tracking [,], ground target tracking [], extended target tracking [,], and sensor management [].
However, there are still two important but open issues about PHD:
The first is that the computational burden is still too intensive in many actual applications, especially in the case of dense clutters and intensive targets. One possible solution is to discern the measurement originality based on tracking gating [,]. Nevertheless, such a decision still faces mistake risks.
The second issue is that additional track extraction is needed because the standard PHD only outputs the track points without the corresponding track identities. But the presented track extraction algorithm [,] is too complex to implement.
In this paper, we present an adaptive collaborative GMPHD (ACo-GMPHD) filter with the capability for automatic track extraction for fast multi-target tracking in dense clutter. In the ACo-GMPHD, the persistent and birth target PHDs are updated respectively based on the corresponding measurement subsets, instead of based on all measurements, so that the computational complexity is expected to be reduced. Meanwhile, the collaboration mechanism among these PHDs regarding measurement utilization is adaptively established to avoid decision risks triggered by measurement partitions. In addition, permanent tracks and temporary tracks can be automatically extracted from the persistent and birth target PHDs. Simulations show that the proposed ACo-GMPHD greatly reduces the computational cost and significantly improves the track extraction, compared with the well-known GMPHD filter.
2. Problem Formulation
2.1. Additional Gaussian Noise Model
In an MTT scenario, targets appear and disappear randomly. A new target appears in the surveillance region either by spontaneous birth or by spawning from an existing target. The number of the newly-born targets is assumed to be Poisson-distribution. A target may disappear at the next instant. Here, represents the probability that a target corresponding to the state at survives up to . For a target in the surveillance region, its movement is depicted by an additional Gaussian noise model:
define is a Gaussian density function with mean and covariance , so here, , ; One corresponding measurement will be obtained according to the following additional Gaussian noise model:
where is the state mapping for to ; is the covariance of process noise; is the mapping from the state to the measurement; and is the covariance of measurement noise.
Denote as the -th target state, as the j-th measurement, and and as the target number and measurement number, respectively. Now the multi-target states and observation sensor measurements are represented by the random finite sets (RFS) and , respectively. Here, and are the space of all finite subsets of state space and measurement space , respectively. The RFS of the target states is as stated in []:
and the RFS of sensor measurements is:
where is the survival target RFS inherited from the RFS ; is the birth target RFS; is the RFS of the detected target-originated measurements; and is the RFS of clutter.
2.2. The PHD Filter
In the PHD filter, the following common assumptions [] are made:
A.1: each target state evolves and generates one measurement independently;
A.2: any clutter is Poisson distributed and independent of target-originated measurements;
A.3: the predicted multi-target RFS is Poisson distributed and independent.
Given the posterior intensity , the intensity function is:
and the posterior intensity is:
where is the detection probability of an individual target with state ; is the birth target PHD at time ; is the intensity of the clutter RFS.
Lemma 1.
If the multi-target PHD at time is represented as the sum of multiple PHDs with each PHD having the following Gaussian mixture form []:
with
then the predicted PHD will be
with
where
and is the predicted mean; is the predicted covariance.
Lemma 2.
Given the predicted PHD and the measurements , the updated PHD [] is:
with
where
Remark 1.
As shown in the PHD recursions specified by Lemmas 1–2, the output from the PHD filter provides a multimodal density from which we need to estimate the states of the targets at each time, while it does not output target tracks. Moreover, the persistent target PHD and birth target PHD are jointly processed indifferently. In fact, the birth PHD reflects the nature of the birth target and is used for capturing newborn targets while the persistent PHD is updated for track maintenance of the surviving targets. Utilizing their difference is expected to further improve both tracking performance and calculation efficiency. Furthermore, all measurements (most of them are just clutter, for example in sea surveillance and ground tracking) are utilized to update the PHD, and hence most computational resources are wasted. These facts motivated us to establish the adaptive multi-PHD filter framework with track extraction and adaptive processing via both adaptive measurement partition and multi-PHD collaboration.
3. Adaptive Collaborative GMPHD (ACo-GMPHD) Filter
Figure 1 is the ACo-GMPHD framework consists of persistent PHDs, birth PHDs, and pre-persistent PHDs. Here, each PHD is specialized for a certain permanent/new-born/temporary target. In order to improve the computational efficiency, after the prediction of persistent PHDs and pre-persistent PHDs, the measurements in the surveillance area are adaptively partitioned into the persistent measurements and the birth measurements. Furthermore, the persistent PHDs and the pre-persistent PHDs are updated only using the persistent measurements, hence avoiding unnecessary data processing.
Figure 1.
The adaptive collaborative Gaussian Mixture Probability Hypothesis Density (ACo-GMPHD) filter framework.
Remark 2.
One may wonder whether the measurement partition in the ACo-GMPHD filter introduces several decision risks. In fact, the measurements away from the confidence region have little contribution to the persistent targets, and hence the weight of the Gaussian components would not be underestimated in updating the persistent PHD. In other words, the partition of the measurements has nothing to do with updating the persistent targets in setting the large-confidence region. For the birth target, when the confidence region is large, the birth measurements may be possibly partitioned into the persistent measurements, which may lead to missing the birth target. Here the measurement which does not contribute to the update of the persistent PHDs will be introduced into the birth measurement set, which can avoid the birth target missing. In general, adaptive measurement partition is effective as shown in the later simulation.
3.1. Prediction of Persistent PHD
Given the persistent PHD set and the pre-persistent PHD set , the target intensity is represented in the Gaussian mixture form of multiple PHDs:
with
where and denote the i-th persistent PHD and the i-th pre-persistent PHD; and are the corresponding labels; and and are the corresponding deleting thresholds, respectively.
According to Lemma 1, the predicted persistent PHD is:
where
3.2. Prediction of Birth PHDs
According to reference [], we choose the scheme of calculating birth PHD :
with
where , , and are calculated based on the measurements which were not utilized for track update at time .
According to Lemma 1, the predicted birth PHD is:
where
3.3. Measurement Partition
As the integral of the PHD equals the expectation of the target number in the surveillance region, the PHD should be updated by using the target-oriented measurements instead of all the measurements. Different kinds of PHDs such as the persistent PHD and the birth PHD should be updated based on the different measurement sets. Thus, we partitioned the measurement space through utilizing the information of the Gaussian terms.
The innovation covariances of the persistent and pre-persistent PHDs are:
The shortest Mahalanobis distance between a real measurement and the predicted measurement is:
If , then the measurement will be assigned to the persistent measurement set , where the threshold denotes the quantile of the upper-tail of a chi-squared distribution with degrees of freedom [], where is the measurement dimension.
The birth measurement set is
3.4. Update of Persistent PHD
According to Lemma 2, the persistent PHD is updated based on the persistent measurement set :
with
where is the clutter intensity in the survival region; ; ; ; and .
The corresponding measurement weight of the persistent measurement is:
The measurement set for updating the birth PHDs is defined as:
where is the threshold for selecting the invalid measurements. Now the birth measurement set contains two parts:
The integrals of the persistent and pre-persistent PHDs are:
Denote the persistent PHD index set by and the pre-persistent PHD index set by . The invalid persistent and pre-persistent PHD index sets are:
where is the upper-bound threshold of the weight of the invalid PHD. The invalid PHDs are treated as the additional birth PHDs in the following processing.
3.5. Update of Birth PHDs
For any birth PHD, its prediction is:
with
where represents the cardinality of the persistent targets; represents the cardinality of the invalid persistent targets.
According to Lemma 2, the birth PHDs are updated using the birth measurements :
where is the clutter intensity in the birth region.
Then the weight of the birth measurement and the integral of the birth PHD are calculated as:
and the invalid measurement set is constructed:
Denote as the number of birth PHDs at the next time step.
3.6. PHDs Management
3.6.1. Birth PHDs Management
If a birth PHD has a large enough weight, such as , it can be reclassified as a pre-persistent PHD. Then, the pre-persistent PHD set is augmented by in the birth PHD set .
3.6.2. Pre-Persistent PHDs Management
If a pre-persistent PHD has a large enough weight, such as , it can be reclassified as a persistent PHD. Then, the persistent PHD set is augmented by in the pre-persistent PHD set .
3.6.3. Persistent PHDs Management
A persistent PHD with a large enough large weight, for example , is outputted as the stable track. Otherwise, if up to successive time instants, then such a persistent PHD is considered as the terminated track.
3.7. Birth Intensity Design
Here we adopt the strategy previously described in reference [] as follows. A one-step initialization method is utilized to select the reliable birth intensity components for the next time step. The measurements near the current multi-target states are deleted to reduce the unnecessary birth intensity components. Without velocity information, the a priori velocity is zero-mean and has the covariance determined based on the maximum expected velocity (For more details, see reference []). The invalid measurement set is assigned to determine the birth PHD at time :
with
where the Gaussian term weight is calculated according to reference []; is an M-by-M identity matrix; and is the cardinality of the measurement set .
3.8. Output Persistent PHD
At different times, the Gaussian terms with the same label represent the same target. The output track information at time is the state and covariance of the persistent PHDs respectively:
Remark 3.
The analysis for the complexity of the ACo-GMPHD is an open issue due to the measurement partition is random. In principle, the ACo-GMPHD and the standard GM-PHD have the similar process flowchart and hence their calculation burden is similar. Differing from the standard GM-PHD, the ACo-GMPHD partitions all measurements into smaller sets and separately processes them. Since the computational complexity of the standard GM-PHD increases exponentially with respect to the number of the related measurements, the ACo-GMPHD is expected to be more cost-efficient, which coincides with the simulation result.
4. Simulation Analysis
To verify the systematic performance of the ACo-GMPHD filter, we compared it with the standard GMPHD filter which utilizes a priori birth target intensity and the GMPHD-I filter [] via an MTT simulation scenario, similar to reference []. The difference is that six targets are considered here, instead of the three targets in reference []. The initial states, appearance, and disappearance of each target are given in Table 1. True trajectories are shown in Figure 2.
Table 1.
A List of Initial Target States.
Figure 2.
Trajectories of the true targets and the clutters.
The detailed scenario parameters are given in Table 2.
Table 2.
The Settings of the Simulation Scenario.
Priori birth target intensity is provided for the standard GMPHD filter with , , and .
We used a performance evaluation metric called the optimal subpattern assignment (OSPA) distance, which is specialized for the MTT filter accuracy test []. We selected OSPA parameters: and .
We ran 100 Monte Carlo (MC) trials for each filter to obtain the OSPA distance and the averaged computational cost, and obtained the track-valued estimates in one MC trial. In addition, we validated the performance of each filter in the case of different clutter densities.
Figure 3 and Figure 4 show the Monte Carlo average of the OSPA distance with detection probabilities of 0.9 and 0.7, respectively. Compared with the other two filters, the ACo-GMPHD almost always had the lowest OSPA distance, reflecting the effectiveness of the proposed adaptive multi-PHD collaboration and measurement partition.
Figure 3.
Monte Carlo average of the OSPA distance with a detection probability of 0.9.
Figure 4.
Monte Carlo average of the OSPA distance with a detection probability of 0.7.
As shown in Figure 3 and Figure 4, there are five OSPA peaks in the ACo-GMPHD at times 20, 50, 60, 70, and 80 s, corresponding to the target appearances and disappearances, respectively. Some peaks are even higher than that of the standard GMPHD, and are always smaller than that of the GMPHD-I. The explanation for this is that:
- the ACo-GMPHD does not utilize a priori information of the birth target. At the moment that a target appears, the clutter and birth target measurements are hardly distinguishable without the support of the subsequent measurements. Thus, the birth target measurements may be treated as the clutter, and hence possibly leads to a delay in the cardinality estimation, as shown in Figure 5 when a target is newly born, which causes the peak of the OSPA distance. This is the cost of the measurement partition.
Figure 5. Monte Carlo average estimates of the number of targets. Estimated number (solid lines), standard deviation (dashed lines). - the GMPHD-I also does not utilize a priori information of the birth target. However, due to the absence of adaptation and collaboration compared with the ACo-GMPHD, the GMPHD-I is the worst regarding the OSPA measure.
Furthermore, we present the time-averaged OSPA versus the clutter density in Figure 6. With the increase of clutter density, the OSPA distance of the ACo-GMPHD filter gradually increases, but it is still lower than that of other two comparison algorithms.
Figure 6.
Time-averaged OSPA distance in one run of each filter for varying clutter densities.
For each time step, the averaged computation time (ACT) is shown in Figure 7. Obviously, the ACo-GMPHD filter significantly decreased the computational burden, compared with the standard PHD or GMPHD-I filters. The ACT of the ACo-GMPHD filter is about 0.65 s, much smaller than the measurement sampling period of 1 s.
Figure 7.
The computation time of the three filters.
Figure 8 plots the curves of the ACT versus the clutter density. As the clutter density increases, the ACTs of all the filters increase; however, the ACo-GMPHD filter has the lowest rate of increase, implying that it is more suitable for the dense clutter case.
Figure 8.
The time-averaged computation time under different clutter densities.
5. Conclusions
In this paper, we proposed the ACo-GMPHD filter with automatic track extraction, which was shown to be satisfactory for multi-target tracking. It costs less computational time and has better OSPA, except for some undesirable peaks at the moment of birth targets appear. Hence, one possible avenue for future research is to introduce priori information about birth targets, which would be helpful in order to better discern the target and the clutter, and hence more effectively reduce the corresponding OSPA peaks. Additionally, the threshold at the step of PHDs management was considered as constant in the proposed filter, and a possible future research study is to adaptively choose the threshold under some optimal performance index.
Acknowledgments
The authors would like to acknowledge the support of National Natural Science fund of China, No. 61135001, 61374159 and 61374023.
Author Contributions
Feng Yang and Yongqi Wang conceived of, designed and performed the simulations and wrote the manuscript. Hao Chen, Pengyan Zhang and Yan Liang reviewed the manuscript.
Conflicts of Interest
The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.
References
- Blackman, S.S.; Popoli, R. Design and Analysis of Modern Tracking Systems; Artech House: Norwood, MA, USA, 1999. [Google Scholar]
- Bar-Shalom, Y.; Li, X.R. Multitarget Multisensor Tracking: Principles and Techniques; YBS Publishing: Storrs, CT, USA, 1995. [Google Scholar]
- Bar-Shalom, Y. Tracking and Data Association; Academic Press: Orlando, FL, USA, 1988. [Google Scholar]
- Mahler, R.P.S. Statistical Multisource-Multitarget Information Fusion; Artech House, Library: Norwood, MA, USA, 2007. [Google Scholar]
- Mahler, R.P.S. Multitarget Bayes filtering via first-order multitarget moments. IEEE Trans. Aerosp. Electron. Syst. 2003, 39, 1152–1178. [Google Scholar] [CrossRef]
- Vo, B.N.; Ma, W.K. The Gaussian mixture probability hypothesis density filter. IEEE Trans. Signal Process. 2006, 54, 4091–4104. [Google Scholar] [CrossRef]
- Clark, D.; Vo, B.N. Convergence analysis of the Gaussian mixture PHD filter. IEEE Trans. Signal Process. 2007, 55, 1204–1212. [Google Scholar] [CrossRef]
- Pollard, E.; Plyer, A.; Pannetier, B.; Champagnat, F.; Besnerais, G.L. GM-PHD filters for multi-object tracking in uncalibrated aerial videos. In Proceedings of the 12th International Conference on Information Fusion, Seattle, WA, USA, 6–9 July 2009.
- Zhang, Q.; Song, T.L. Improved Bearings-Only Multi-Target Tracking with GM-PHD Filtering. Sensors 2016, 16, 1469. [Google Scholar] [CrossRef] [PubMed]
- Dong, P.; Jing, Z.L.; Li, M.Z.; Pan, H. The variable structure multiple model GM-PHD filter based on likely-model set algorithm. In Proceedings of the 19th International Conference on Information Fusion, Heidelberg, Germany, 5–8 July 2016; pp. 2289–2295.
- Wu, W.H.; Liu, W.J.; Jiang, J.; Gao, L.; Wei, Q.; Liu, C.Y. GM-PHD filter-based multi-target tracking in the presence of Doppler blind zone. Digit Signal Process 2016, 52, 1–12. [Google Scholar] [CrossRef]
- Dai, B.; Li, C.Y.; Ji, H.B.; Hu, Y. Iterative-Mapping PHD filter for extended targets tracking. In Proceedings of the 2015 International Conference on Control. Automation and Information Sciences, Changshu, China, 29–31 October 2015; pp. 85–88.
- Granstrom, K.; Orguner, U. A PHD filter for tracking multiple extended targets using random matrices. IEEE Trans. Signal Process. 2012, 60, 5657–5671. [Google Scholar] [CrossRef]
- Mahler, R.P.S.; Elfallah, A. Unified sensor management in unknown dynamic clutter. Soc. Photo-Opt. Instrum. Eng. SPIE Process. 2010, 7698, 11–12. [Google Scholar]
- Macagnano, D.; De-Abreu, G.T.F. Adaptive gating for multitarget tracking with Gaussian mixture filters. IEEE Trans. Signal Process. 2012, 60, 1533–1538. [Google Scholar] [CrossRef]
- Li, T.; Sun, S.D.; Sattar, T.P. High-speed Sigma-gating SMC-PHD filter. Signal Process. 2013, 93, 2586–2593. [Google Scholar] [CrossRef]
- Li, Y.X.; Xiao, H.; Song, Z.Y.; Fan, H.Q.; Hu, R. Joint multi-target filtering and track maintenance using improved labeled particle PHD filter. In Proceedings of the IEEE International Congress on Image and Signal Processing (CISP), Datong, China, 14–16 October 2014; pp. 1136–1140.
- Panta, K.; Vo, B.N.; Singh, S. Novel data association schemes for the probability hypothesis density filter. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 556–570. [Google Scholar] [CrossRef]
- Vo, B.T.; Vo, B.N.; Cantoni, A. Analytic implementations of the cardinalized probability hypothesis density filter. IEEE Trans. Signal Process. 2007, 55, 3553–3567. [Google Scholar] [CrossRef]
- Ju, H.Y.; Du, Y.K.; Bae, S.H.; Shin, V. Joint initialization and tracking of multiple moving objects using doppler information. IEEE Trans. Signal Process. 2011, 59, 3447–3452. [Google Scholar]
- Musicki, D. Doppler-aided target tracking in heavy clutter. In Proceedings of the 13th International Conference on Information Fusion, Edinburgh, UK, 26–29 July 2010.
- Schuhmacher, D.; Vo, B.T.; Vo, B.N. A consistent metric for performance evaluation of multi-object filters. IEEE Trans. Signal Process. 2008, 56, 3447–3457. [Google Scholar] [CrossRef]
© 2016 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/).