Next Article in Journal
Comparison of Spectral Reflectance-Based Smart Farming Tools and a Conventional Approach to Determine Herbage Mass and Grass Quality on Farm
Previous Article in Journal
Evaluation of Remote Sensing and Reanalysis Snow Depth Datasets over the Northern Hemisphere during 1980–2016
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

A Priority Data Association Policy for Multitarget Tracking on Intelligent Vehicle Risk Assessment

1
School of Automotive Studies, Tongji University, Shanghai 201804, China
2
Clean Energy Automotive Engineering Centre, Tongji University, Shanghai 201804, China
3
Postdoctoral Station of Mechanical Engineering, Tongji University, Shanghai 201804, China
4
School of Mechatronics and Vehicle Engineering, East China Jiaotong University, Nanchang 330013, China
5
Key Laboratory of Conveyance and Equipment Ministry of Education, East China Jiaotong University, Nanchang 330013, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2020, 12(19), 3255; https://doi.org/10.3390/rs12193255
Submission received: 1 September 2020 / Revised: 23 September 2020 / Accepted: 5 October 2020 / Published: 7 October 2020

Abstract

:
In order to conduct risk assessment for collision-free decision making of intelligent vehicles in a complex road traffic environment, it is essential to conduct stable tracking and state estimation of multiple vehicle targets. Therefore, this paper proposes a multitarget tracking method in line with the priority data association rule. Firstly, a standard coordinate turn process model is deduced as the existence of translation and rotation of the vehicle on the two-dimensional ground plane. Secondly, an unscented Kalman filter algorithm is developed due to the nonlinear radar measurement model. Thirdly, a priority data association rule, which puts the targets in a priority queue according to the number of times they are associated, is designed to filter out noise, given that it is unlikely for a vehicle target as an inertial system to appear or disappear instantly in practice. In addition, the data association rule specifies that the closer the target is to the front of the queue, the more prioritized the association with the newly observed target would be. Finally, the track management algorithm is constructed. On this basis, a series of real vehicle tests were conducted on real roads with four typical scenarios. According to the test results, the proposed algorithm is effective in filtering out noise and is suboptimal as the nearest neighbor data association.

Graphical Abstract

1. Introduction

Due to the rapid development of artificial intelligence [1], sensor technology [2], computing systems [3], and so on, intelligent driving technology has advanced significantly over the most recent decades [4]. Taking into account the massive potential of intelligent vehicles in alleviating traffic congestion, improving road safety and reducing the emissions of air pollutants [5,6], many universities and enterprises have been increasing their efforts on the development and application of this technology, such as Waymo [7], Apollo [8], and Momenta [9].
However, the frequent occurrence of accidents [10] and complaints made by passengers [11] suggest that there remain various problems needing to be solved for the absolute safety of autonomous driving [12]. One of them is how to keep track of multiple traffic targets effectively for the accuracy of risk assessment, based on which sensible decisions can be taken to avoid the prospect of collisions or false alarms [13,14]. Popular works in multitargets tracking follow a scheme composed of four parts: a motion model, a state estimation algorithm, a data association method, and track management [15]. Purposed to describe the behaviors of the target vehicle, the motion model consists of a process model and measurement model, both of which could be either linear or nonlinear [16,17]. The most commonly used motion models for target dynamics include constant velocity (CV) [18], constant acceleration (CA) [19], and constant coordinate turn (CT) [20]. As for the state estimation algorithm, the premise of its design lies in whether the motion model is linear or nonlinear. If the motion model (both the process model and measurement model) is linear, the Kalman filter can be applied in practice [21]. If the process model or the measurement model are nonlinear, however, it is necessary to consider extended Kalman filtering [22] or unscented Kalman filtering [23]. With regard to the data association method, the nearest neighbor data association (NNDA) [24], the probabilistic data association (PDA) [25], and the joint probabilistic data association (JPDA) [26] algorithms have been developed. In respect to track management, there are three key processes involved, namely track update, track dieout, and track initiation [27]. By applying a millimeter wave radar for a collision warning system, Lee et al. [28] conducted a study on the target recognition and tracking algorithm of different radar signals, based on which a multi-target detection and tracking algorithm was proposed in combination with a Kalman filter. Schuster at al. [29] used a set of millimeter wave radars to detect adjacent lanes of vehicles, based on the different positions of radar signals, manage track (such as track creation, track update and track deletion), at the same time as tracking the vehicle’s motion state and geometrical size. The method for real target tracking and recognition is relatively accurate for size, but millimeter wave radars will capture multiple false targets and fail to achieve accurate estimations due to many noise signals being tracked [29].
In order to filter out noise signals at the time of multi-target tracking, this paper proposes a novel multi-target tracking method within the framework of the priority data association rule for intelligent vehicles fitted with a millimeter-wave radar system. This approach is innovative in making use of prior information that a vehicle target as an inertial system cannot appear or disappear instantaneously. On the one hand, the introduction of prior information can help filter out noise. On the other hand, the suboptimal data association is preserved. To put the proposed method into practice, some efforts were made as follows. Firstly, to describe the track problem, the stochastic system was exemplified as a standard coordinate turn (CT) process model and a radar nonlinear measurement model, and the CT model was deduced as the existence of translation and rotation of the vehicle on the two-dimensional ground plane. Secondly, since the radar measurement model is nonlinear, an unscented Kalman filter algorithm was applied. Thirdly, to make full use of prior information on the object that a vehicle target as an inertial system cannot appear or disappear instantaneously, the historical tracking data was ranked by the number of times the target got associated before being classified into four scenarios, namely Unclassified, Candidate, Activation, and Dieout. The transition between different scenarios was managed using a finite state machine. Additionally, all targets were sorted out as a priority queue according to the number of times they were associated, based on which the data association rule was developed that the closer the target is to the front of the queue, the more prioritized the association with the newly observed target would be. Finally, a track management algorithm was developed in combination with all the formulas and rules. The performance of the proposed method was verified via real-world tests under the four typical scenarios as mentioned above.
This article is organized as follows. Section 2 presents the problem formulation, which describes the derivation process of the coordinate turn process model, radar nonlinear measurement model, and unscented Kalman filter. Section 3 introduces the priority data association rule and track management algorithm. In Section 4, the performance evaluation results are shown and the impact of the proposed method on four typical scenarios is discussed, based on which a comparison is drawn with the nearest neighbor data association. Section 5 concludes the paper by summarizing the findings made in this study.

2. Problem Formulation

For the tracking of multiple vehicle objects, a stochastic system was developed. Given the translation and rotation of the vehicle on the two-dimensional ground plane, a standard coordinate turn process model was constructed. Apart from that, a standard nonlinear measurement model is regarded as taking the characteristics of radar into account. Finally, an unscented Kalman filter algorithm was developed to address the approximation issues encountered by the extended Kalman filter [30,31,32,33].

2.1. Stochastic System

According to the study of Beomjun and Li [13,14], a general format for a stochastic system of vehicle object during the sampling period (k, k + 1) is expressed as follows:
{ X ( k + 1 ) = f ( X ( k ) , u ( k ) ) + w ( k ) Y ( k ) = h ( X ( k ) , u ( k ) ) + v ( k ) ,
where X(.) represents the state vector of the vehicle object, u(.) indicates the input vector, f(.) and h(.) refer to the linear or nonlinear functions, respectively, Y(.) denotes the measurement vector, w(.) means the process noise, and v(.) stands for measurement noise. Both w(.) and v(.) are mutually uncorrelated zero-mean white Gaussian noise with covariances Q and R, respectively.

2.2. Coordinate Turn Process Model

The vehicle target movement in the two-dimensional ground plane is comprised mainly of two degrees of freedom and one degree of free rotation. It is assumed that the accelerations in the steady state are quite slight; linear accelerations or decelerations can be rationally described by process noise w with a constant velocity [34] and the constant rotation. Based on the above assumptions, the constant coordinate turn (CT) motion could be written as follows:
X = [ x y x ˙ y ˙ ω ] T ,
where (x, y) represents vehicle target position, ( x ˙ , y ˙ ) indicates the translational velocity of the two horizontal axes, and ω refers to the rotary motion in the vertical direction.
The recursive relation of vehicle position from time k to time k + 1 is expressed as:
{ x ( k + 1 ) = x ( k ) + x ˙ ( k ) T + 1 2 σ x T y ( k + 1 ) = y ( k ) + y ˙ ( k ) T + 1 2 σ y T ,
where σ x represents velocity noise covariance in the x axis, σ y refers to velocity noise covariance in the y axis, and T denotes the sampling period.
Likewise, the velocity transfer relation is expressed as:
{ x ˙ ( k + 1 ) = x ˙ ( k ) T + σ x T y ˙ ( k + 1 ) = y ˙ ( k ) T + σ y T .
From the geometric relations, it can be known that the rotary motion satisfies the following equations:
{ v = x ˙ ( k ) 2 + y ˙ ( k ) 2 x ˙ ( k + 1 ) = v cos θ ( k ) y ˙ ( k + 1 ) = v sin θ ( k ) ω ( k ) = θ ˙ ( k ) .
According to Equations (5), the following differential formulas can be obtained:
{ x ¨ ( k + 1 ) = y ˙ ( k ) ω ( k ) y ¨ ( k + 1 ) = x ˙ ( k ) ω ( k ) .
Finally, with Formulas (3)–(6) combined, the constant coordinate turn (CT) process model is obtained as:
[ x ( k + 1 ) y ( k + 1 ) x ˙ ( k + 1 ) y ˙ ( k + 1 ) ω ( k + 1 ) ] = [ 1 0 sin ( ω ( k ) T ) ω ( k ) cos ( ω ( k ) T ) 1 ω ( k ) 0 0 1 1 cos ( ω ( k ) T ) ω ( k ) sin ( ω ( k ) T ) ω ( k ) 0 0 0 cos ( ω ( k ) T ) sin ( ω ( k ) T ) 0 0 0 sin ( ω ( k ) T ) cos ( ω ( k ) T ) 0 0 0 0 0 1 ] [ x ( k ) y ( k ) x ˙ ( k ) y ˙ ( k ) ω ( k ) ] + [ T 2 2 0 0 0 T 2 2 0 T 0 0 0 T 0 0 0 1 ] [ σ x σ y σ ω ] ,
where σ ω represents the covariance of rotation-induced noise, so that the state transition matrix of the system A(k) and process noise distribution matrix Γ ( k ) are expressed as:
A ( k ) = [ 1 0 sin ( ω ( k ) T ) ω ( k ) cos ( ω ( k ) T ) 1 ω ( k ) 0 0 1 1 cos ( ω ( k ) T ) ω ( k ) sin ( ω ( k ) T ) ω ( k ) 0 0 0 cos ( ω ( k ) T ) sin ( ω ( k ) T ) 0 0 0 sin ( ω ( k ) T ) cos ( ω ( k ) T ) 0 0 0 0 0 1 ] ,       Γ ( k ) = [ T 2 2 0 0 0 T 2 2 0 T 0 0 0 T 0 0 0 1 ] .

2.3. Radar Nonlinear Measurement Model

The radar system is applied to track the target in the polar coordinate system, based on which the radial distance r(k) and azimuth angle φ(k) of the target are output. Combined with the position (x, y) in the rectangular coordinate system, the measurement model is constructed as follows:
Y ( k ) = [ r ( k ) φ ( k ) ] = h ( X ( k ) , u ( k ) ) = [ x ( k ) 2 + y ( k ) 2 arctan y ( k ) x ( k ) ] .

2.4. Unscented Kalman Filter

According to the measurement model (8), the filter is definitely capable of dealing with nonlinearity, as radar tracking is a nonlinear system. In this case, an unscented Kalman filter (UKF) is applicable. The core idea of a UKF is to rely on the unscented transform (UT) for sampling a set of deterministic sigma points that capture the mean and covariance of the original distribution of the target state.
For the specified mean target state Xm and covariance P, the sigma points are sampled in line with the following rules:
{ X ( 0 ) = X m , i = 0 X ( i ) = X m + ( ( n + λ ) P ) ( i ) , i = 1 ~ n X ( i ) = X m ( ( n + λ ) P ) ( i ) , i = n + 1 ~ 2 n ,
where X(i) represents the i-th sigma point state, n indicates the dimension of the state, λ denotes the scale with formula λ = α2(n + κ) − n, α (0 ≤ α ≤ 1) refers to a scaling parameter that determines the spread of the sigma points that are supposed to be ideally a small number, and κ stands for the other tuning parameter. The condition κ ≥ 0 must be satisfied to ensure that the covariance matrix is positive semidefinite [30].
The weight of these sigma points is determined using the following equations:
{ w m ( 0 ) = λ n + λ , i = 0 w c ( 0 ) = 1 n + λ + ( 1 α 2 + β ) , i = 0 w m ( i ) = w c ( i ) = 1 2 ( n + λ ) , i = 1 ~ 2 n ,
where w m ( i ) represents the i-th sigma weight for the mean target state, w c ( i ) indicates the i-th sigma weight for covariance, and β (β ≥ 0) denotes weight parameter.
The process of running the proposed unscented Kalman filter algorithm is detailed below.
(1)
Initialization: Parameters λ, w m ( i ) , w c ( i ) , Q, and R are chosen for a given initiation state X(0|0), covariance P(0|0), A(0), and Γ(0). If k ≥ 1, the following steps are taken:
(2)
Step 1: state prediction:
X ( k + 1 | k ) = A ( k ) X ( k | k ) ,
(3)
Step 2: covariance prediction:
P ( k + 1 | k ) = A ( k ) P ( k | k ) A ( k ) T + Γ ( k ) Q Γ ( k ) T ,
(4)
Step 3: generate sigma points:
X ( i ) ( k + 1 | k ) = [ ( X ( k + 1 | k ) ) T ( X ( k + 1 | k ) + ( n + λ ) P ( k + 1 | k ) ) T ( X ( k + 1 | k ) ( n + λ ) P ( k + 1 | k ) ) T ] ,
(5)
Step 4: measurement prediction based on sigma points:
Y ( i ) ( k + 1 | k ) = h ( X ( i ) ( k + 1 | k ) ) ,
(6)
Step 5: mean measurement prediction:
Y m ( k + 1 | k ) = i = 0 2 n w m ( i ) ( k + 1 | k ) Y ( i ) ( k + 1 | k ) ,
(7)
Step 6: mean measurement covariance prediction:
P z z ( k + 1 | k ) = i = 0 2 n w c ( i ) ( k + 1 | k ) [ Y ( i ) ( k + 1 | k ) Y m ( k + 1 | k ) ] [ Y ( i ) ( k + 1 | k ) Y m ( k + 1 | k ) ] T + R ,
P x z ( k + 1 | k ) = i = 0 2 n w c ( i ) ( k + 1 | k ) [ X ( i ) ( k + 1 | k ) X ( k + 1 | k ) ] [ Y ( i ) ( k + 1 | k ) Y m ( k + 1 | k ) ] T ,
(8)
Step 7: calculate Kalman gain:
K ( k + 1 ) = P x z ( k + 1 | k ) [ P z z ( k + 1 | k ) ] 1 ,
(9)
Step 8: update state estimation:
X ( k + 1 | k + 1 ) = X ( k + 1 | k ) + K ( k + 1 ) [ Y ( k + 1 ) Y m ( k + 1 | k ) ] ,
(10)
Step 9: update covariance estimation:
P ( k + 1 | k + 1 ) = P ( k + 1 | k ) K ( k + 1 ) P z z ( k + 1 | k ) [ K ( k + 1 ) ] T ,

3. Multitarget Tracking

In general, multitarget tracking involves two critical steps, namely data association and track management. The former is purposed to match the newly observed data with historical data, thus keeping target tracking updated, whereas the latter is aimed at updating the trajectory of the target according to the certainty rules, which could mainly consists of either the start, maintenance, or end of the tracking trajectory, corresponding to the entry, maintenance, and departure of the target.

3.1. Priority Data Association Policy

Conventional data association methods, such as nearest neighbor data association (NNDA), probabilistic data association (PDA), and joint PDA (JPDA) algorithms, commonly rely on the spatial distance relationship of the target, but without using prior information on the target, which leads to noise data being treated as the real target. Considering that a target vehicle as an inertial system is unlikely to appear or disappear instantly, the number of times the target is associated can be taken as prior information, and historical data can be ranked, with priority given to the data that were continuously observed for the highest number of times and the latest data, which allows the tracking process to be described by a finite state machine for each target tracked, as shown in Figure 1. All targets in different stages of tracking are categorized into four types, namely Unclassified, Candidate, Activation, and Dieout. The transfer process of target type is as following: the process from the Unclassified target to the Candidate target corresponds to the candidate initial stage, the process from the Candidate target to the activation target corresponds to the track initiation stage, and the process from other types of targets to the Dieout target corresponds to the dieout stage.
Furthermore, targets of different types are combined into a priority queue according to prior information on the number of times of association, as shown in Figure 2. At the beginning of each tracking cycle, the order of precedence associated with the new observed data is set as: Activation targets, Candidate targets, and Unclassified targets. Similarly, for the targets of the same type, the priority associated with the new data is also ranked by the number of successful associations. In each tracking cycle, each type of target accumulates the number of successful association counts, which means the count is increased by 1 if the association is successful, and otherwise the count is reduced by 1. Additionally, targets of different types rely on different sliding time windows; for example, the maximum sliding time window of an Unclassified target is NM, which means that the Unclassified target will disappear when the cumulative number of unassociated times reaches NM + 1 and the Unclassified target type is converted into a Candidate target once the target association is successful, with the count being 1. If the Candidate target is successfully correlated for M consecutive times, the target state is shifted to the Activation state and the count is 1. If the Candidate target is not associated for M times in a row, however, the candidate target will disappear.

3.2. Track Management

Combining the finite-state machine illustrated in Figure 1 and priority data association rule shown in Figure 2, the complete technical route to track management is presented in Algorithm 1.

4. Discussion

The proposed multitarget algorithm was implemented with ESR radar as the basis, and a series of real-world vehicle tests were conducted to verify the algorithm. As shown in Figure 3, one host vehicle (the white car at the back) and two target vehicles (the two cars in the front) were involved in the tests. All of the vehicles were equipped with an OxTS high-precision positioning system applied to record the position of the vehicle in real time. As shown in Figure 4, there were four typical scenarios put to test, including:
(1)
Scenario 1: the host vehicle is stationary and the two target vehicles drive on a straight route;
(2)
Scenario 2: the car is stationary, target car #1 changes lanes, and target car #2 drives on a straight route;
(3)
Scenario 3: the host vehicle drives on a straight route and the two target cars drive on a straight route;
(4)
Scenario 4: the host vehicle drives on a straight route, target car #1 changes lanes, and target car #2 drives on a straight route.
Algorithm 1. Pseudocode of track management.
Input:  dnew: the new detected data by radar
Data:  Tuo: the Unclassified targets from the last cycle
     Tco: the Candidate targets from the last cycle
     Tao: the Activation targets from the last cycle
Output: Tun: the updated Unclassified targets
    Tcn: the updated Candidate targets
    Tan: the updated Activation targets
begin
  if dnew is empty
    if system is not initiation
     if Tuo is nonempty
       Ttp ← Unclassified_accumulation (Tuo)
       Tun ← Unclassified_dieout (Ttp)
     end
     if Tco is nonempty
       Ttp ← Candidate_accumulation (Tco)
       Tcn ← Candidate_dieout (Ttp)
     end
     if Tao is nonempty
       Ttp ← Track_dieout (Tao)
       Tcn ← Track_supplement (Ttp)
     end
   else
     Tun ← empty;   Tcn ← empty;   Tan ← empty
   end
  else
    if system is not initiation
     if Tao is nonempty
       Ttp ← Track_update (Tao, dnew)
       Tttp ← Track_dieout (Ttp)
       Tant ← Track_supplement (Tttp)
    end
    if Tco is nonempty
       Tantt, Ttp ← Track_initiation (Tco, dnew)
       Tttp ← Candidate_accumulation (Ttp)
       Tcnt ← Candidate_dieout (Tttp)
    end
    if Tuo is nonempty
       Tcntt, Ttp ← Unclassified_accumulation (Tuo, dnew)
       Tun ← Unclassified_dieout (Ttp)
    end
   else
     Tun ← Unclassified_accumulation (dnew)
     Tcn ← empty
     Tan ← empty
   end
   Tcn = Tcnt + Tcntt;   Tan = Tant + Tantt
  end
Tuo = Tun;   Tco = Tcn;  Tao = Tan
end
In order to verify the performance of the proposed algorithm, the nearest neighbor data association (NNDA) was adopted as a comparison algorithm; it is the most widely used and suboptimal Bayesian algorithm [24]. As both algorithms rely on a coordinate turn process model and an unscented Kalman filter, the proposed method is denoted as priority data association policy for coordinate turn process model with unscented Kalman filter (PDAP-CT-UKF) and the compared algorithm is denoted by nearest neighbor data association for coordinate turn process model with unscented Kalman filter (NNDA-CT-UKF). The root-mean-square error (RMS) and the mean value of RMS (MRMS) are taken as the index used to assess the performance in tracking real targets, while the total tracked targets are taken as the index used to evaluate the performance in filtering fake targets. As shown in Figure 5, Figure 6, Figure 7 and Figure 8, the region-of-interest (ROI), both ESR ROI and Lane ROI, is used to filter out targets, which beyond the ROI. Both PDAP-CT-UKF and NNDA-CT-UKF performed well in tracking multiple targets and had the same RMS, which means the proposed method (PDAP) and the NNDA are suboptimal in the four typical scenarios in real-time. The tracking data are listed in Table 1. According to the MRMS results, both the PDAP and NNDA showed suboptimal results. Compared with NNDA, however, the total number of targets tracked by PDAP was smaller, which means the proposed algorithm has the capability to filter noise. However, both for NNDA and PDAP, the total number of tracked targets was significantly greater than the number of real targets, which means there should be only two real targets, target #1 and target #2. This suggests that there remains room for the algorithm to be improved significantly.

5. Conclusions

Aiming to improve the performance of multi-target tracking for risk assessment by intelligent vehicles, a priority data association rule was developed. In the rule, to filter out unwanted noise, the number of times that the target is associated is taken as prior information, and the tracking process is described by a finite state machine for each target tracked. Different types of targets are combined into a priority queue according to prior information on the number of times of association, based on which a rule was developed that the further in the queue the target is, the more prioritized the data association would be. Given that the movement of vehicles targeted in the two-dimensional ground plane is comprised mainly of two degrees of freedom and one degree of free rotation, a constant coordinate turn process model was constructed. Due to the nonlinear measurement model, an unscented Kalman filter was developed and applied.
Based on ESR radar, the proposed multi-target algorithm was implemented. Furthermore, real-world vehicle tests were conducted. Four typical scenarios were examined, with the nearest neighbor data association (NNDA) method applied as a comparison algorithm. As indicated by the test results, the proposed algorithm is effective in filtering out noise but is suboptimal in multitargets tracking, similarly to the NNDA.
In the future, our research will be focused on integrating multisensory information, such as lidar and machine vision, to further filter out noise. Due to multi-sensor fusion, the tracking algorithm will be verified and an improvement strategy will be designed. Further research into applications for risk assessment, such as decision making and emergency control, will be conducive to the development of intelligent vehicles.

Author Contributions

Conceptualization, Z.Y., L.X., D.Z., P.X., and Z .L. (Zhiqiang Li); methodology, D.Z., P.X., and Z.L. (Zhiqiang Li); software, D.Z.; validation, D.Z., P.X., and Z.L. (Zhiqiang Li); formal analysis, D.Z., P.X., and Z.L. (Zhiqiang Li); investigation, D.Z., P.X., and Z.L. (Zhiqiang Li); resources, D.Z., P.X., and Z.L. (Zhiqiang Li); data curation, D.Z., P.X., Z.L. (Zhuoren Li), Z.Q., H.X., P.F., P.Z., B.L., Z.F., and Q.C.; writing—original draft preparation, D.Z.; writing—review and editing, P.Z., B.L., and Z.F.; visualization, D.Z.; supervision, Z.Y., and L.X.; project administration, Z.Y., and L.X.; funding acquisition, Z.Y., and L.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Fundamental Research Funds for the Central Universities (grant no. 22120190205); the National Key Research and Development Program of China (grant no. 2018YFB0105101; grant no. 2018YFB0105103); the National Natural Science Foundation of the People’s Republic of China (grant no. 51975414); the Research on Test and Evaluation Methods of ADAS and Standard-Setting (grant no. GYQJ-2017-4-08).

Acknowledgments

The authors would like to express their appreciation to Yishi Lu and Xing Yang in our laboratory for their valuable support in the tests. The authors also thank the assistance from other people of the School of Automotive Studies, Tongji University, the Clean Energy Automotive Engineering Center, Tongji University, and the School of Mechatronics and Vehicle Engineering, East China Jiaotong University, China.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. De Marvao, A.; Dawes, T.J.; Howard, J.P.; O’Regan, D.P. Artificial intelligence and the cardiologist: What you need to know for 2020. Heart 2020, 106, 399–400. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Javanmardi, E.; Gu, Y.; Javanmardi, M.; Kamijo, S. Autonomous vehicle self-localization based on abstract map and multi-channel LiDAR in urban area. IATSS Res. 2019, 43, 1–13. [Google Scholar] [CrossRef]
  3. Maggipinto, M.; Terzi, M.; Masiero, C.; Beghi, A.; Susto, G.A. A computer vision-inspired deep learning architecture for virtual metrology modeling with 2-dimensional data. IEEE Trans. Semicond. Manuf. 2018, 31, 376–384. [Google Scholar] [CrossRef]
  4. Chen, Y.; Zhao, D.; Lv, L.; Zhang, Q. Multi-task learning for dangerous object detection in autonomous driving. Inf. Sci. 2018, 432, 559–571. [Google Scholar] [CrossRef]
  5. Katrakazas, C.; Quddus, M.; Chen, W.; Deka, L. Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions. Transp. Res. Part C Emerg. Technol. 2015, 60, 416–442. [Google Scholar] [CrossRef]
  6. González, D.; Pérez, J.; Milanés, V.; Nashashibi, F. A Review of Motion Planning Techniques for Automated Vehicles. IEEE Trans. Intell. Transp. Syst. 2016, 17, 1135–1145. [Google Scholar] [CrossRef]
  7. Rosenband, D.L. Inside Waymo’s self-driving car: My favorite transistors. In Proceedings of the 2017 Symposium on VLSI Circuits, Kyoto, Japan, 5–8 June 2017; pp. C20–C22. [Google Scholar] [CrossRef]
  8. Cao, Y.; Xiao, C.; Yang, D.; Fang, J.; Yang, R.; Liu, M.; Li, B. Adversarial objects against lidar-based autonomous driving systems. arXiv 2019, arXiv:1907.05418. [Google Scholar]
  9. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 770–778. [Google Scholar] [CrossRef] [Green Version]
  10. Uber’s Deadly Self-Driving Accident: What We Know So Far. Available online: https://www.extremetech.com/extreme/265945-ubers-deadly-accident-know-happened (accessed on 20 March 2018).
  11. Self-Driving Car Crash in Arizona: Red Light Runner Hits Waymo Van. Available online: https://www.abc15.com/news/region-southeast-valley/chandler/waymo-car-involved-in-chandler-arizona-crash (accessed on 4 May 2018).
  12. Moreno, F.A.; Monroy, J.; Ruiz-Sarmiento, J.R.; Galindo, C.; Gonzalez-Jimenez, J. Automatic Waypoint Generation to Improve Robot Navigation Through Narrow Spaces. Sensors 2020, 20, 240. [Google Scholar] [CrossRef] [Green Version]
  13. Xie, G.; Gao, H.; Qian, L.; Huang, B.; Li, K.; Wang, J. Vehicle Trajectory Prediction by Integrating Physics- and Maneuver-Based Approaches Using Interactive Multiple Models. IEEE Trans. Ind. Electron. 2018, 65, 5999–6008. [Google Scholar] [CrossRef]
  14. Kim, B.; Yi, K.; Yoo, H.; Chong, H.; Ko, B. An IMM/EKF Approach for Enhanced Multitarget State Estimation for Application to Integrated Risk Management System. IEEE Trans. Veh. Technol. 2015, 64, 876–889. [Google Scholar] [CrossRef]
  15. Fortin, B.; Lherbier, R.; Noyer, J. A Model-Based Joint Detection and Tracking Approach for Multi-Vehicle Tracking With Lidar Sensor. IEEE Trans. Intell. Transp. Syst. 2015, 16, 1883–1895. [Google Scholar] [CrossRef]
  16. Frohle, M.; Granstrom, K.; Wymeersch, H. Multiple Target Tracking With Uncertain Sensor State Applied To Autonomous Vehicle Data. In Proceedings of the 2018 IEEE Statistical Signal Processing Workshop (SSP), Freiburg, Germany, 10–13 June 2018; pp. 1–5. [Google Scholar] [CrossRef]
  17. Eltrass, A.; Khalil, M. Automotive radar system for multiple-vehicle detection and tracking in urban environments. IET Intell. Transp. Syst. 2018, 12, 783–792. [Google Scholar] [CrossRef]
  18. Kaempchen, N.; Weiss, K.; Schaefer, M.; Dietmayer, K.C.J. IMM object tracking for high dynamic driving maneuvers. In Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy, 14–17 June 2004; pp. 825–830. [Google Scholar] [CrossRef]
  19. Hillenbrand, J.; Spieker, A.M.; Kroschel, K. A Multilevel Collision Mitigation Approach—Its Situation Assessment, Decision Making, and Performance Tradeoffs. IEEE Trans. Intell. Transp. Syst. 2006, 7, 528–540. [Google Scholar] [CrossRef]
  20. Schubert, R.; Richter, E.; Wanielik, G. Comparison and evaluation of advanced motion models for vehicle tracking Cologne. In Proceedings of the 2008 11th International Conference on Information Fusion, Cologne, Germany, 30 June–3 July 2008; pp. 1–6. [Google Scholar] [CrossRef]
  21. Song, D.; Tharmarasa, R.; Kirubarajan, T.; Fernando, X.N. Multi-Vehicle Tracking With Road Maps and Car-Following Models. IEEE Trans. Intell. Transp. Syst. 2018, 19, 1375–1386. [Google Scholar] [CrossRef]
  22. Stéphanie, L.; Vasquez, D.; Laugier, C. A survey on motion prediction and risk assessment for intelligent vehicles. Robomech J. 2014, 1, 1–14. [Google Scholar] [CrossRef] [Green Version]
  23. Khazraj, H.; Faria da Silva, F.; Bak, C.L. A performance comparison between extended Kalman Filter and unscented Kalman Filter in power system dynamic state estimation. In Proceedings of the 2016 51st International Universities Power Engineering Conference (UPEC), Coimbra, Portugal, 6–9 September 2016; pp. 1–6. [Google Scholar] [CrossRef]
  24. Leung, H.; Hu, Z.; Blanchette, M. Evaluation of multiple radar target trackers in stressful environments. IEEE Trans. Aerosp. Electron. Syst. 1999, 35, 663–674. [Google Scholar] [CrossRef]
  25. Ding, Z.; Hong, L. Bias phenomenon and compensation for PDA/JPDA algorithms. Math. Comput. Model. 1998, 27, 1–16. [Google Scholar] [CrossRef]
  26. Blom, H.A.P.; Bloem, E.A. Probabilistic data association avoiding track coalescence. IEEE Trans. Autom. Control 2000, 45, 247–259. [Google Scholar] [CrossRef]
  27. Hyun, E.; Lee, J. Multi-target tracking scheme using a track management table for automotive radar systems. In Proceedings of the 2016 17th International Radar Symposium (IRS), Krakow, Poland, 10–12 May 2016; pp. 1–5. [Google Scholar] [CrossRef]
  28. Lee, M.S.; Kim, Y.H. Automotive radar tracking of multi-target for vehicle CW/CA systems. Mechatronics 2004, 14, 143–151. [Google Scholar] [CrossRef]
  29. Schuster, M.; Reuter, J.; Wanielik, G. Tracking of vehicles on nearside lanes using multiple radar sensors. In Proceedings of the 2014 International Radar Conference, Lille, France, 13–17 October 2014; pp. 1–6. [Google Scholar] [CrossRef]
  30. Partovibakhsh, M.; Liu, G. An Adaptive Unscented Kalman Filtering Approach for Online Estimation of Model Parameters and State-of-Charge of Lithium-Ion Batteries for Autonomous Mobile Robots. IEEE Trans. Control Syst. Technol. 2014, 23, 357–363. [Google Scholar] [CrossRef]
  31. Sarkka, S. On Unscented Kalman Filtering for State Estimation of Continuous-Time Nonlinear Systems. IEEE Trans. Autom. Control AC 2007, 52, 1631–1641. [Google Scholar] [CrossRef] [Green Version]
  32. Santhanagopalan, S.; White, R.E. State of charge estimation using an unscented filter for high power lithium ion cells. Int. J. Energy Res. 2010, 34, 152–163. [Google Scholar] [CrossRef]
  33. Partovibakhsh, M.; Liu, G. Online estimation of model parameters and state-of-charge of Lithium-Ion battery using Unscented Kalman Filter. In Proceedings of the 2012 American Control Conference (ACC), Montreal, QC, Canada, 27–29 June 2012; pp. 3962–3967. [Google Scholar] [CrossRef]
  34. Eltoukhy, M.; Ahmad, M.O.; Swamy, M.N.S. An Adaptive Turn Rate Estimation for Tracking a Maneuvering Target. IEEE Access 2020, 8, 94176–94189. [Google Scholar] [CrossRef]
Figure 1. Finite state machine diagram.
Figure 1. Finite state machine diagram.
Remotesensing 12 03255 g001
Figure 2. Priority data association policy diagram.
Figure 2. Priority data association policy diagram.
Remotesensing 12 03255 g002
Figure 3. Configuration of the host and target vehicle.
Figure 3. Configuration of the host and target vehicle.
Remotesensing 12 03255 g003
Figure 4. Test scenarios. (a) Scenario 1; (b) Scenario 2; (c) Scenario 3; (d) Scenario 4.
Figure 4. Test scenarios. (a) Scenario 1; (b) Scenario 2; (c) Scenario 3; (d) Scenario 4.
Remotesensing 12 03255 g004
Figure 5. Real test for scenario 1. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Figure 5. Real test for scenario 1. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Remotesensing 12 03255 g005aRemotesensing 12 03255 g005b
Figure 6. Real test for scenario 2. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Figure 6. Real test for scenario 2. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Remotesensing 12 03255 g006aRemotesensing 12 03255 g006b
Figure 7. Real test for scenario 3. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Figure 7. Real test for scenario 3. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Remotesensing 12 03255 g007
Figure 8. Real test for scenario 4. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Figure 8. Real test for scenario 4. (a) NNDA-CT-UKF multitarget tracking; (b) PDAP-CT-UKF multitarget tracking; (c) RMS for tracking target #1; (d) RMS for tracking target #2.
Remotesensing 12 03255 g008
Table 1. Tracking statistics.
Table 1. Tracking statistics.
NNDA-CT-UKFPDAP-CT-UKF
MRMSTotal Tracked TargetsMRMSTotal Tracked Targets
Scenario 1Target #10.7416 m250.7416 m23
Target #20.7498 m0.7498 m
Scenario 2Target #10.4348 m390.4348 m36
Target #20.7854 m0.7854 m
Scenario 3Target #10.7032 m460.7032 m40
Target #20.9493 m0.9493 m
Scenario 4Target #10.7645 m680.7645 m64
Target #20.8497 m0.8497 m

Share and Cite

MDPI and ACS Style

Zeng, D.; Xiong, L.; Yu, Z.; Chen, Q.; Fu, Z.; Li, Z.; Zhang, P.; Xu, P.; Qian, Z.; Xiao, H.; et al. A Priority Data Association Policy for Multitarget Tracking on Intelligent Vehicle Risk Assessment. Remote Sens. 2020, 12, 3255. https://doi.org/10.3390/rs12193255

AMA Style

Zeng D, Xiong L, Yu Z, Chen Q, Fu Z, Li Z, Zhang P, Xu P, Qian Z, Xiao H, et al. A Priority Data Association Policy for Multitarget Tracking on Intelligent Vehicle Risk Assessment. Remote Sensing. 2020; 12(19):3255. https://doi.org/10.3390/rs12193255

Chicago/Turabian Style

Zeng, Dequan, Lu Xiong, Zhuoping Yu, Qiping Chen, Zhiqiang Fu, Zhuoren Li, Peizhi Zhang, Puhang Xu, Zixuan Qian, Hongyu Xiao, and et al. 2020. "A Priority Data Association Policy for Multitarget Tracking on Intelligent Vehicle Risk Assessment" Remote Sensing 12, no. 19: 3255. https://doi.org/10.3390/rs12193255

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop