Next Article in Journal
A Quantitative Comparison of Overlapping and Non-Overlapping Sliding Windows for Human Activity Recognition Using Inertial Sensors
Next Article in Special Issue
Anti-Clutter Gaussian Inverse Wishart PHD Filter for Extended Target Tracking
Previous Article in Journal
Identification of Gait Motion Patterns Using Wearable Inertial Sensor Network
Previous Article in Special Issue
Optimal Target Assignment with Seamless Handovers for Networked Radars
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Tracking Multiple Marine Ships via Multiple Sensors with Unknown Backgrounds

1
School of Electrical Engineering, Computing, and Mathematical Sciences, Curtin University, Bentley, WA 6102, Australia
2
School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China
*
Author to whom correspondence should be addressed.
Current address: ThaiNguyen University of Technology, ThaiNguyen University, ThaiNguyen 251810, Vietnam.
Sensors 2019, 19(22), 5025; https://doi.org/10.3390/s19225025
Submission received: 23 September 2019 / Revised: 15 November 2019 / Accepted: 15 November 2019 / Published: 18 November 2019

Abstract

:
In multitarget tracking, knowledge of the backgrounds plays a crucial role in the accuracy of the tracker. Clutter and detection probability are the two essential background parameters which are usually assumed to be known constants although they are, in fact, unknown and time varying. Incorrect values of these parameters lead to a degraded or biased performance of the tracking algorithms. This paper proposes a method for online tracking multiple targets using multiple sensors which jointly adapts to the unknown clutter rate and the probability of detection. An effective filter is developed from parallel estimation of these parameters and then feeding them into the state-of-the-art generalized labeled multi-Bernoulli filter. Provided that the fluctuation of these unknown backgrounds is slowly-varying in comparison to the rate of measurement-update data, the validity of the proposed method is demonstrated via numerical study using multistatic Doppler data.

1. Introduction

In a multitarget scenario, the targets set cardinality and their dynamic states randomly vary with time. The objective of tracking multiple targets is to estimate the number of targets and their trajectories using the data collected from sensor(s) in a joint manner [1,2,3,4]. Currently, there are three major paradigms for this field of study, namely Joint Probability Data Association (JPDA) [1], Multiple Hypotheses Tracking (MHT) [2] and Random Finite Set (RFS) [3,4]. While the first two formers involve modifying single target tracking filters to accommodate the problem of multitarget tracking, the latter applies estimation theory focusing on Bayesian optimality and provide a top-down formulation for solving the multitarget estimation problem [3,4].
Using RFS leads to the development of a series of multitarget estimation algorithms. Several RFS-based filters has been proposed in both the literature and practical applications, such as the Probability Hypothesis Density (PHD) [5], Cardinalized PHD (CPHD) [6,7], and the multi-Bernoulli filters [8]. While these filters and their extensions can give good estimates of the current target states, they do not produce target trajectories without using heuristics [9,10]. A theoretically rigorous and systematic consideration of the multitarget trajectory estimation based on RFS approach was proposed in [11]. This work also derives an exact closed-form solution to the multitarget tracking problem, known as Generalized Labeled multi-Bernoulli (GLMB) filter. This filter can estimate not only the number of the targets but also their trajectories, simultaneously [12]. It has been applied to several problems as tracking with merged measurements [13], track-before-detect [14,15], extended targets [16], cell biology [17,18], sensor scheduling [19], spawning targets [20], distributed data fusion [21], field robotics [22,23] and computer vision [24]. The GLMB filter for multitarget tracking with two sensors has been developed in [25,26]. An efficient implementation of the GLMB filter based on Gibbs sampling whose complexity depends linearly on the total number of measurements and quadratically on the number of hypothesized targets has been presented in [27]. This method has been extended to the multi-scan GLMB filter [28] and the multi-sensor GLMB filter [9].
In the multitarget tracking problem, clutter and detection profile are notable sources of uncertainty [29]. Clutter is the set of false measurements that do not originate from any true target and detection profile models the ability of the sensor to detect targets. Knowledge of these parameters are essential in Bayesian multitarget estimation. Mismatches in parameters of clutter and detection models lead to poor performance of filtering algorithms. While these parameters are unknown and randomly time-varying, they are normally assumed to be known in advance. This assumption is unrealistic in most practical applications and these parameters need to be estimated from training data or manually tuned [29].
Since the adaptability of the tracker to these unknown parameters are important in practice, several RFS filters have been proposed in the literature to perform multitarget tracking with mismatches in clutter and detection probability. Some of the proposed methods that accommodate the unknown clutter rate are given in [30,31,32,33]. A filter which bootstraps the clutter estimator of [29] into the CPHD filter [6] has been proposed in [34]. Several approaches for dealing with unknown detection probability have been presented in the literature, such as [29,35,36]. However, none of these filters can output target tracks. While the GLMB filter can output tracks, and has been applied to several problems without prior knowledge of clutter rate, as in [37,38,39], it is still computationally expensive. A low computational cost bootstrapping method using GLMB filter has been given in [40] for multisensor multitarget tracking with unknown detection probability.
Multisensor multitarget tracking with jointly unknown clutter rate and detection profile is far more complicated than those with a single unknown parameter. The use of multiple sensors leads to multidimensional ranked assignment problem which is the main hurdle in the implementation of the GLMB filter [9]. Furthermore, exploiting background information from training data for the multitarget estimation at each time frame is insufficient due to the time-varying nature of the two mentioned unknown parameters.
This work is aimed to contribute an efficient method for multitarget tracking that not only produces target trajectories but also estimates the jointly unknown clutter rate and detection profile online with low computational cost. By using a simple combination of the two well-known filters, the CPHD and GLMB filters, this method is not only fast in estimating the unknown parameters but also producing trajectories of the targets. Specifically, these two mentioned unknown parameters would be estimated separately by using the λ - CPHD and p D - CPHD filters before feeding to the GLMB filter for the purpose of tracking trajectories. The preliminary results of this work are reported in [40]. Particularly, in [40], the unknown detection probability is treated by the p D - CPHD filter before boostraped into the GLMB filter with known clutter rate. The soundness and effectiveness of the proposed solution are demonstrated in Section 4 via a multiple marine ships tracking application.
The remainder of this work is presented as follows. The backgrounds on GLMB filtering will be given in Section 2. The proposed bootstrapping method will be introduced in Section 3 followed by numerical studies in Section 4. Some concluding marks in Section 5.

2. Background

Some fundamentals on multitarget state-space model, the CPHD filter, and GLMB filter will be summarized in this section. Following the convention in [11], single target states are denoted with lower-case letters (i.e., x) while upper-case letters denote multitarget states (i.e., X). The corresponding spaces are denoted by blackboard bold letters ( X , L , Z , e t c ) . The sequence of variable X i , X i + 1 , . . . , X j is abbreviated by X i : j . In this work the inner product f ( x ) g ( x ) d x is rewritten as f , g . Given a set S, the finite subsets of S is written as F ( S ) , and 1 S ( · ) denotes the indicator function of S. For a finite set X, | X | represents its the number of elements, and the product x X f x for some real-valued function f is denoted by the multitarget exponential f X , with f = 1 . Further, the generalized Kronecker-delta function δ Y whose arguments can be arbitrary sets, vectors, integers, etc., is defined as follows
δ Y [ X ] = 1 i f X = Y 0 o t h e r w i s e .

2.1. Multitarget States

As mentioned in Section 1, algorithms using non-labeled RFS cannot produce trajectories without using heuristic techniques [10]. The Labeled RFS framework, introduced in [11,41], is a principled approach to produce target tracks. Moreover, it is the only method that can produce trajectories from the filtering density [10]. In the labeled RFS frame work, a labeled target at time k is represented by a kinematic target state vector x k in state space X and its unique label k in the (discrete) label space L , and hence x = ( x , ) X × L . This unique label is characterized by two parameters: time of target birth τ and the index of individual targets born at the same time ρ , i.e., k = ( τ , ρ ) L [11]. Hence, formally, a trajectory of each target is a sequence of consecutive labeled states with the same label [11]. Note that the label space for all targets born up to time k is the disjoint union L k = L k - 1 B k where B k is the label space for targets born at time k , and L k - 1 is the label space of the targets born prior to time k. To distinguish the unlabeled states from labeled ones, the normal and bold letters (e.g., x , X , x , X ) are used, respectively. Suppose that at time k, there are N targets with corresponding states x k , 1 , , x k , N , then the multitarget state can be represented as follows:
X k = x k , 1 , , x k , N F X × L k
Definition 1.
[11] Let L : X × L L be the projection L ( x ; ) = , and hence L ( X ) = L x : x X is the set of labels of X . A labeled RFS with space X and (discrete) label space L is an RFS on X × L such that each realization X has distinct labels, i.e., | L ( X ) | = | X | .
Since each target in a multitarget state has a distict label, δ | X | ( | L ( X ) | ) = 1 , the distinct label indicator can be defined as follows [11]
Δ ( X ) δ | X | ( | L ( X ) | ) .

2.2. Standard Multitarget Dynamic Model

Given a multitarget state X k at time k, each state x k , k X k can either exist with probability P S , k + 1 | k x k and evolve to a new state x k + 1 at next time step k + 1 with probability density f k + 1 | k x k + 1 | x k , k δ k k + 1 or disappear with probability 1 - P S , k + 1 | k x k . Let S k + 1 | k ( x ) be the labeled Bernoulli RFS of the surviving target with state x from time k to time k + 1 and B k + 1 be the labeled multi-Bernoulli RFS of the new-born targets at time k + 1 , then the multitarget state X k + 1 is the union of the surviving targets and the new-born ones,
X k + 1 = x k X k S k + 1 | k x k B k + 1 ,
Following the convention in [9], in this work, the set B k + 1 is distributed according to the labeled multi-Bernoulli (LMB) density. Furthermore, for simplicity, the subscript k for the current time is omitted, and the next time step k + 1 is indicated by the subscript + .
Assuming that the appearance, disappearance, and movement of each target are independent of the others, the multitarget transition density (The Mahler’s Finite Set Statistics (FISST) notion of density is used in this paper for consistency with the probability density [42]) is [11,41]
f X + | X = f S ( X + ( X × L ) | X ) f B , + ( X + - ( X × L ) )
in which the distribution of new-born targets is given by
f B , + B + = Δ B + 1 B + r B , + L B + 1 - r B , + B + - L B + p B , + B + ,
where r B , + ( ) is the birth probability of new target with new-born label , and p B , + ( · ; ) is the distribution of its kinematic state [11]. The distribution of the survival targets is
f S , + S | X = Δ S Δ X 1 L ( X ) L S Υ ( S ; · ) X Υ ( S ; x , ) = ( x + , + ) S δ ( + ) P S ( x , ) f + ( x + | x , ) + ( 1 - 1 L S ( ) ( 1 - P S ( x , ) ) .

2.3. Standard Multitarget Observation Model

Assuming that there are M sensors, each state x , X can be either detected by sensor s , s = 1 , M with probability of detection P D s x , and generate an observation z s Z ( s ) with likelihood g D s z s | x , , or being miss detected with probability 1 - P D s x , . The set of multitarget observations collected by the s t h -sensor at time k is Z k ( s ) = z 1 ( s ) , , z M ( s ) F Z , with Z being the observation space. Note that, the s t h - sensor can also receive spurious measurements or false alarms at each time step. Let D ( s ) ( x ) be the set of measurements generated by target with state x at time k, the multitarget observation at the current time k is the superposition of all observations of detected targets modeled by multi-Bernoulli RFS, i.e., D ( s ) X = x X D ( s ) x and the clutter modeled by either Poisson or i.i.d. clutter RFS C ( s ) .
Z ( s ) = D ( s ) X C ( s )
The likelihood function of a multitarget state X for sensor s is given as follows [9],
g s ( Z s | X ) θ s Θ s 1 Θ s L X θ s Υ Z s s , θ s L x x X
where Θ s is the set of positive association map θ s at time k , θ s : L { 0 , 1 , , | Z s | } , such that θ s i = θ s j i = j (i.e., each observation in Z s is assigned to at most one target, then each target has a distinct label), Θ s J is the subset of Θ s with domain J , and
Υ Z s ( s , j ) ( x ) = P D ( s ) x g ( s ) ( z j ( s ) | x ) κ s ( z j ( s ) ) , j = 1 : M s 1 - P D ( s ) ( x ) j = 0 .
Using the assumption that the sensors are conditionally independent (More concisely, the sensors do not interfere or influence each other while taking measurements or detections. The measurement noise, missed detections and clutter from each sensor in a multitarget scenario are, therefore, independent from the others), and let us define the following abbreviations
Z ( Z 1 , , Z M ) ,
Θ Θ 1 × × Θ M ,
Θ J Θ 1 J × × Θ M J ,
θ ( θ 1 , , θ M ) ,
1 Θ I θ s = 1 M 1 Θ s I ( θ s ) ,
Υ Z j 1 , , j M x , s = 1 M Υ Z s ( s , j s ) x , ,
then, the multi-sensor likelihood is written as
g Z | X = s = 1 M g s ( Z s | X ) θ Θ 1 Θ L X θ Υ Z θ L x x X .
Obviously, the form of the multi-sensor likelihood g Z | X in (17) and that of it its single-sensor counterpart in (9) are identical.

2.4. Multitarget Bayesian Recursion

Let π k - 1 · | Z 1 : k - 1 denotes the multitarget density of the multitarget state at time k - 1 , where Z 1 : k - 1 = ( Z 1 , , Z k - 1 ) is the set of all observation history up to time k - 1 . For simplicity, we obmit the dependence on past measurements, i.e, we use π k - 1 · | Z k - 1 instead of π k - 1 · | Z 1 : k - 1 . The multitarget Bayes filter use the Chapman-Kolmogorov equation to predict the multitarget state to time k given posterior at time k - 1 as follows [3]
π k | k - 1 X k | Z k - 1 = f k | k - 1 X k | X π k - 1 X | Z k - 1 d X ,
where f k | k - 1 X k | X is defined as the multitarget transition kernel from time k - 1 to time k, and the integral in Equation (18) is the set integral defined for any function f : F X × L R ,
f X δ X = i = 0 1 i ! f x 1 , , x i d x 1 , , x i .
The multitarget state X k is partially observed at time k, and the RFS Z k is modeled by the multitarget likelihood function g k Z k | X k , thus the multitarget posterior at this time is given by Bayes rule:
π k X k | Z k = g k Z k | X k π k | k - 1 X k | Z k - 1 g k Z k | X π k | k - 1 X | Z k - 1 d X .

3. GLMB Recursion with Bootstrapping Method

In this section, the generalized labeled multi-Bernoulli (GLMB) filter with its recursion is summarized. The proposed method for estimating unknown backgrounds before bootstrapping them into this filter is also introduced.

3.1. GLMB Filter

Definition 2.
A GLMB density is a labeled multitarget density given as follows [11]
π X = Δ X ϱ Ξ , J L ω J , ϱ δ J L X p ϱ X ,
where the discrete space Ξ is the space of association map histories Θ 0 : k Θ 0 × × Θ k , each ϱ = θ 1 : k Ξ represents a history of the (multisensor) positive 1-1 map, the weight ω J , ϱ and multitarget exponential p ( ϱ ) X satisfy
ϱ Ξ J L ω J , ϱ δ J L X = 1 ,
p ( ϱ ) x , d x = 1 .
Noting that, in Equation (21), while ω J , ϱ L X is a function of only the labels of the multitarget state X , whereas p ϱ X depends on entire set X .
The cardinality distribution P r | X | = n , existence probability r and probability density p x , of a track L are given as follows [11]:
P r | X | = n = ϱ Ξ J L δ n | J | ω J , ϱ
r = ϱ Ξ J L 1 J ω J , ϱ
p x , = 1 r ϱ Ξ J L 1 J ω J , ϱ p ϱ x ,

3.1.1. The GLMB Recursion

Since the GLMB filter is an exact closed-form multitarget Bayes filter under the standard multitarget dynamic and observation models [12], and the form of the likelihood function in a single sensor and multisensor cases are identical, the GLMB filter can be implemented via two separate steps (update and prediction) or the combined step (joint-predict-update process). In this work, for the convenience of proposed method, the two step GLMB recursion will be presented.

a. GLMB update 

Given the standard multitarget observation likelihood function (9), the posterior multitarget density is calculated as follows [11]
π ( s ) ( X | Z ( s ) ) = Δ ( X ) ( J , ϱ ) F ( L ) × Ξ θ ( s ) Θ ω ( Z ( s ) ) ( s , J , ϱ , θ ( s ) ) ( L ( X ) ) p ( s , ϱ , θ ( s ) ) ( · | Z ( s ) ) X ,
where
ω Z ( s ) ( s , J , ϱ , θ ( s ) ) ( L ) = Γ Z ( s ) ( s , J , ϱ , θ ( s ) ) ( J , ϱ ) F ( L ) × Ξ θ ( s ) Θ Γ Z ( s ) ( s , J , ϱ , θ ( s ) )
Γ Z ( s ) ( s , J , ϱ , θ ( s ) ) = ω Z ( s ) ( s , J , ϱ ) ( L ) p ¯ Z ( s ) ( s , ϱ , θ ( s ) ) J
p ( s , ϱ , θ ( s ) ) ( x , | Z ( s ) ) = p ( s , ϱ ) ( x , ) Υ Z ( s ) ( s ) ( x , ; θ ( s ) ) p ¯ Z ( s ) ( s , ϱ , θ ( s ) ) ( )
p ¯ Z ( s ) ( s , ϱ , θ ( s ) ) ( ) = p ( s , ϱ ) ( · , ) , Υ Z ( s ) ( s ) ( · , ; θ ( s ) )
and Υ Z ( s ) ( s ) ( x , ; θ ( s ) ) is given in (10).

b. Prediction 

Given the posterior multitarget density at current time is a GLMB filtering density with the form of (21), the predicted multitarget density at next time step is calculated under the standard multitarget dynamic model (4) as follows [11]:
π + ( s ) ( X + ) = Δ ( X + ) ( J + , ϱ ) F ( L + ) × Ξ ω + ( s , J + , ϱ ) ( L ( X + ) ) p + ( s , ϱ ) X +
where
ω + ( s , J + , ϱ ) ( L ) = ω B ( s ) ( J + B ) ω S ( s , ϱ ) ( J + L ) ,
p + ( s , ϱ ) ( x , ) = 1 L ( ) p S ( s , ϱ ) ( x , ) + 1 - 1 L ( ) p B ( s ) ( x , )
p S ( s , ϱ ) ( x , ) = P S ( s ) ( · , ) f ( x | · , ) , p ( s , ϱ ) ( · , ) p ¯ S ( s , ϱ ) ( ) ,
p ¯ S ( s , ϱ ) ( ) = P S ( s ) ( · , ) f ( x | · , ) , p ( s , ϱ ) ( · , ) d x
ω S ( s , ϱ ) ( L ) = [ p ¯ S ( s , ϱ ) ] L J L 1 J ( L ) Q S ( s , ϱ ) ( ) J - L ω ( s , J , ϱ )
Q S ( s , ϱ ) ( ) = 1 - P S ( s ) ( · , ) , p ( s , ϱ ) ( · , ) .

3.2. Adaptive to Unknown Backgrounds

In practice, the both the clutter rate and detection profile are unknown and unpredictably vary with time. Prior knowledge of background models, therefore, are typically unavailable. Mismatch in background models results in degradation of tracker performance [4]. In this section, based on the suite of methods for tackling the unknown clutter rate and detection probability introduced in [4], the bootstrapping method will be proposed.
A technique that accommodates the jointly unknown clutter rate λ and the unknown probability of detection p D has been introduced in [29]. This technique considers clutter as an RFS of "generator targets” or “false targets”, and incorporates the non-homogeneous and unknown detection probability into each target state. Each real target state x X is corresponded to an augmented state x a = ( x , a ) , in which a X d = [ 0 , 1 ] is the variable on the probability detecting x. The augmented multitarget state now can be described as follows
X a = x a , 1 , , x a , n = x 1 , a 1 , , x n , a n
Similarly, the augmented generator target state is x c = [ x ¯ , a c ] with x ¯ X c be the generator target state, and a c X d = [ 0 , 1 ] . The augmented generator multitarget state is
X c = x c , 1 , , x c , m = x ¯ 1 , a c 1 , , x ¯ n , a c m
Then the probability of detection is replaced by a and a c , respectively.
p D , a s x a = p D , a s x , a a
p D , c s x c = p D , c s x ¯ , a c a c
Assuming that the false and true targets are statistically independent, then each of the augmented generator targets can be modeled for their characteristics as appearances, disappearances, and transitions, together with likelihood, detection and missed detection. The multitarget state is then a combination of (augmented) actual targets and clutter generators. Meaning that, the augmented hybrid space X h involving the multitarget state can be defined as follows [29]
X ( h ) = X × X ( d ) X ( c ) × X ( d ) X a ( d ) X c ( d )
where denotes the disjoint union, and × denotes the Cartesian product.
The multitarget state (4) and multitarget observation (8)) at time k now become the hybrid ones:
X h = X a X c
Z h = Z a Z c
with Z a and Z c be the augmented multitarget and augmented generator observations, respectively. The integral of a function f ( h ) : X ( h ) R is given by [29]
X ( h ) f ( h ) X h d x h = X a ( d ) f a ( d ) X a δ X a + X a c f a ( c ) X c δ X c
Here, the set integral (19) has been applied to both augmented multitarget state and augmented generator multitarget state terms, i.e, [4]
f a ( d ) X a δ X a = n 0 1 n ! f a x a , 1 , , x a , n d x a , 1 , , d x a , n
f c ( d ) X c δ X c = m 0 1 m ! f a c x c , 1 , , x c , n d x c , 1 , , d x c , m
Noting that the the measurement likelihood is kept unchanged
g x a = g a s x , a g s x
g x c = g c s x ¯ , a c g s x ¯
While the method proposed in [29] results in good estimates of targets, it do not produce the trajectories of the targets. Moreover, although this method is a closed-form solution of the CPHD recursion with jointly unknown clutter rate and detection profile, it is proposed for single-sensor multiple targets estimation solely. In this paper, we propose a method of using the technique introduced in [29] to estimate the mentioned unknown parameters then bootstrapping them into the GLMB filter for tracking on-the-fly. The structure of the proposed method is given in Figure 1.

3.3. Implementation

Since after each filtering iteration, the number of components in the GLMB density grows at an exponential rate, the low weight terms should be truncated for tractability. In this work, we use Murty’s ranked assignment algorithm to sample a given number of hypotheses of the multitarget density with the highest probability to be the correct ones. Then these components are propagated through the filtering recursion only. Although the use of Murty’s algorithm leads to a cubic complexity in the product of the number of Doppler measurements, its implementation is reasonable because there are maximum 10 targets in this work.

4. Numerical Study

The advantages of multi-static Doppler radar such as lightweight, wide range of surveillance with high accuracy, and low power consumption lead to its broad applications in both civilian and military applications [43,44,45]. However, the number of the sensors in conjunction with the non-linear nature and and low observability of the Doppler type measurement leads to many numerical difficulties [44,45]. The use of multistatic Doppler-only measurements in a scenario of 10 receivers and one cooperative transmitter has been proposed in [46] and its extended version [47] for joint detection and tracking of one target.
This numerical study based on the model mentioned in [40] with 10 marine ships. Each ship at time k is represented by a 5 - D state vector x k in the surveillance of interest x k = p k T , ν k T , α k T , where p k = μ k , λ k T and ν k = μ ˙ k , λ ˙ k T denote the position and velocity in the longitude and latitude, respectively; α k is the course of the target, and T denotes the transpose operation. The target dynamic model can be given as follows:
x k = F k | k - 1 x k - 1 + G n k
where
F x k - 1 = 1 sin ( α t ) α 0 ( cos ( α t ) - 1 ) α 0 0 cos ( α t ) 0 - sin ( α t ) 0 0 - ( cos ( α t ) - 1 ) α 1 - sin ( α t ) α 0 0 sin ( α t ) 0 cos ( α t ) 0 0 0 0 0 1 x k - 1 ; G = t 2 2 0 0 t 0 0 0 t 2 2 0 0 t 0 0 0 t ,
and t is sample period, n k is a Gaussian noise vector of velocity and course noise components with zero-mean. Note that latitudinal and longitudinal measurements are in degrees ( ) , the distance, speed and time are given in nautical miles ( M ) , knots ( k n ) , and hours ( h ) , respectively.
Remark 1.
Equation (52) is resulted from the assumption that the surveillance region is not very far from the Equator.
The new births are assumed to be distributed with labeled multi-Bernoulli RFS distributions of parameters f B x = r B i , p B i i = 1 4 where r B i is the ith common existence probability, and p B i x = N x , x ^ B ( i ) , P B with
x ^ B 1 = 15.6 N , 0 , 113 E , 0 , 0 T ; x ^ B 2 = 13.2 N , 0 , 107 . 5 E , 0 , 0 T x ^ B 3 = 18.2 N , 0 , 110.7 E , 0 , 0 T ; x ^ B 4 = 22.3 N , 0 , 118.8 E , 0 , 0 T ; P B = d i a g 2 N , 30 k n , 2 E , 30 k n , 6 π / 180 r a d s - 1
Table 1 lists out the initial state of ten targets with random time of appearance and disappearance, and the average course is α ¯ = 2 π / 180 ( r a d / s ) .
The parameters of the dynamic model are given in Table 2.
Consider the configuration of multiple Doppler sensors system including two spatially distributed receivers and one cooperative transmitter located as in Figure 2. Based on Doppler effect, this system can measure the speed of a target at a distance by calculating the altered frequency of the returned signals which originate from the emitting pulses of radio signals and being reflected to radar after reaching target [48].
The observation of a target state x k at the s t h receiver using Doppler measurement is given by
z k ( s ) = - ν k T p k - p r ( s ) p k - p r ( s ) + p k - p t p k - p t f t c + w k ,
in which p k and ν k have been defined above the Equation (51), p t = [ μ t , λ t ] T is the position of the transmitter, and p r ( s ) = [ μ r ( s ) , λ r ( s ) ] T is the location of the s t h - receiver; w k is zero-mean Gaussian noise, w k N ( 0 , Q k ) , with covariance Q k = d i a g [ 1 H z 2 ] ; and f t is the signal frequency emitted from the transmitter, and c is the light speed.
Since the targets are dynamic in different directions, the value of observation z k ( s ) in (53) can be negative or positive in the known interval - f 0 , + f 0 of the Doppler sensor. In this work, the measurement space for two receivers have the same measurement space of - 200 H z , 200 H z . The parameters of the observation model are given in Table 3. It can be seen that, not only the state equation but also the measurement one are highly nonlinear.
By using the proposed B - GLMB filter, the configuration of multiple marine ships tracking using multiple Doppler radars with ground truths and their tracking results are illustrated in Figure 2. For better visualization of multiple targets, each target is assigned to a distinct color. The results of longitudinal-latitudinal co-ordinate target trajectories are demonstrated in Figure 3.
For evaluating the effectiveness of the proposed method comparing to the fixed-GLMB filter and the Joint-CPHD, 100 Monte - Carlo run has been used, and the distance, location and cardinality errors are calculated via Optimal Sub-Pattern Assignment, OSPA, [49] and shown in Figure 4a. By using this metric, the distance between the set of true multitarget states and that of estimated target states is calculated at each time step. For measuring the error between two set of tracks, the use of OSPA is insufficient, and OSPA ( 2 ) is needed. The OSPA ( 2 ) errors [50] of the B-GLMB and fixed-GLMB filters are compared and plotted against time in Figure 4b, respectively.
For the B - GLMB filter and joint-CPHD filter, the clutter rate fluctuates in the range of λ c = [ 28 , 70 ] , and the detection probability changes from 0.75 to 0.98, i.e., p D = [ 0 . 75 , 0 . 98 ] . The fixed-GLMB filter is used with fixed p D of 0.75 and 0.98 and fixed λ of 28 and 70, respectively. The window length used in OSPA ( 2 ) to obtain the differences between the true and estimate sets of trajectories in Figure 4b is set at w l = 10 . Both the OSPA and OSPA ( 2 ) are used with cut-off parameter c 0 = 0 and p = 1 .
Obviously from Figure 4a, the errors in distance and location between the set of true targets and the estimated ones using B - GLMB filter is the smallest values comparing to those of the fixed-GLMB and joint-CPHD filters. In addition, the errors in cardinality statistics using fixed-GLMB and B - GLMB are almost identical and better than error measured by joint-CPHD filter. The results of measuring errors between the set of true target tracks and that of the estimated tracks are given in Figure 4b. Once again, the effectiveness of the proposed method in reducing the errors in distances and locations of the target tracks is validated. The cardinality statistics for the B - GLMB filter, fixed-GLMB filter and joint-CPHD over 100 Monte Carlo run are given in Figure 5.

5. Conclusions

This paper presented an efficient solution to the problem of tracking an unknown and time-varying number of marine ships from multiple sensors with unknown clutter rate and probability of detection. Particularly, these two unknown parameters are parallel estimated based on the λ - CPHD and the p D - CPHD filters, then bootstrapped into the cutting-edge GLMB filter. By using the bootstrapping method, the proposed filter utilizes the advantages of the two former estimators in accommodating the unknown backgrounds and reduces the computational cost from tracking algorithm of the latter filter. The effectiveness and correctness of the proposed method are demonstrated in Section 4. From our best knowledge, this is the first principled online algorithm for tracking marine ships via multiple sensors with unknown backgrounds in Doppler measurements. For future work, one of the forcuses would be investigating the combination of multi-scan GLMB [28] and multisensor GLMB [9] filters for multisensor multitarget tracking.

Author Contributions

In this work, T.T.D.N. and W.L. contributed in software and discussion. C.-T.D. conceived and planned the conceptualization, data curation, formal analysis, investigation, and methodology. C.-T.D. also designed and directed the project, resources, supervision, validition and visualization. C.-T.D. wrote, revised and edited the original draft as well as the manuscript. All authors discussed the comments from reviewers before sending their responses.

Funding

This research was sponsored by the Joint CIPRS-MOET Scholarship.

Acknowledgments

The Authors acknowledge the administrative and technical support from their Supervisors and Universities.

Conflicts of Interest

The authors declare no conflict of interest in this study.

References

  1. Bar-Shalom, Y.; Fortmann, T.E. Tracking and Data Association; Academic Press: San Diego, CA, USA, 1988; ISBN 978-012-079-760-8. [Google Scholar]
  2. Blackman, S.; Popoli, R. Design and Analysis of Modern Tracking Systems; Artech House: Norwood, MA, USA, 1999; ISBN 978-158-053-006-4. [Google Scholar]
  3. Mahler, R.S. Statistical Multisource-Multitarget Information Fusion; Artech House: Boston, MA, USA, 2007; ISBN 978-159-693-092-6. [Google Scholar]
  4. Mahler, R.S. Advances in Statistical Multisource-Multitarget Information Fusion; Artech House: Boston, MA, USA, 2014; ISBN 978-16-0807-798-4. [Google Scholar]
  5. Mahler, R.P. Multitarget Bayes filtering via first-order multitarget moments. IEEE Trans. Aerosp. Electron. Syst. 2003, 39, 1152–1178. [Google Scholar] [CrossRef]
  6. Vo, B.-T.; Vo, B.-N.; Cantoni, A. Analytic implementations of the cardinalized probability hypothesis density filter. IEEE Trans. Signal Process. 2007, 55, 3553–3567. [Google Scholar] [CrossRef]
  7. Mahler, R.P. PHD filters of higher order in target number. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 1523–1543. [Google Scholar] [CrossRef]
  8. Vo, B.-N.; Vo, B.-T.; Pham, N.-T.; Suter, D. Joint Detection and Estimation of Multiple Objects from Image Observations. IEEE Trans. Signal Process. 2010, 58, 5129–5241. [Google Scholar] [CrossRef]
  9. Vo, B.-N.; Vo, B.-T.; Beard, M. Multi-Sensor Multi-Object tracking with the Generalized Labeled Multi-Bernoulli Filter. IEEE Trans. Signal Process. 2019. Accepted for publication. [Google Scholar] [CrossRef]
  10. Mahler, R.S. “statistic 103” for multitarget tracking. Sensors 2019, 19, 202. [Google Scholar] [CrossRef] [PubMed]
  11. Vo, B.-T.; Vo, B.-N. Labeled random finite sets and multi-object conjugate priors. IEEE Trans. Signal Process. 2013, 61, 3460–3475. [Google Scholar] [CrossRef]
  12. Mahler, R.S. Exact Closed-Form Multitarget Bayes Filters. Sensors 2019, 19, 2818. [Google Scholar] [CrossRef]
  13. Beard, M.; Vo, B.-T.; Vo, B.-N. Bayesian multi-target tracking with merged measurements using labelled random finite sets. IEEE Trans. Signal Process. 2015, 63, 1433–1447. [Google Scholar] [CrossRef]
  14. Papi, F.; Kim, D.Y. A particle multi-target tracker for superpositional measurements using labeled random finite sets. IEEE Trans. Signal Process. 2015, 63, 4348–4358. [Google Scholar] [CrossRef]
  15. Papi, F.; Vo, B.N.; Vo, B.T.; Fantacci, C.; Beard, M. Generalized Labeled Multi-Bernoulli Approximation of Multi-Object Densities. IEEE Trans. Signal Process. 2014, 63, 5487–5497. [Google Scholar] [CrossRef]
  16. Beard, M.; Reuter, S.; Granström, K.; Vo, B.T.; Vo, B.N.; Scheel, A. Multiple extended target tracking with labeled random finite sets. IEEE Trans. Signal Process. 2016, 64, 1638–1653. [Google Scholar] [CrossRef]
  17. Nguyen, T.T.D.; Kim, D.Y. GLMB tracker with partial smoothing. Sensors 2019, 19, 4419. [Google Scholar] [CrossRef] [PubMed]
  18. Hadden, W.J.; Young, J.L.; Holle, A.W.; McFetridge, M.L.; Kim, D.Y.; Wijesinghe, P.; Taylor-Weiner, H.; Wen, J.H.; Lee, A.R.; Bieback, K.; et al. Stem cell migration and mechanotransduction on linear stiffness gradient hydrogels. Proc. Natl. Acad. Sci. USA 2017, 114, 5647–5652. [Google Scholar] [CrossRef] [PubMed]
  19. Beard, M.; Vo, B.-T.; Vo, B.-N.; Arulampalam, S. Void Probabilities and Cauchy-Schwarz Divergence for Generalized Labeled Multi-Bernoulli Models. IEEE Trans. Signal Process. 2017, 65, 5047–5061. [Google Scholar] [CrossRef]
  20. Bryant, D.S.; Vo, B.-T.; Vo, B.-N.; Jones, B.A. A Generalized Labeled Multi-Bernoulli Filter with Object Spawning. IEEE Trans. Signal Process. 2018, 66, 6177–6189. [Google Scholar] [CrossRef]
  21. Fantacci, C.; Vo, B.-N.; Vo, B.-T.; Battistelli, G.; Chisci, L. Robust fusion for multisensor multiobject tracking. IEEE Signal Process. Lett. 2018, 25, 640–644. [Google Scholar] [CrossRef]
  22. Deusch, H.; Reuter, S.; Dietmayer, K. The labeled multi-Bernoulli SLAM filter. IEEE Signal Process. Lett. 2015, 22, 1561–1565. [Google Scholar] [CrossRef]
  23. Moratuwage, D.; Adams, M.; Inostroza, F. δ-Generalised Labelled Multi-Bernoulli Simultaneous Localization and Mapping with an Optimal Kernel-Based Particle Filtering Approach. Sensors 2019, 19, 2290. [Google Scholar] [CrossRef]
  24. Kim, D.Y.; Vo, B.-N.; Vo, B.-T.; Jeon, M. A labeled random finite set online multi-object tracker for video data. Pattern Recognit. 2019, 90, 377–389. [Google Scholar] [CrossRef]
  25. Wei, B.; Nener, B.; Liu, W.; Ma, L. Centralized Multi-Sensor Multi-Target Tracking with Labeled Random Finite Sets. In Proceedings of the International Conference Control, Automation and Information Sciences (ICCAIS 2016), Ansan, Korea, 27–29 October 2016; pp. 82–87. [Google Scholar] [CrossRef]
  26. Fantacci, C.; Papi, F. Scalable multisensor multitarget tracking using the marginalized δ-GLMB density. IEEE Signal Process. Lett. 2016, 23, 863–867. [Google Scholar] [CrossRef]
  27. Vo, B.-N.; Vo, B.-T.; Hoang, H.G. An efficient implementation of the Generalized Labeled Multi-Bernoulli filter. IEEE Trans. Signal Process. 2017, 65, 1975–1987. [Google Scholar] [CrossRef]
  28. Vo, B.-N.; Vo, B.-T. A multi-scan labeled Random Finite Set model for multi-object state estimation. IEEE Trans. Signal Process. 2019, 67, 4948–4963. [Google Scholar] [CrossRef]
  29. Mahler, R.S.; Vo, B.-T.; Vo, B.-N. CPHD filtering with unknown clutter rate and detection profile. IEEE Trans. Signal Process. 2011, 59, 3497–3513. [Google Scholar] [CrossRef]
  30. Mahler, R.S.; El-Fallah, A. CPHD filtering with unknown probability of detection. In Signal Processing, Sensor Fusion, and Target Recognition XIX; International Society for Optics and Photonics: Orlando, FL, USA, 2010; p. 7697(76970F). [Google Scholar] [CrossRef]
  31. Vo, B.-T.; Vo, B.-N.; Hoseinnezhad, R.; Mahler, R.P.S. Robust multi-Bernoulli filtering. IEEE J. Sel. Top. Sign. Proces. 2013, 7, 399–409. [Google Scholar] [CrossRef]
  32. Correa, J.; Martin, A. Estimating detection statistics within a bayes-closed multi-object filter. In Proceedings of the 19th International Conference on Information Fusion (FUSION 2016), Heidelberg, Germany, 5–8 July 2016; pp. 811–819. [Google Scholar]
  33. Si, W.; Zhu, H.; Qu, Z. Robust Poisson Multi-Bernoulli Filter With Unknown Clutter Rate. IEEE Access 2019, 7, 117871–117882. [Google Scholar] [CrossRef]
  34. Beard, M.; Vo, B.-T.; Vo, B.-N. Multi-target filtering with unknown clutter density using bootstrap GMCPHD filter. IEEE Signal Process. Lett. 2013, 20, 323–326. [Google Scholar] [CrossRef]
  35. Li, C.; Wang, W.; Kirubarajan, T.; Sun, J.; Lei, P. PHD and CPHD Filtering With Unknown Detection Probability. IEEE Trans. Signal Process. 2018, 66, 3784–3798. [Google Scholar] [CrossRef]
  36. Wang, S.; Bao, Q.; Chen, Z. Refined PHD Filter for Multi-Target Tracking under Low Detection Probability. Sensors 2019, 19, 2842. [Google Scholar] [CrossRef] [Green Version]
  37. Li, S.; Yi, W.; Hoseinnezhad, R.; Wang, B.; Kong, L. Multiobject tracking for generic observation model using labeled random finite sets. IEEE Trans. Signal Process. 2018, 66, 368–383. [Google Scholar] [CrossRef]
  38. Kim, D.Y. Visual multiple-object tracking for unknown clutter rate. IET Comput. Vision 2018, 12, 728–734. [Google Scholar] [CrossRef] [Green Version]
  39. Punchihewa, Y.G.; Vo, B.T.; Vo, B.N.; Kim, D.Y. with Labeled Random Finite Sets. IEEE Trans. Signal Process. 2018, 66, 3040–3055. [Google Scholar] [CrossRef]
  40. Do, C.-T.; Nguyen, H.V. Tracking multiple targets from multistatic Doppler radar with unknown probability of detection. Sensors 2019, 19, 1672. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Vo, B.-N.; Vo, B.-T.; Phung, D. Labeled random finite sets and the Bayes multitarget tracking filter. IEEE Trans. Signal Process. 2014, 62, 6554–6567. [Google Scholar] [CrossRef] [Green Version]
  42. Vo, B.-N.; Singh, S.; Doucet, A. Sequential Monte Carlo methods for multi-target filtering with random finite sets. IEEE Trans. Aerosp. Electron. Syst. 2005, 41, 1224–1245. [Google Scholar] [CrossRef]
  43. Chernyak, V.S. Fundamentals of Multisite Radar Systems: Multistatic Radars and Multistatic Radar Systems; Routledge: Boca Raton, FL, USA, 2018; ISBN 978-905-699-165-4. [Google Scholar]
  44. Goodman, N.A.; Bruyere, D. Optimum and decentralized detection for multistatic airborne radar. IEEE Trans. Aerosp. Electron. Syst. 2007, 43. [Google Scholar] [CrossRef]
  45. Smith, G.E.; Woodbridge, K.; Baker, C.J.; Griffiths, H. Multistatic micro-Doppler radar signatures of personnel targets. IET Signal Process. 2010, 4, 224–233. [Google Scholar] [CrossRef]
  46. Ristic, B.; Farina, A. Joint detection and tracking using multi-static Doppler-shift measurement. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), Kyoto, Japan, 25–30 March 2012; pp. 3881–3884. [Google Scholar] [CrossRef]
  47. Ristic, B.; Farina, A. Target tracking via multi-static Doppler shifts. IET Radar Sonar Navig. 2013, 7, 508–516. [Google Scholar] [CrossRef]
  48. Guo, F.; Fan, Y.; Zhou, Y.; Xhou, C.; Li, Q. Space Electronic Reconnaissance: Localization Theories and Methods, 1st ed.; John Wiley & Sons: Solaris South Tower, Singapore, 2014; ISBN 978-111-854-219-4. [Google Scholar]
  49. Schuhmacher, D.; Vo, B.-T.; Vo, B.-N. A consistent metric for performance evaluation of multi-object filters. IEEE Trans. Signal Process. 2008, 56, 3447–3457. [Google Scholar] [CrossRef] [Green Version]
  50. Beard, M.; Vo, B.-T.; Vo, B.-N. A solution for Large-scale Multi-Object Tracking. arXiv 2018, arXiv:1804.06622. [Google Scholar]
Figure 1. The proposed structure of the B-GLMB filter.
Figure 1. The proposed structure of the B-GLMB filter.
Sensors 19 05025 g001
Figure 2. Configuration of multitarget tracking using MRS.
Figure 2. Configuration of multitarget tracking using MRS.
Sensors 19 05025 g002
Figure 3. Tracking in longitudinal-latitudinal coordinates.
Figure 3. Tracking in longitudinal-latitudinal coordinates.
Sensors 19 05025 g003
Figure 4. Evaluation of tracking errors using (a) OSPA, and (b) OSPA (2).
Figure 4. Evaluation of tracking errors using (a) OSPA, and (b) OSPA (2).
Sensors 19 05025 g004
Figure 5. Cardinality tracking results.
Figure 5. Cardinality tracking results.
Sensors 19 05025 g005
Table 1. Target initial states.
Table 1. Target initial states.
Target μ k λ k μ k ˙ λ ˙ k α k (rad/s)Time of Birth (h)Time of Beath (h)
1 18 12 15 110 42 06 32 - 5 - 5 α ¯ / 8 1100
2 15 37 52 113 57 14 13 - 9 - α ¯ / 2 580
3 18 11 40 110 41 43 - 18 0 2 α ¯ 1090
4 13 13 52 107 29 31 232 - α ¯ / 4 20100
5 22 17 11 118 49 24 6 - 20 - 5 α ¯ / 6 20100
6 22 17 58 118 48 05 - 22 6 3 α ¯ / 4 3070
7 18 12 15 110 42 06 15 - 30 α ¯ / 8 3070
8 15 35 57 113 01 06 - 30 32 3 α ¯ / 5 4585
9 13 11 44 107 30 19 28 - 30 5 α ¯ / 3 55100
10 15 36 04 112 53 30 305 7 α ¯ / 4 55100
Table 2. Parameters of the Dynamic model.
Table 2. Parameters of the Dynamic model.
ParameterSymbolValue
Sample periodt0.15 (h)
Std. of speed noise σ ν 2 (kn)
Std. of course noise σ α π/180 (rads −1)
Common existence prob. r B 1 , 2 , r B ( 3 , 4 ) (0.04; 0.02)
Survival prob. P S 0.95
Number of targetsN10
Table 3. Parameters of observation model.
Table 3. Parameters of observation model.
NameSymbolValue
Transmitter p t [ 16 58 16 N , 107.02 48 E ]
Receiver 1 p r 1 [ 12 22 43 N , 116 28 25 E ]
Receiver 2 p r 2 [ 25 22 47 N , 115 07 19 E ]
Transmit freq. f t 300 ( Mhz )
Light speedc 3 × 10 8 ( m / s )
Detection prob. p D 0.75 ; 0.98
Clutter rate range λ c 28 ; 60
Surveil. area S r [ 10 - 30 N , 100 - 125 E ]

Share and Cite

MDPI and ACS Style

Do, C.-T.; Nguyen, T.T.D.; Liu, W. Tracking Multiple Marine Ships via Multiple Sensors with Unknown Backgrounds. Sensors 2019, 19, 5025. https://doi.org/10.3390/s19225025

AMA Style

Do C-T, Nguyen TTD, Liu W. Tracking Multiple Marine Ships via Multiple Sensors with Unknown Backgrounds. Sensors. 2019; 19(22):5025. https://doi.org/10.3390/s19225025

Chicago/Turabian Style

Do, Cong-Thanh, Tran Thien Dat Nguyen, and Weifeng Liu. 2019. "Tracking Multiple Marine Ships via Multiple Sensors with Unknown Backgrounds" Sensors 19, no. 22: 5025. https://doi.org/10.3390/s19225025

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop