Next Article in Journal
Graph Cut-Based Human Body Segmentation in Color Images Using Skeleton Information from the Depth Sensor
Next Article in Special Issue
Data Association for Multi-Object Tracking via Deep Neural Networks
Previous Article in Journal
SWIR AOTF Imaging Spectrometer Based on Single-pixel Imaging
Previous Article in Special Issue
Markov Chain Realization of Multiple Detection Joint Integrated Probabilistic Data Association
Open AccessArticle

Behavioral Pedestrian Tracking Using a Camera and LiDAR Sensors on a Moving Vehicle

TELIN-IPI, Ghent University - imec, St-Pietersnieuwstraat 41, B-9000 Gent, Belgium
*
Authors to whom correspondence should be addressed.
Sensors 2019, 19(2), 391; https://doi.org/10.3390/s19020391
Received: 15 December 2018 / Revised: 4 January 2019 / Accepted: 15 January 2019 / Published: 18 January 2019
(This article belongs to the Special Issue Multiple Object Tracking: Making Sense of the Sensors)
In this paper, we present a novel 2D–3D pedestrian tracker designed for applications in autonomous vehicles. The system operates on a tracking by detection principle and can track multiple pedestrians in complex urban traffic situations. By using a behavioral motion model and a non-parametric distribution as state model, we are able to accurately track unpredictable pedestrian motion in the presence of heavy occlusion. Tracking is performed independently, on the image and ground plane, in global, motion compensated coordinates. We employ Camera and LiDAR data fusion to solve the association problem where the optimal solution is found by matching 2D and 3D detections to tracks using a joint log-likelihood observation model. Each 2D–3D particle filter then updates their state from associated observations and a behavioral motion model. Each particle moves independently following the pedestrian motion parameters which we learned offline from an annotated training dataset. Temporal stability of the state variables is achieved by modeling each track as a Markov Decision Process with probabilistic state transition properties. A novel track management system then handles high level actions such as track creation, deletion and interaction. Using a probabilistic track score the track manager can cull false and ambiguous detections while updating tracks with detections from actual pedestrians. Our system is implemented on a GPU and exploits the massively parallelizable nature of particle filters. Due to the Markovian nature of our track representation, the system achieves real-time performance operating with a minimal memory footprint. Exhaustive and independent evaluation of our tracker was performed by the KITTI benchmark server, where it was tested against a wide variety of unknown pedestrian tracking situations. On this realistic benchmark, we outperform all published pedestrian trackers in a multitude of tracking metrics. View Full-Text
Keywords: pedestrian tracking; multi-object tracking; particle filter; behavioral; sensor fusion; LiDAR; autonomous vehicle; driverless car pedestrian tracking; multi-object tracking; particle filter; behavioral; sensor fusion; LiDAR; autonomous vehicle; driverless car
Show Figures

Figure 1

MDPI and ACS Style

Dimitrievski, M.; Veelaert, P.; Philips, W. Behavioral Pedestrian Tracking Using a Camera and LiDAR Sensors on a Moving Vehicle. Sensors 2019, 19, 391.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop