Next Article in Journal
Previous Article in Journal
Sensors 2014, 14(5), 9046-9073; doi:10.3390/s140509046
Article

Robust Curb Detection with Fusion of 3D-Lidar and Camera Data

1,2,* , 1
, 1
 and 1
Received: 12 March 2014; in revised form: 9 May 2014 / Accepted: 16 May 2014 / Published: 21 May 2014
(This article belongs to the Section Physical Sensors)
Abstract: Curb detection is an essential component of Autonomous Land Vehicles (ALV), especially important for safe driving in urban environments. In this paper, we propose a fusion-based curb detection method through exploiting 3D-Lidar and camera data. More specifically, we first fuse the sparse 3D-Lidar points and high-resolution camera images together to recover a dense depth image of the captured scene. Based on the recovered dense depth image, we propose a filter-based method to estimate the normal direction within the image. Then, by using the multi-scale normal patterns based on the curb’s geometric property, curb point features fitting the patterns are detected in the normal image row by row. After that, we construct a Markov Chain to model the consistency of curb points which utilizes the continuous property of the curb, and thus the optimal curb path which links the curb points together can be efficiently estimated by dynamic programming. Finally, we perform post-processing operations to filter the outliers, parameterize the curbs and give the confidence scores on the detected curbs. Extensive evaluations clearly show that our proposed method can detect curbs with strong robustness at real-time speed for both static and dynamic scenes.
Keywords: curb detection; fusion; 3D-lidar; camera; depth image; Markov chain curb detection; fusion; 3D-lidar; camera; depth image; Markov chain
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Tan, J.; Li, J.; An, X.; He, H. Robust Curb Detection with Fusion of 3D-Lidar and Camera Data. Sensors 2014, 14, 9046-9073.

AMA Style

Tan J, Li J, An X, He H. Robust Curb Detection with Fusion of 3D-Lidar and Camera Data. Sensors. 2014; 14(5):9046-9073.

Chicago/Turabian Style

Tan, Jun; Li, Jian; An, Xiangjing; He, Hangen. 2014. "Robust Curb Detection with Fusion of 3D-Lidar and Camera Data." Sensors 14, no. 5: 9046-9073.



Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert