Sensors 2014, 14(5), 9046-9073; doi:10.3390/s140509046

Robust Curb Detection with Fusion of 3D-Lidar and Camera Data

1,2,* email, 1email, 1email and 1email
Received: 12 March 2014; in revised form: 9 May 2014 / Accepted: 16 May 2014 / Published: 21 May 2014
(This article belongs to the Section Physical Sensors)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: Curb detection is an essential component of Autonomous Land Vehicles (ALV), especially important for safe driving in urban environments. In this paper, we propose a fusion-based curb detection method through exploiting 3D-Lidar and camera data. More specifically, we first fuse the sparse 3D-Lidar points and high-resolution camera images together to recover a dense depth image of the captured scene. Based on the recovered dense depth image, we propose a filter-based method to estimate the normal direction within the image. Then, by using the multi-scale normal patterns based on the curb’s geometric property, curb point features fitting the patterns are detected in the normal image row by row. After that, we construct a Markov Chain to model the consistency of curb points which utilizes the continuous property of the curb, and thus the optimal curb path which links the curb points together can be efficiently estimated by dynamic programming. Finally, we perform post-processing operations to filter the outliers, parameterize the curbs and give the confidence scores on the detected curbs. Extensive evaluations clearly show that our proposed method can detect curbs with strong robustness at real-time speed for both static and dynamic scenes.
Keywords: curb detection; fusion; 3D-lidar; camera; depth image; Markov chain
PDF Full-text Download PDF Full-Text [14675 KB, Updated Version, uploaded 21 June 2014 14:31 CEST]
The original version is still available [1637 KB, uploaded 21 June 2014 14:31 CEST]

Export to BibTeX |

MDPI and ACS Style

Tan, J.; Li, J.; An, X.; He, H. Robust Curb Detection with Fusion of 3D-Lidar and Camera Data. Sensors 2014, 14, 9046-9073.

AMA Style

Tan J, Li J, An X, He H. Robust Curb Detection with Fusion of 3D-Lidar and Camera Data. Sensors. 2014; 14(5):9046-9073.

Chicago/Turabian Style

Tan, Jun; Li, Jian; An, Xiangjing; He, Hangen. 2014. "Robust Curb Detection with Fusion of 3D-Lidar and Camera Data." Sensors 14, no. 5: 9046-9073.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert