Next Article in Journal
Organoleptic Analysis of Drinking Water Using an Electronic Tongue Based on Electrochemical Microsensors
Previous Article in Journal
Device Identification Interoperability in Heterogeneous IoT Platforms
Open AccessArticle

One-Stage Multi-Sensor Data Fusion Convolutional Neural Network for 3D Object Detection

by Minle Li 1,*, Yihua Hu 1,2,*, Nanxiang Zhao 1,2 and Qishu Qian 1
1
State Key Laboratory of Pulsed Power Laser Technology, College of Electronic Engineering (National University of Defence Technology), Hefei 230037, China
2
Anhui Province Key Laboratory of Electronic Restriction Technology, Hefei 230037, China
*
Authors to whom correspondence should be addressed.
Sensors 2019, 19(6), 1434; https://doi.org/10.3390/s19061434
Received: 21 February 2019 / Revised: 17 March 2019 / Accepted: 20 March 2019 / Published: 23 March 2019
(This article belongs to the Section Remote Sensors, Control, and Telemetry)
Three-dimensional (3D) object detection has important applications in robotics, automatic loading, automatic driving and other scenarios. With the improvement of devices, people can collect multi-sensor/multimodal data from a variety of sensors such as Lidar and cameras. In order to make full use of various information advantages and improve the performance of object detection, we proposed a Complex-Retina network, a convolution neural network for 3D object detection based on multi-sensor data fusion. Firstly, a unified architecture with two feature extraction networks was designed, and the feature extraction of point clouds and images from different sensors realized synchronously. Then, we set a series of 3D anchors and projected them to the feature maps, which were cropped into 2D anchors with the same size and fused together. Finally, the object classification and 3D bounding box regression were carried out on the multipath of fully connected layers. The proposed network is a one-stage convolution neural network, which achieves the balance between the accuracy and speed of object detection. The experiments on KITTI datasets show that the proposed network is superior to the contrast algorithms in average precision (AP) and time consumption, which shows the effectiveness of the proposed network. View Full-Text
Keywords: multi-sensor; object detection; convolutional neural network; point cloud multi-sensor; object detection; convolutional neural network; point cloud
Show Figures

Figure 1

MDPI and ACS Style

Li, M.; Hu, Y.; Zhao, N.; Qian, Q. One-Stage Multi-Sensor Data Fusion Convolutional Neural Network for 3D Object Detection. Sensors 2019, 19, 1434.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop