Next Article in Journal
An Affinity Propagation-Based Self-Adaptive Clustering Method for Wireless Sensor Networks
Next Article in Special Issue
A Strain-Based Method to Estimate Tire Parameters for Intelligent Tires under Complex Maneuvering Operations
Previous Article in Journal
Neural Network Direct Control with Online Learning for Shape Memory Alloy Manipulators
Previous Article in Special Issue
Multi-Stage Hough Space Calculation for Lane Markings Detection via IMU and Vision Fusion
Open AccessArticle

Semantic Segmentation with Transfer Learning for Off-Road Autonomous Driving

1
Department of Electrical and Computer Engineering, Mississippi State University, Starkville, MS 39762, USA
2
Center for Advanced Vehicular Systems, Mississippi State University, Starkville, MS 39762, USA
3
Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO 65211, USA
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(11), 2577; https://doi.org/10.3390/s19112577
Received: 2 April 2019 / Revised: 24 May 2019 / Accepted: 30 May 2019 / Published: 6 June 2019
(This article belongs to the Special Issue Intelligent Vehicles)
Since the state-of-the-art deep learning algorithms demand a large training dataset, which is often unavailable in some domains, the transfer of knowledge from one domain to another has been a trending technique in the computer vision field. However, this method may not be a straight-forward task considering several issues such as original network size or large differences between the source and target domain. In this paper, we perform transfer learning for semantic segmentation of off-road driving environments using a pre-trained segmentation network called DeconvNet. We explore and verify two important aspects regarding transfer learning. First, since the original network size was very large and did not perform well for our application, we proposed a smaller network, which we call the light-weight network. This light-weight network is half the size to the original DeconvNet architecture. We transferred the knowledge from the pre-trained DeconvNet to our light-weight network and fine-tuned it. Second, we used synthetic datasets as the intermediate domain before training with the real-world off-road driving data. Fine-tuning the model trained with the synthetic dataset that simulates the off-road driving environment provides more accurate results for the segmentation of real-world off-road driving environments than transfer learning without using a synthetic dataset does, as long as the synthetic dataset is generated considering real-world variations. We also explore the issue whereby the use of a too simple and/or too random synthetic dataset results in negative transfer. We consider the Freiburg Forest dataset as a real-world off-road driving dataset. View Full-Text
Keywords: semantic segmentation; transfer learning; autonomous; off-road driving semantic segmentation; transfer learning; autonomous; off-road driving
Show Figures

Figure 1

MDPI and ACS Style

Sharma, S.; Ball, J.E.; Tang, B.; Carruth, D.W.; Doude, M.; Islam, M.A. Semantic Segmentation with Transfer Learning for Off-Road Autonomous Driving. Sensors 2019, 19, 2577.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop