Next Article in Journal
Comparative Assessments of the Latest GPM Mission’s Spatially Enhanced Satellite Rainfall Products over the Main Bolivian Watersheds
Next Article in Special Issue
Good Practices for Object-Based Accuracy Assessment
Previous Article in Journal
Mapping 2000–2010 Impervious Surface Change in India Using Global Land Survey Landsat Data
Previous Article in Special Issue
An Open-Source Semi-Automated Processing Chain for Urban Object-Based Classification
Article Menu
Issue 4 (April) cover image

Export Article

Open AccessArticle
Remote Sens. 2017, 9(4), 368; doi:10.3390/rs9040368

Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images

1
ONERA, The French Aerospace Lab, F-91761 Palaiseau, France
2
Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), University Bretagne Sud, UMR 6074, F-56000 Vannes, France
*
Author to whom correspondence should be addressed.
Academic Editors: Norman Kerle, Markus Gerke and Prasad S. Thenkabail
Received: 28 December 2016 / Revised: 5 April 2017 / Accepted: 7 April 2017 / Published: 13 April 2017
View Full-Text   |   Download PDF [5318 KB, uploaded 14 April 2017]   |  

Abstract

Like computer vision before, remote sensing has been radically changed by the introduction of deep learning and, more notably, Convolution Neural Networks. Land cover classification, object detection and scene understanding in aerial images rely more and more on deep networks to achieve new state-of-the-art results. Recent architectures such as Fully Convolutional Networks can even produce pixel level annotations for semantic mapping. In this work, we present a deep-learning based segment-before-detect method for segmentation and subsequent detection and classification of several varieties of wheeled vehicles in high resolution remote sensing images. This allows us to investigate object detection and classification on a complex dataset made up of visually similar classes, and to demonstrate the relevance of such a subclass modeling approach. Especially, we want to show that deep learning is also suitable for object-oriented analysis of Earth Observation data as effective object detection can be obtained as a byproduct of accurate semantic segmentation. First, we train a deep fully convolutional network on the ISPRS Potsdam and the NZAM/ONERA Christchurch datasets and show how the learnt semantic maps can be used to extract precise segmentation of vehicles. Then, we show that those maps are accurate enough to perform vehicle detection by simple connected component extraction. This allows us to study the repartition of vehicles in the city. Finally, we train a Convolutional Neural Network to perform vehicle classification on the VEDAI dataset, and transfer its knowledge to classify the individual vehicle instances that we detected. View Full-Text
Keywords: deep learning, vehicle detection, semantic segmentation, object classification deep learning, vehicle detection, semantic segmentation, object classification
Figures

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Audebert, N.; Le Saux, B.; Lefèvre, S. Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images. Remote Sens. 2017, 9, 368.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Remote Sens. EISSN 2072-4292 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top