Next Article in Journal
The Wettability and Numerical Model of Different Silicon Microstructural Surfaces
Next Article in Special Issue
A Deep Temporal Neural Music Recommendation Model Utilizing Music and User Metadata
Previous Article in Journal
Dual-Functional Nanoscale Devices Using Phase-Change Materials: A Reconfigurable Perfect Absorber with Nonvolatile Resistance-Change Memory Characteristics
Previous Article in Special Issue
Diverse Decoding for Abstractive Document Summarization
Article Menu
Issue 3 (February-1) cover image

Export Article

Open AccessArticle
Appl. Sci. 2019, 9(3), 565; https://doi.org/10.3390/app9030565

Multiscale Object Detection in Infrared Streetscape Images Based on Deep Learning and Instance Level Data Augmentation

College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Received: 24 December 2018 / Revised: 28 January 2019 / Accepted: 30 January 2019 / Published: 8 February 2019
(This article belongs to the Special Issue Advances in Deep Learning)
Full-Text   |   PDF [3141 KB, uploaded 12 February 2019]   |  

Abstract

The development of object detection in infrared images has attracted more attention in recent years. However, there are few studies on multi-scale object detection in infrared street scene images. Additionally, the lack of high-quality infrared datasets hinders research into such algorithms. In order to solve these issues, we firstly make a series of modifications based on Faster Region-Convolutional Neural Network (R-CNN). In this paper, a double-layer region proposal network (RPN) is proposed to predict proposals of different scales on both fine and coarse feature maps. Secondly, a multi-scale pooling module is introduced into the backbone of the network to explore the response of objects on different scales. Furthermore, the inception4 module and the position sensitive region of interest (ROI) align (PSalign) pooling layer are utilized to explore richer features of the objects. Thirdly, this paper proposes instance level data augmentation, which takes into account the imbalance between categories while enlarging dataset. In the training stage, the online hard example mining method is utilized to further improve the robustness of the algorithm in complex environments. The experimental results show that, compared with baseline, our detection method has state-of-the-art performance. View Full-Text
Keywords: infrared streetscape images; multiscale object detection; Faster R-CNN; instance level data augmentation infrared streetscape images; multiscale object detection; Faster R-CNN; instance level data augmentation
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Qu, H.; Zhang, L.; Wu, X.; He, X.; Hu, X.; Wen, X. Multiscale Object Detection in Infrared Streetscape Images Based on Deep Learning and Instance Level Data Augmentation. Appl. Sci. 2019, 9, 565.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Appl. Sci. EISSN 2076-3417 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top