Next Article in Journal
Effect of Local Gas Flow in Full Penetration Laser Beam Welding with High Welding Speeds
Next Article in Special Issue
An Overview on the Latest Nature-Inspired and Metaheuristics-Based Image Registration Algorithms
Previous Article in Journal
Image Magnification Based on Bicubic Approximation with Edge as Constraint
Previous Article in Special Issue
Symbiotic Organism Search Algorithm with Multi-Group Quantum-Behavior Communication Scheme Applied in Wireless Sensor Networks
Open AccessArticle

Pedestrian Detection Based on Two-Stream UDN

by 1,2,3, 1,2,3, 4, 1,2,3,* and 1,2,3
Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing University of Technology, Beijing 100124, China
Beijing Artificial Intelligence Institute, Beijing University of Technology, Beijing 100124, China
Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
CITIC Guoan Broadcom Network Co., Ltd., Beijing 100176, China
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(5), 1866;
Received: 3 January 2020 / Revised: 28 February 2020 / Accepted: 4 March 2020 / Published: 9 March 2020
(This article belongs to the Special Issue Intelligence Systems and Sensors)
Pedestrian detection is the core of the driver assistance system, which collects the road conditions through the radars or cameras on the vehicle, judges whether there is a pedestrian in front of the vehicle, supports decisions such as raising the alarm, automatically slowing down, or emergency stopping to keep pedestrians safe, and improves the security when the vehicle is moving. Suffering from weather, lighting, clothing, large pose variations, and occlusion, the current pedestrian detection still has a certain distance from the practical applications. In recent years, deep networks have shown excellent performance for image detection, recognition, and classification. Some researchers employed deep network for pedestrian detection and achieve great progress, but deep networks need huge computational resources, which make it difficult to put into practical applications. In real scenarios of autonomous vehicles, the computation ability is limited. Thus, the shallow networks such as UDN (Unified Deep Networks) is a better choice, since it performs well while consuming less computation resources. Based on UDN, this paper proposes a new deep network model named two-stream UDN, which augments another branch for solving traditional UDN’s indistinction of the difference between trees/telegraph poles and pedestrians. The new branch accepts the upper third part of the pedestrian image as input, and the partial image has less deformation, stable features, and more distinguished characters from other objects. For the proposed two-stream UDN, multi-input features including the HOG (Histogram of Oriented Gradients) feature, Sobel feature, color feature, and foreground regions extracted by GrabCut segmentation algorithms are fed. Compared with the original input of UDN, the multi-input features are more conducive for pedestrian detection, since the fused HOG features and significant objects are more significant for pedestrian detection. Two-stream UDN is trained through two steps. First, the two sub-networks are trained until converge; then, we fuse results of the two subnets as the final result and feed it back to the two subnets to fine tune network parameters synchronously. To improve the performance, Swish is adopted as the activation function to obtain a faster training speed, and positive samples are mirrored and rotated with small angles to make the positive and negative samples more balanced. View Full-Text
Keywords: pedestrian detection; Unified Deep Net; two-stream nets; network training pedestrian detection; Unified Deep Net; two-stream nets; network training
Show Figures

Figure 1

MDPI and ACS Style

Wang, W.; Wang, L.; Ge, X.; Li, J.; Yin, B. Pedestrian Detection Based on Two-Stream UDN. Appl. Sci. 2020, 10, 1866.

AMA Style

Wang W, Wang L, Ge X, Li J, Yin B. Pedestrian Detection Based on Two-Stream UDN. Applied Sciences. 2020; 10(5):1866.

Chicago/Turabian Style

Wang, Wentong; Wang, Lichun; Ge, Xufei; Li, Jinghua; Yin, Baocai. 2020. "Pedestrian Detection Based on Two-Stream UDN" Appl. Sci. 10, no. 5: 1866.

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Search more from Scilit
Back to TopTop