Next Article in Journal
Pattern Classification by the Hotelling Statistic and Application to Knee Osteoarthritis Kinematic Signals
Previous Article in Journal
Generalization of Parameter Selection of SVM and LS-SVM for Regression
Open AccessArticle

Semi-Supervised Faster RCNN-Based Person Detection and Load Classification for Far Field Video Surveillance

Department of Electrical and Computer Engineering, University of Texas at Dallas, Richardson 75080, USA
*
Author to whom correspondence should be addressed.
Mach. Learn. Knowl. Extr. 2019, 1(3), 756-767; https://doi.org/10.3390/make1030044
Received: 26 May 2019 / Revised: 24 June 2019 / Accepted: 25 June 2019 / Published: 27 June 2019
This paper presents a semi-supervised faster region-based convolutional neural network (SF-RCNN) approach to detect persons and to classify the load carried by them in video data captured from distances several miles away via high-power lens video cameras. For detection, a set of computationally efficient image processing steps are considered to identify moving areas that may contain a person. These areas are then passed onto a faster RCNN classifier whose convolutional layers consist of ResNet50 transfer learning. Frame labels are obtained in a semi-supervised manner for the training of the faster RCNN classifier. For load classification, another convolutional neural network classifier whose convolutional layers consist of GoogleNet transfer learning is used to distinguish a person carrying a bundle from a person carrying a long arm. Despite the challenges associated with the video dataset examined in terms of the low resolution of persons, the presence of heat haze, and the shaking of the camera, it is shown that the developed approach outperforms the faster RCNN approach. View Full-Text
Keywords: person detection and load classification; semi-supervised faster RCNN; far field video surveillance person detection and load classification; semi-supervised faster RCNN; far field video surveillance
Show Figures

Figure 1

MDPI and ACS Style

Wei, H.; Kehtarnavaz, N. Semi-Supervised Faster RCNN-Based Person Detection and Load Classification for Far Field Video Surveillance. Mach. Learn. Knowl. Extr. 2019, 1, 756-767.

Show more citation formats Show less citations formats

Article Access Map by Country/Region

1
Back to TopTop