Next Article in Journal
Chladni Figures in Modal Analysis of a Double-Panel Structure
Next Article in Special Issue
Virtual to Real Adaptation of Pedestrian Detectors
Previous Article in Journal
Integrated Rogowski Coil Sensor for Press-Pack Insulated Gate Bipolar Transistor Chips
Previous Article in Special Issue
A Light-Weight Practical Framework for Feces Detection and Trait Recognition
Open AccessArticle

Weighted Kernel Filter Based Anti-Air Object Tracking for Thermal Infrared Systems

by Chuljoong Kim 1,2 and Hanseok Ko 1,*
1
Department of Video Information Processing, Korea University, Seoul 136-713, Korea
2
Hanwha Systems Co., Sungnam 461-140, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(15), 4081; https://doi.org/10.3390/s20154081
Received: 23 June 2020 / Revised: 16 July 2020 / Accepted: 20 July 2020 / Published: 22 July 2020
(This article belongs to the Special Issue Visual Sensor Networks for Object Detection and Tracking)
Visual object tracking is an important component of surveillance systems and many high-performance methods have been developed. However, these tracking methods tend to be optimized for the Red/Green/Blue (RGB) domain and are thus not suitable for use with the infrared (IR) domain. To overcome this disadvantage, many researchers have constructed datasets for IR analysis, including those developed for The Thermal Infrared Visual Object Tracking (VOT-TIR) challenges. As a consequence, many state-of-the-art trackers for the IR domain have been proposed, but there remains a need for reliable IR-based trackers for anti-air surveillance systems, including the construction of a new IR dataset for this purpose. In this paper, we collect various anti-air thermal-wave IR (TIR) images from an electro-optical surveillance system to create a new dataset. We also present a framework based on an end-to-end convolutional neural network that learns object tracking in the IR domain for anti-air targets such as unmanned aerial vehicles (UAVs) and drones. More specifically, we adopt a Siamese network for feature extraction and three region proposal networks for the classification and regression branches. In the inference phase, the proposed network is formulated as a detection-by-tracking method, and kernel filters for the template branch that are continuously updated for every frame are introduced. The proposed network is able to learn robust structural information for the targets during offline training, and the kernel filters can robustly track the targets, demonstrating enhanced performance. Experimental results from the new IR dataset reveal that the proposed method achieves outstanding performance, with a real-time processing speed of 40 frames per second. View Full-Text
Keywords: visual object tracking; thermal infrared (TIR); region proposal network (RPN); convolutional neural network (CNN); weighted kernel filter (WKF) visual object tracking; thermal infrared (TIR); region proposal network (RPN); convolutional neural network (CNN); weighted kernel filter (WKF)
Show Figures

Figure 1

MDPI and ACS Style

Kim, C.; Ko, H. Weighted Kernel Filter Based Anti-Air Object Tracking for Thermal Infrared Systems. Sensors 2020, 20, 4081.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop