Next Article in Journal
A Review of Force Myography Research and Development
Previous Article in Journal
Optimal Target Assignment with Seamless Handovers for Networked Radars
Open AccessArticle

Infrared and Visible Image Fusion through Details Preservation

School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China
Author to whom correspondence should be addressed.
Sensors 2019, 19(20), 4556;
Received: 19 September 2019 / Revised: 14 October 2019 / Accepted: 16 October 2019 / Published: 20 October 2019
(This article belongs to the Section Intelligent Sensors)
In many actual applications, fused image is essential to contain high-quality details for achieving a comprehensive representation of the real scene. However, existing image fusion methods suffer from loss of details because of the error accumulations of sequential tasks. This paper proposes a novel fusion method to preserve details of infrared and visible images by combining new decomposition, feature extraction, and fusion scheme. For decomposition, different from the most decomposition methods by guided filter, the guidance image contains only the strong edge of the source image but no other interference information so that rich tiny details can be decomposed into the detailed part. Then, according to the different characteristics of infrared and visible detail parts, a rough convolutional neural network (CNN) and a sophisticated CNN are designed so that various features can be fully extracted. To integrate the extracted features, we also present a multi-layer features fusion strategy through discrete cosine transform (DCT), which not only highlights significant features but also enhances details. Moreover, the base parts are fused by weighting method. Finally, the fused image is obtained by adding the fused detail and base part. Different from the general image fusion methods, our method not only retains the target region of source image but also enhances background in the fused image. In addition, compared with state-of-the-art fusion methods, our proposed fusion method has many advantages, including (i) better visual quality of fused-image subjective evaluation, and (ii) better objective assessment for those images. View Full-Text
Keywords: image fusion; guided filter; details; CNN; DCT image fusion; guided filter; details; CNN; DCT
Show Figures

Figure 1

MDPI and ACS Style

Liu, Y.; Dong, L.; Ji, Y.; Xu, W. Infrared and Visible Image Fusion through Details Preservation. Sensors 2019, 19, 4556.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop