Deep Color Transfer for Color-Plus-Mono Dual Cameras
College of Information Technology Convergence, Gachon University, Seongnam 1342, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(9), 2743; https://doi.org/10.3390/s20092743
Received: 25 March 2020
/
Revised: 3 May 2020
/
Accepted: 6 May 2020
/
Published: 11 May 2020
(This article belongs to the Section Optical Sensors)
A few approaches have studied image fusion using color-plus-mono dual cameras to improve the image quality in low-light shooting. Among them, the color transfer approach, which transfers the color information of a color image to a mono image, is considered to be promising for obtaining improved images with less noise and more detail. However, the color transfer algorithms rely heavily on appropriate color hints from a given color image. Unreliable color hints caused by errors in stereo matching of a color-plus-mono image pair can generate various visual artifacts in the final fused image. This study proposes a novel color transfer method that seeks reliable color hints from a color image and colorizes a corresponding mono image with reliable color hints that are based on a deep learning model. Specifically, a color-hint-based mask generation algorithm is developed to obtain reliable color hints. It removes unreliable color pixels using a reliability map computed by the binocular just-noticeable-difference model. In addition, a deep colorization network that utilizes structural information is proposed for solving the color bleeding artifact problem. The experimental results demonstrate that the proposed method provides better results than the existing image fusion algorithms for dual cameras.
View Full-Text
▼
Show Figures
Figure 1
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
MDPI and ACS Style
Jang, H.W.; Jung, Y.J. Deep Color Transfer for Color-Plus-Mono Dual Cameras. Sensors 2020, 20, 2743. https://doi.org/10.3390/s20092743
AMA Style
Jang HW, Jung YJ. Deep Color Transfer for Color-Plus-Mono Dual Cameras. Sensors. 2020; 20(9):2743. https://doi.org/10.3390/s20092743
Chicago/Turabian StyleJang, Hae W., and Yong J. Jung. 2020. "Deep Color Transfer for Color-Plus-Mono Dual Cameras" Sensors 20, no. 9: 2743. https://doi.org/10.3390/s20092743
Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
