Next Article in Journal
Previous Article in Journal
Sensors 2012, 12(8), 10326-10338; doi:10.3390/s120810326
Article

Multi-Sensor Fusion of Infrared and Electro-Optic Signals for High Resolution Night Images

1,* , 2
, 1
 and 1
Received: 4 June 2012; in revised form: 8 July 2012 / Accepted: 12 July 2012 / Published: 30 July 2012
(This article belongs to the Section Physical Sensors)
View Full-Text   |   Download PDF [1857 KB, uploaded 21 June 2014]
Abstract: Electro-optic (EO) image sensors exhibit the properties of high resolution and low noise level at daytime, but they do not work in dark environments. Infrared (IR) image sensors exhibit poor resolution and cannot separate objects with similar temperature. Therefore, we propose a novel framework of IR image enhancement based on the information (e.g., edge) from EO images, which improves the resolution of IR images and helps us distinguish objects at night. Our framework superimposing/blending the edges of the EO image onto the corresponding transformed IR image improves their resolution. In this framework, we adopt the theoretical point spread function (PSF) proposed by Hardie et al. for the IR image, which has the modulation transfer function (MTF) of a uniform detector array and the incoherent optical transfer function (OTF) of diffraction-limited optics. In addition, we design an inverse filter for the proposed PSF and use it for the IR image transformation. The framework requires four main steps: (1) inverse filter-based IR image transformation; (2) EO image edge detection; (3) registration; and (4) blending/superimposing of the obtained image pair. Simulation results show both blended and superimposed IR images, and demonstrate that blended IR images have better quality over the superimposed images. Additionally, based on the same steps, simulation result shows a blended IR image of better quality when only the original IR image is available.
Keywords: theoretical PSF; inverse filter design; IR image transformation; EO image edge detection; image pair blending/superimposing theoretical PSF; inverse filter design; IR image transformation; EO image edge detection; image pair blending/superimposing
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Huang, X.; Netravali, R.; Man, H.; Lawrence, V. Multi-Sensor Fusion of Infrared and Electro-Optic Signals for High Resolution Night Images. Sensors 2012, 12, 10326-10338.

AMA Style

Huang X, Netravali R, Man H, Lawrence V. Multi-Sensor Fusion of Infrared and Electro-Optic Signals for High Resolution Night Images. Sensors. 2012; 12(8):10326-10338.

Chicago/Turabian Style

Huang, Xiaopeng; Netravali, Ravi; Man, Hong; Lawrence, Victor. 2012. "Multi-Sensor Fusion of Infrared and Electro-Optic Signals for High Resolution Night Images." Sensors 12, no. 8: 10326-10338.



Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert