A Novel Adversarial Based Hyperspectral and Multispectral Image Fusion
1
School of Astronautics, Beihang University, Beijing 100191, China
2
School of Information Technology and Electrical Engineering, University of New South Wales, Canberra, NSW 2600, Australia
*
Author to whom correspondence should be addressed.
Remote Sens. 2019, 11(5), 492; https://doi.org/10.3390/rs11050492
Received: 27 January 2019 / Revised: 24 February 2019 / Accepted: 25 February 2019 / Published: 28 February 2019
In order to reconstruct a high spatial and high spectral resolution image (H2SI), one of the most common methods is to fuse a hyperspectral image (HSI) with a corresponding multispectral image (MSI). To effectively obtain both the spectral correlation of bands in HSI and the spatial correlation of pixels in MSI, this paper proposes an adversarial selection fusion (ASF) method for the HSI–MSI fusion problem. Firstly, the unmixing based fusion (UF) method is adopted to dig out the spatial correlation in MSI. Then, to acquire the spectral correlation in HSI, a band reconstruction-based fusion (BRF) method is proposed, regarding H2SI as the product of the optimized band image dictionary and reconstruction coefficients. Finally, spectral spatial quality (SSQ) index is designed to guide the adversarial selection process of UF and BRF. Experimental results on four real-world images demonstrate that the proposed strategy achieves smaller errors and better reconstruction results than other comparison methods.
View Full-Text
Keywords:
hyperspectral image (HSI); multispectral image (MSI); data fusion; spectral unmixing; resolution enhancement
▼
Show Figures
Graphical abstract
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
MDPI and ACS Style
Luo, X.; Yin, J.; Luo, X.; Jia, X. A Novel Adversarial Based Hyperspectral and Multispectral Image Fusion. Remote Sens. 2019, 11, 492. https://doi.org/10.3390/rs11050492
AMA Style
Luo X, Yin J, Luo X, Jia X. A Novel Adversarial Based Hyperspectral and Multispectral Image Fusion. Remote Sensing. 2019; 11(5):492. https://doi.org/10.3390/rs11050492
Chicago/Turabian StyleLuo, Xukun; Yin, Jihao; Luo, Xiaoyan; Jia, Xiuping. 2019. "A Novel Adversarial Based Hyperspectral and Multispectral Image Fusion" Remote Sens. 11, no. 5: 492. https://doi.org/10.3390/rs11050492
Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
Search more from Scilit
