Next Article in Journal
New Global View of Above-Cloud Absorbing Aerosol Distribution Based on CALIPSO Measurements
Next Article in Special Issue
Hyperspectral Pansharpening Based on Spectral Constrained Adversarial Autoencoder
Previous Article in Journal
Rapid and Accurate Monitoring of Intertidal Oyster Reef Habitat Using Unoccupied Aircraft Systems and Structure from Motion
Previous Article in Special Issue
Spatial–Spectral Fusion in Different Swath Widths by a Recurrent Expanding Residual Convolutional Neural Network
Open AccessArticle

Deep Self-Learning Network for Adaptive Pansharpening

by Jie Hu, Zhi He * and Jiemin Wu
School of Geography and Planning, Guangdong Provincial Key Laboratory of Urbanization and Geo-simulation, Center of Integrated Geographic Information Analysis, Sun Yat-sen University (SYSU), Guangzhou 510275, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2019, 11(20), 2395; https://doi.org/10.3390/rs11202395
Received: 10 September 2019 / Revised: 12 October 2019 / Accepted: 13 October 2019 / Published: 16 October 2019
(This article belongs to the Special Issue Remote Sensing Image Restoration and Reconstruction)
Deep learning (DL)-based paradigms have recently made many advances in image pansharpening. However, most of the existing methods directly downscale the multispectral (MSI) and panchromatic (PAN) images with default blur kernel to construct the training set, which will lead to the deteriorative results when the real image does not obey this degradation. In this paper, a deep self-learning (DSL) network is proposed for adaptive image pansharpening. First, rather than using the fixed blur kernel, a point spread function (PSF) estimation algorithm is proposed to obtain the blur kernel of the MSI. Second, an edge-detection-based pixel-to-pixel image registration method is designed to recover the local misalignments between MSI and PAN. Third, the original data is downscaled by the estimated PSF and the pansharpening network is trained in the down-sampled domain. The high-resolution result can be finally predicted by the trained DSL network using the original MSI and PAN. Extensive experiments on three images collected by different satellites prove the superiority of our DSL technique, compared with some state-of-the-art approaches. View Full-Text
Keywords: pansharpening; deep learning; PSF estimation; image registration; convolutional neural network pansharpening; deep learning; PSF estimation; image registration; convolutional neural network
Show Figures

Graphical abstract

MDPI and ACS Style

Hu, J.; He, Z.; Wu, J. Deep Self-Learning Network for Adaptive Pansharpening. Remote Sens. 2019, 11, 2395.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop