Next Article in Journal
Climate Change and Anthropogenic Impacts on Wetland and Agriculture in the Songnen and Sanjiang Plain, Northeast China
Next Article in Special Issue
Urban Land Use Mapping by Combining Remote Sensing Imagery and Mobile Phone Positioning Data
Previous Article in Journal
Snow Density and Ground Permittivity Retrieved from L-Band Radiometry: Melting Effects
Open AccessArticle

Matching of Remote Sensing Images with Complex Background Variations via Siamese Convolutional Neural Network

by Haiqing He 1,*, Min Chen 2, Ting Chen 3 and Dajun Li 1
1
School of Geomatics, East China University of Technology, Nanchang 330013, China
2
Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 611756, China
3
School of Water Resources & Environmental Engineering, East China University of Technology, Nanchang 330013, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2018, 10(2), 355; https://doi.org/10.3390/rs10020355
Received: 22 January 2018 / Revised: 21 February 2018 / Accepted: 22 February 2018 / Published: 24 February 2018
(This article belongs to the Special Issue Multisensor Data Fusion in Remote Sensing)
Feature-based matching methods have been widely used in remote sensing image matching given their capability to achieve excellent performance despite image geometric and radiometric distortions. However, most of the feature-based methods are unreliable for complex background variations, because the gradient or other image grayscale information used to construct the feature descriptor is sensitive to image background variations. Recently, deep learning-based methods have been proven suitable for high-level feature representation and comparison in image matching. Inspired by the progresses made in deep learning, a new technical framework for remote sensing image matching based on the Siamese convolutional neural network is presented in this paper. First, a Siamese-type network architecture is designed to simultaneously learn the features and the corresponding similarity metric from labeled training examples of matching and non-matching true-color patch pairs. In the proposed network, two streams of convolutional and pooling layers sharing identical weights are arranged without the manually designed features. The number of convolutional layers is determined based on the factors that affect image matching. The sigmoid function is employed to compute the matching and non-matching probabilities in the output layer. Second, a gridding sub-pixel Harris algorithm is used to obtain the accurate localization of candidate matches. Third, a Gaussian pyramid coupling quadtree is adopted to gradually narrow down the searching space of the candidate matches, and multiscale patches are compared synchronously. Subsequently, a similarity measure based on the output of the sigmoid is adopted to find the initial matches. Finally, the random sample consensus algorithm and the whole-to-local quadratic polynomial constraints are used to remove false matches. In the experiments, different types of satellite datasets, such as ZY3, GF1, IKONOS, and Google Earth images, with complex background variations are used to evaluate the performance of the proposed method. The experimental results demonstrate that the proposed method, which can significantly improve the matching performance of multi-temporal remote sensing images with complex background variations, is better than the state-of-the-art matching methods. In our experiments, the proposed method obtained a large number of evenly distributed matches (at least 10 times more than other methods) and achieved a high accuracy (less than 1 pixel in terms of root mean square error). View Full-Text
Keywords: image matching; Siamese convolutional neural network; background variation; sub-pixel Harris algorithm; Gaussian pyramid coupling quadtree image matching; Siamese convolutional neural network; background variation; sub-pixel Harris algorithm; Gaussian pyramid coupling quadtree
Show Figures

Graphical abstract

MDPI and ACS Style

He, H.; Chen, M.; Chen, T.; Li, D. Matching of Remote Sensing Images with Complex Background Variations via Siamese Convolutional Neural Network. Remote Sens. 2018, 10, 355.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop