Next Article in Journal
Electromagnetic Simulation Flow for Integrated Power Electronics Modules
Next Article in Special Issue
Wildfire and Smoke Detection Using Staged YOLO Model and Ensemble CNN
Previous Article in Journal
Fault Diagnosis and Tolerant Control for Three-Level T-Type Inverters
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Super-Resolution Reconstruction Model of Spatiotemporal Fusion Remote Sensing Image Based on Double Branch Texture Transformers and Feedback Mechanism

1
College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China
2
School of Software, Xinjiang University, Urumqi 830046, China
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(16), 2497; https://doi.org/10.3390/electronics11162497
Submission received: 27 June 2022 / Revised: 31 July 2022 / Accepted: 1 August 2022 / Published: 10 August 2022
(This article belongs to the Special Issue Remote Sensing Image Processing)

Abstract

High spatial-temporal resolution plays a vital role in the application of geoscience dynamic observance and prediction. However, thanks to the constraints of technology and budget, it is troublesome for one satellite detector to get high spatial-temporal resolution remote sensing images. Individuals have developed spatiotemporal image fusion technology to resolve this downside, and deep remote sensing images with spatiotemporal resolution have become a possible and efficient answer. Due to the fixed size of the receptive field of convolutional neural networks, the features extracted by convolution operations cannot capture long-range features, so the correlation of global features cannot be modeled in the deep learning process. We propose a spatiotemporal fusion model of remote sensing images to solve these problems based on a dual branch feedback mechanism and texture transformer. The model separates the network from the coarse-fine images with similar structures through the idea of double branches and reduces the dependence of images on time series. It principally merges the benefits of transformer and convolution network and employs feedback mechanism and texture transformer to extract additional spatial and temporal distinction features. The primary function of the transformer module is to learn global temporal correlations and fuse temporal features with spatial features. To completely extract additional elaborated features in several stages, we have a tendency to design a feedback mechanism module. This module chiefly refines the low-level representation through high-level info and obtains additional elaborated features when considering the temporal and spacial characteristics. We have a tendency to receive good results by comparison with four typical spatiotemporal fusion algorithms, proving our model’s superiority and robustness.
Keywords: remote sensing images; spatiotemporal image fusion; feedback mechanism; texture tran-sformer; detailed features remote sensing images; spatiotemporal image fusion; feedback mechanism; texture tran-sformer; detailed features

Share and Cite

MDPI and ACS Style

Liu, H.; Qian, Y.; Yang, G.; Jiang, H. Super-Resolution Reconstruction Model of Spatiotemporal Fusion Remote Sensing Image Based on Double Branch Texture Transformers and Feedback Mechanism. Electronics 2022, 11, 2497. https://doi.org/10.3390/electronics11162497

AMA Style

Liu H, Qian Y, Yang G, Jiang H. Super-Resolution Reconstruction Model of Spatiotemporal Fusion Remote Sensing Image Based on Double Branch Texture Transformers and Feedback Mechanism. Electronics. 2022; 11(16):2497. https://doi.org/10.3390/electronics11162497

Chicago/Turabian Style

Liu, Hui, Yurong Qian, Guangqi Yang, and Hao Jiang. 2022. "Super-Resolution Reconstruction Model of Spatiotemporal Fusion Remote Sensing Image Based on Double Branch Texture Transformers and Feedback Mechanism" Electronics 11, no. 16: 2497. https://doi.org/10.3390/electronics11162497

APA Style

Liu, H., Qian, Y., Yang, G., & Jiang, H. (2022). Super-Resolution Reconstruction Model of Spatiotemporal Fusion Remote Sensing Image Based on Double Branch Texture Transformers and Feedback Mechanism. Electronics, 11(16), 2497. https://doi.org/10.3390/electronics11162497

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop