AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention

Tu, Ziming; Yang, Xiubin; Tang, Xingyu; Xu, Tingting; He, Xi; Liu, Penglin; Jiang, Li; Fu, Zongqiang

doi:10.3390/rs15225409

Open AccessArticle

AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention

by

Ziming Tu

^1,2

,

Xiubin Yang

^1,*,

Xingyu Tang

^1,2,

Tingting Xu

³,

Xi He

^1,2,

Penglin Liu

⁴,

Li Jiang

⁴ and

Zongqiang Fu

^1,2

¹

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

²

Daheng College, University of Chinese Academy of Sciences, Beijing 100039, China

³

School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China

⁴

Physics Department, Changchun University of Science and Technology, Changchun 130022, China

^*

Author to whom correspondence should be addressed.

Remote Sens. 2023, 15(22), 5409; https://doi.org/10.3390/rs15225409

Submission received: 8 September 2023 / Revised: 2 November 2023 / Accepted: 13 November 2023 / Published: 18 November 2023

(This article belongs to the Special Issue Advances and Challenges on Multisource Remote Sensing Image Fusion: Datasets, New Technologies, and Applications)

Download

Browse Figures

Versions Notes

Abstract

Reference-based super-resolution (RefSR) has achieved remarkable progress and shows promising potential applications in the field of remote sensing. However, previous studies heavily rely on existing and high-resolution reference image (Ref), which is hard to obtain in remote sensing practice. To address this issue, a novel structure based on a zoom camera structure (ZCS) together with a novel RefSR network, namely AEFormer, is proposed. The proposed ZCS provides a more accessible way to obtain valid Ref than traditional fixed-length camera imaging or external datasets. The physics-enabled network, AEFormer, is proposed to super-resolve low-resolution images (LR). With reasonably aligned and enhanced attention, AEFormer alleviates the misalignment problem, which is challenging yet common in RefSR tasks. Herein, it contributes to maximizing the utilization of spatial information across the whole image and better fusion between Ref and LR. Extensive experimental results on benchmark dataset RRSSRD and real-world prototype data both verify the effectiveness of the proposed method. Hopefully, ZCS and AEFormer can enlighten a new model for future remote sensing imagery super-resolution.

Keywords: remote sensing imagery; reference-based super-resolution; attention

Share and Cite

MDPI and ACS Style

Tu, Z.; Yang, X.; Tang, X.; Xu, T.; He, X.; Liu, P.; Jiang, L.; Fu, Z. AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention. Remote Sens. 2023, 15, 5409. https://doi.org/10.3390/rs15225409

AMA Style

Tu Z, Yang X, Tang X, Xu T, He X, Liu P, Jiang L, Fu Z. AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention. Remote Sensing. 2023; 15(22):5409. https://doi.org/10.3390/rs15225409

Chicago/Turabian Style

Tu, Ziming, Xiubin Yang, Xingyu Tang, Tingting Xu, Xi He, Penglin Liu, Li Jiang, and Zongqiang Fu. 2023. "AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention" Remote Sensing 15, no. 22: 5409. https://doi.org/10.3390/rs15225409

APA Style

Tu, Z., Yang, X., Tang, X., Xu, T., He, X., Liu, P., Jiang, L., & Fu, Z. (2023). AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention. Remote Sensing, 15(22), 5409. https://doi.org/10.3390/rs15225409

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

AEFormer: Zoom Camera Enables Remote Sensing Super-Resolution via Aligned and Enhanced Attention

Abstract

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI