Abstract
Uncovering latent structures from complex, degraded data is a central challenge in modern unsupervised learning, with critical implications for downstream tasks. This principle is exemplified in the domain of aerial imagery, where the quality of images captured by drones is often compromised by complex, flight-induced degradations, thereby raising the information entropy and obscuring essential semantic patterns. Conventional super-resolution methods, trained on generic data, fail to restore these unique artifacts, thereby limiting their effectiveness for vessel identification, a task that fundamentally relies on clear pattern recognition. To bridge this gap, we introduce a novel adaptive super-resolution framework for ship images captured by drones. The approach integrates a static stage for foundational feature extraction and a dynamic stage for adaptive scene reconstruction, enabling robust performance in complex aerial environments. Furthermore, to ensure the super-resolution model’s generalizability and effectiveness, we optimize the design of degradation methods based on the characteristics of drone aerial images and construct a high-resolution dataset of ship images captured by drones. Extensive experiments demonstrate that our method surpasses existing state-of-the-art algorithms, confirming the efficacy of our proposed model and dataset.
1. Introduction
With the rapid advancement of drone technology, drones have been widely adopted in various fields, such as agricultural production [1], natural disaster monitoring [2], and military reconnaissance [3], owing to their flexibility and timeliness in information acquisition. However, the unique operational profile of drones introduces a constellation of severe and often intertwined degradation challenges that are far more complex than those encountered in conventional ground-based photography. Limitations in onboard sensor size and payload capacity often necessitate the use of less-than-optimal optics, directly compromising image clarity. Furthermore, the inherent instability of the aerial platform, even with advanced gimbals, induces unavoidable motion blur, which is exacerbated during high-speed maneuvers or in turbulent atmospheric conditions. Weather phenomena such as haze, fog, and atmospheric turbulence are not mere obstacles but active participants in the degradation process, scattering light and reducing contrast over long distances. These compounded factors result in acquired images exhibiting low resolution, blurred details, and significant noise, thereby fundamentally obscuring the underlying semantic structures and latent patterns within the data, posing a significant barrier to downstream tasks that rely on robust feature extraction and clustering [4,5].
Single-image super-resolution (SR) is able to enhance the visual quality of an image by applying image restoration techniques to extrapolate and reconstruct high-frequency details from the limited information inherent in a low-resolution (LR) source [6]. Super-resolution has emerged as a prominent area of investigation, with deep learning catalyzing a paradigm shift and achieving unprecedented performance gains. The ability of deep neural networks to implicitly learn prior distributions has significantly enhanced SR performance, and there has been a dramatic upsurge in the use of deep networks to achieve effective super-resolution [7,8,9,10]. Moreover, recent studies have successfully applied SR technology to various fields, including remote sensing [11], medical science [12] and face recognition [13]. Nevertheless, the majority of these state-of-the-art deep learning-based SR methods suffer from a critical domain gap when applied to real-world drone imagery. This limitation stems primarily from their training paradigm: most models are exclusively trained and evaluated on synthetic data generated from a single, idealized degradation model—typically, the simple bicubic down-sampling kernel [14]. This controlled environment creates a significant bias, as the models learn to reverse a specific, known degradation pattern rather than the complex and unknown combinations prevalent in aerial scenarios. Consequently, when confronted with real drone images, these models exhibit a stark performance drop, which severely hinders their practical applicability.
Image super-resolution techniques can allow the drone to fly higher and cover larger areas while still maintaining high image quality. As far as drone images are concerned, the perspective is often from above, which differs from the human perspective of natural images. In addition, drones face more complex and diverse imaging scenes, such as long-distance photography, high-magnification zoom, extensive maneuvering, and varying weather conditions, all of which contribute to their distinctive features and increase information entropy, which may lead to differences between drone-image super-resolution research and conventional methods.
Nevertheless, research on super-resolution reconstruction for drone aerial images is still in its infancy, lacking support from relevant publicly available datasets. In particular, the data for ship scenes captured by drones is even more scarce; as ships are the main carriers operating on the water surface and a key focus of maritime reconnaissance, conducting research using drone aerial ship images holds significant practical importance.
Based on the above considerations, a novel adaptive super-resolution method for drone-captured ship images is proposed in this paper. It is mainly composed of a simple degradation parameter estimation module and an adaptive reconstruction module. Furthermore, we construct a drone-captured ship image super-resolution dataset and optimize the design of degradation methods according to the characteristics of drones. Our main contributions can be summarized as follows:
- (1)
- An adaptive super-resolution method for drone-captured images is introduced, which adopts a strategy composed of static and dynamic parts to handle the super-resolution reconstruction problem in complex scenes.
- (2)
- A degradation process is designed to model practical degradations in drone aerial images, considering realistic conditions during drone capture.
- (3)
- A novel dataset of ship images captured by drones is introduced, which contains high-resolution drone images. Through extensive experiments and comparisons, our method achieves better performance than previous works.
2. Related Work
2.1. Drone Image Super-Resolution
Owing to the extensive integration of drones into various industries, methods in the field of computer vision have emerged as a fundamental enabler of their functionality [15,16,17]. By enhancing image clarity, drone super-resolution facilitates high-precision downstream tasks, including surveillance and reconnaissance [18]. Driven by the superior performance of deep learning, current research in image super-resolution has largely moved beyond traditional interpolation and reconstruction methods [19], which are now seldom employed due to their inherent performance limitations. The predominant paradigm in deep learning-based image reconstruction relies on Convolutional Neural Networks (CNNs) or Generative Adversarial Networks (GANs). However, the majority of studies have concentrated on natural images [20], which are typically captured from a horizontal, human-like perspective. In contrast, aerial drone images are typically captured from a top-down or oblique angle, which gives them a distinctive perspective compared to conventional natural images. Currently, research on super-resolution for drone images remains limited. Lin et al. [21] constructed a super-resolution dataset by capturing drone images at various altitudes, and a height-aware framework was proposed. Zhao et al. [22] introduced a multi-conditioned guidance network for the super-resolution of thermal drone images utilizing detailed information from visible images. To support this work, the authors also curated a paired dataset of drone visible and thermal imagery. Zhao et al. [23] further expanded the diversity and scale of the aforementioned dataset and subsequently proposed a guided decoupling network for the super-resolution task. Han et al. [24] proposed a cross-platform super-resolution reconstruction method for remote sensing images, which leveraged high-resolution (HR) drone aerial remote sensing images to guide the reconstruction of low-resolution satellite images. Li et al. [25] introduced an efficient image restoration algorithm based on diffusion models, which utilizes the frozen internal representations of pretrained encoder–decoder networks to restore high-resolution aerial images. Weng et al. [26] proposed a Gaussian quantization representation learning method oriented to diffusion models for few-shot drone-captured infrared image super-resolution. However, research in this domain is still in its infancy, and current solutions lack the adaptability required for diverse and challenging aerial scenarios. To overcome these limitations, we introduce a robust and flexible framework for the reconstruction of drone images, contributing to the practical applicability of super-resolution in real-world drone images.
2.2. Image Degradation Models
As mentioned in the Introduction, most SR methods [20,27,28] employ bicubic down-sampling or other simple degradation models for training and evaluation. The complexity of real-world degradation, however, poses a significant challenge to models trained on simplistic assumptions, limiting their effectiveness on real-world images. These approaches where the degradation model is known or assumed is termed non-blind super-resolution. In contrast, blind super-resolution addresses the more challenging scenario where the degradation process is unknown, making it particularly suitable for real-world images [29]. To that end, a few methods have been proposed. Gu et al. [30] introduced an iterative kernel correction approach, which progressively refines the degradation kernel within the super-resolution process to improve reconstruction quality. Zhang et al. [31] designed a random shuffle strategy to synthesize more practical degradations, including blur, noise, down-sampling, and JPEG compression. Wang et al. [32] proposed a high-order degradation modeling process and incorporated sinc filters in the synthesis process. Wang et al. [33] proposed an unsupervised degradation representation learning method. Through a dedicated degradation perception module, it fuses these degradation features to enhance the model’s reconstruction performance under unknown degradation conditions. Liang et al. [34] introduced an efficient degradation-adaptive network, which improved the adaptability to diverse degradations through the joint optimization of multiple experts. In essence, while blind super-resolution has made strides, most approaches rely on generic degradation models. However, drones routinely face challenging scenarios, from high-speed maneuvers to adverse weather, which imprint a complex signature of degradation on the captured images. This gap between generic modeling and the distinct realities of drone imagery severely compromises performance. The degradation model proposed in our work is a step in this direction.
3. Methodology
As shown in Figure 1, the adaptive super-resolution network for drone-captured ship images proposed in this paper comprises two core modules: a degradation prediction module and an adaptive reconstruction module. Initially, the degradation prediction module analyzes the input low-resolution image to estimate its specific degradation pattern. This degradation information is then fed into the adaptive reconstruction module, which employs a hybrid “static + dynamic” strategy. The process begins with the static feature reconstruction stage. This stage functions as a general-purpose super-resolution network, processing the input LR image to extract fundamental textural details and structural information. Its primary role is to generate a preliminary high-resolution feature map that captures the essential content of the image, independent of the specific degradation type. Crucially, this static feature map then serves as the foundation for the dynamic stage. The dynamic stage takes both the static features and the degradation parameters predicted by the degradation prediction module as inputs. It leverages the degradation information to selectively modulate and enhance the static features. For instance, if the predictor indicates severe motion blur in a specific direction, the dynamic stage will apply a learned operation to counteract the degradation. In essence, the dynamic stage acts as an intelligent “adapter” that tailors the generic restoration from the static stage to one that is adapted to the degradation state of the input image. By fusing these two complementary stages of information, our model can robustly and flexibly restore a clear, high-resolution image from a wide variety of real-world drone degradations.
Figure 1.
The overall framework of the proposed network.
3.1. Degradation Model
While significant efforts have been dedicated to the development of degradation models for real-world scenes, existing approaches often employ a generic series of processing steps, such as noise injection, blurring, and down-sampling, without adequately accounting for specific circumstances. To more accurately reflect the actual flight status of drones, we have enhanced existing degradation models [34] by incorporating factors specific to aerial photography, such as motion blur, lens blur, and digital zoom. Therefore, the model can more accurately simulate the complex conditions of real-world data. Figure 2 shows some samples in these cases.
Figure 2.
Schematic illustration of different imaging conditions.
Currently, most image degradation models employ Gaussian blur, which is characterized by its uniform distribution, to simulate blurring effects. This approach is suitable for modeling the lens blur caused by defocus during drone flight. Gaussian blur is defined as follows:
where is the weight of the Gaussian blur and is the standard deviation. To reflect the variability of real-world flight conditions, we do not use a fixed . Instead, for each training image, is randomly sampled from a uniform distribution. This range is chosen to simulate blur ranging from slight defocus to more significant lens softness.
However, the captured images are also susceptible to motion blur induced by either target motion or drone maneuvering. Unlike uniform Gaussian blur, motion blur is directional in nature, and its function is modeled as follows:
where is the weight of the motion blur, represents the distance an object moves (kernel size) and represents the angle of movement. Similarly, to model the unpredictability of drone dynamics and target movement, the motion blur parameters are randomized. The kernel length is sampled from pixels to represent motion from slight jitter to significant displacement, and the angle () is uniformly sampled from to account for all possible directions of drone travel or maneuvering.
Drawing inspiration from prior works [31,34], we design three different levels of a degradation pipeline to simulate complex and realistic image degradation. While the foundational concept of a multi-stage approach draws from prior work, such as [34], our implementation is specifically tailored to address the unique challenges presented in this paper. A key distinction lies in our redefined parameter spaces; for instance, rather than employing generic blur kernels, we specifically model the mentioned motion and lens blur to accurately represent the physical degradations inherent to drone imagery, such as platform dynamics and optical aberrations. We also significantly expanded the standard deviation range for these blur kernels, ensuring the model is robust to both subtle and severe blurring artifacts. We also introduce a novel step to simulate digital zoom when degradation modeling; this is achieved by applying high-ratio down-sampling, followed by up-sampling, which effectively mimics the loss of detail inherent in digital magnification. For the input image () and scale factor (), the zoom processing can be expressed as . Recognizing that imagery is rarely artificially up-sampled, we constrain the resizing process to two realistic scenarios: down-sampling or maintaining the original resolution. This structured pipeline sequentially applies these tailored degradations—blurring, resizing, noise injection, and aggressive JPEG compression—to generate highly realistic training data. These tailored modifications detailed in Table 1 ensure our synthetic data more closely mirrors the real-world distribution, thereby enhancing the model’s robustness and effectively bridging the domain gap between synthetic training data and real-world drone imagery. With respect to the specific parameter scale of the three levels presented in the table, level 3 includes two processing stages, and is the cutoff frequency of the sinc kernel. During training, we randomly sample from these methods according to a balanced probability distribution of [0.3, 0.4, 0.3] to generate the LR–HR image pairs. The blur operation employs motion and lens blur in equal proportions. Figure 3 shows samples with different levels of degradations.
Table 1.
Detailed parameter settings of the degradation. [‘a’, ‘b’, ‘b’] denote the resize modes of [area, bilinear, bicubic]; [‘G’, ‘P’] denote the noise types of [Gaussian, Poisson]; R-J and J-R denote the order of resizing and JPEG com-pression, respectively.
Figure 3.
Schematic illustration of levels of degradation.
The degradation prediction module is built upon a simple convolutional neural network architecture. Within this module, the intermediate layer of the linear mapping is set to a dimension of 64. To effectively guide the model in learning the degradation information from the input image, the network is trained with a regression loss. This loss function is given by
where represents the predicted degradation parameters and represents the ground truth.
The degradations caused by drone flight may elevate the information entropy of an image, which, in turn, obscures its underlying semantic patterns. This phenomenon occurs because these degradations introduce random or complex artifacts, rendering the image content less predictable and more disordered. To quantify this effect, Shannon Entropy is employed. In Figure 4, we present the Shannon entropy values for the HR, LR, and SR images of a representative sample. The results demonstrate that image degradation can lead to an increase in entropy, whereas the entropy is markedly reduced after super-resolution reconstruction. This degradation-induced entropy increase is a general trend. However, we note an extreme case where severe blurring can paradoxically reduce entropy by averaging pixel values, though such instances are infrequent. The Shannon entropy of an image () can be defined as follows:
where denotes the total number of possible gray levels in the image, is the index of a specific gray level and represents the probability of a pixel having gray level .
Figure 4.
The Shannon entropy of a representative sample.
3.2. Adaptive Reconstruction Module
The adaptive reconstruction module comprises two stages: static and dynamic feature reconstruction. In the static stage, the module focuses on extracting the textural details of the target from the input LR image, which provides a stable, content-rich foundation. Subsequently, based on these features, the dynamic stage leverages the predicted degradation information to guide the restoration process, ultimately producing a clear, high-resolution image. In this way, the two-stage approach adaptively achieves super-resolution for drone imagery.
For the static reconstruction stage, we adopt swift parameter-free attention [35] which has demonstrated exceptional efficiency in super-resolution tasks by effectively enhancing salient features and suppressing redundant information. To make the reconstruction process robust, we design a Residual Swift Parameter-free Attention Block (RSPA Block) in this stage. As shown in Figure 5, RSPA Block incorporates swift parameter-free attention into the standard residual block, thereby enhancing the robustness of feature learning. Concatenating multiple blocks enables the comprehensive extraction of low-level features from the input image while simultaneously capturing both local and global characteristics. Then, the RSPA block can be expressed as follows:
where represents the element-wise sum, stands for the convolutional layer with a 3 × 3 kernel, is the swift parameter-free attention block and represents the cat operation between feature maps in the channel dimension.
Figure 5.
Architecture of the RSPA Block.
In the dynamic reconstruction stage, dynamic convolution [36], which can dynamically adjust parameters according to different inputs, is introduced. The core of our dynamic stage lies in its mechanism for generating convolutional weights, a process directly driven by the predicted degradation information. Specifically, the predicted degradation parameters () are first fed into a fully connected network. This network acts as a learnable function () that maps the abstract degradation vector into a set of attention weights. These weights () determine the importance of different pre-defined convolution kernels in the subsequent step, and the number of convolution kernels in the bank is 5. The parameters of the dynamic convolution layer () are formed by a weighted combination of these kernels using the attention weights () and the weighting vector (), which is adaptively modulated for the specific degradation of the input. The stage is introduced in the latter part of our model, enabling the model to combine the static features with the degradation information to achieve better reconstruction of low-resolution images.
This enables the network to adapt its behavior, significantly enhancing its capacity to address diverse and complex degradation scenarios. Consequently, our model can robustly generate high-quality SR images by adaptively tuning its internal parameters according to various input images. The process of dynamic convolution can be expressed as follows:
where represents the parameters of dynamic convolution layer, and denote the input and output features and represents the convolution operation.
Furthermore, the dynamic reconstruction stage can be expressed as follows:
where denotes the LeakyReLU activation function and denotes the process of dynamic convolution.
Finally, the obtained is processed by a dynamic convolution operation to map to the output dimension; then, is generated by fusing the bicubic up-sampled input images with the output.
3.3. Loss Function
Commonly used loss functions reported in previous SR works [31,32,37] include pixel loss (), adversarial loss (), and perceptual loss ().
Pixel loss aims to align the spatial geometry of the reconstructed image with its original HR counterpart as far as possible. It is defined as follows:
where denotes the SR image and denotes the HR image.
Adversarial loss guides the network to reconstruct visually favorable images, and the U-Net discriminator with spectral normalization is adopted. The adversarial loss is defined as
where denotes the LR image, denotes the discriminator and denotes the generator.
Perceptual loss enhances the perceptual quality of SR images by minimizing the feature distance between SR and HR images in a deep feature space, and a pretrained VGG19 network [38] is used to extract the features. It is defined as
where denotes the ith layer output of VGG19.
In addition to the above loss functions, we adopt the regression loss mentioned in Section 3.1, which is computed for the degradation prediction. The total loss is defined as follows:
4. Experimental Details
4.1. Experimental Settings
Given the paucity of publicly accessible aerial drone imagery of ships, we construct a drone aerial ship image dataset by conducting real data collection experiments. This dataset comprises high-resolution imagery captured by a DJI M30T drone (DJI, Shenzhen, China), encompassing a diverse array of ship classes; some image samples are displayed in Figure 6. For this study, the training partition consists of 7260 images, and the test partition contains 106 images. Specifically, the dataset encompasses diverse vessel types, including cargo ships, container ships, LPG tanker ships, and other marine vessels. It comprises images captured under varied scenarios, such as sunny weather, cloudy weather, front-lit conditions, and backlit conditions, thereby ensuring the data exhibits substantial diversity. During the model training process, the training HR patch size is set to 256 × 256, the learning rate is set to and the total batch size is 8. We adopt the Adam optimizer [39] with and to optimize the model. We first train our model for 500 K iterations only with the pixel loss. Then, we use all the training losses to train the obtained model for 200 K iterations.
Figure 6.
Some image samples from our dataset.
4.2. Evaluation Metrics
To evaluate the effectiveness of the super-resolution task quantitatively, we employ the peak signal-to-noise ratio (PSNR) [40,41], the structural similarity index metric (SSIM) [41,42] and the learned perceptual image patch similarity (LPIPS) [43] to compare the performance of different methods. These metrics are widely utilized for the evaluation of image super-resolution. Generally, there is a positive correlation between PSNR and SSIM values and the quality of the reconstructed image. Note that LPIPS is more consistent with human visual perception, and a lower LPIPS value indicates a higher perceptual similarity between the reconstructed image and the ground truth.
5. Results and Discussions
In this section, we present a thorough experimental evaluation of our proposed method. We benchmark its performance against a diverse set of state-of-the-art super-resolution approaches, encompassing both classic and recent models including ESRGAN [37], BSRGAN [31], Real-ESRGAN [32], DASR [34], A-ESRGAN [44], DAT [45], DRCT [46] and DRSR [47]. The comparison is conducted from two primary perspectives: quantitative analysis using standard metrics and qualitative assessment through visual inspection.
A comprehensive quantitative comparison among these methods is presented in Table 2. For a fair assessment, all methods are evaluated with their respective, officially released pre-trained models. As shown in the table, DAT and ESRGAN achieve great results when evaluated on bicubic-degraded images. However, their performance degrades significantly for other degradation types, as evidenced by a sharp increase in their LPIPS scores. For example, the LPIPS of the DAT method rises from 0.1442 under bicubic degradation to 0.4982 under level 1. This indicates a fundamental limitation of methods trained exclusively on bicubic models. While the blind DRSR super-resolution method outperforms the two methods mentioned above, its LPIPS score remains relatively high in complex degradation scenarios. A-ESRGAN, BSRGAN, Real-ESRGAN, DASR and DRCT outperform the aforementioned methods in terms of LPIPS across the three different degradation scenarios while also exhibiting more robust and stable overall performance, whereas A-ESRGAN exhibits relatively inferior overall performance. However, all these methods still suffer a severe performance drop at degradation level 3, particularly in perceptual quality. In stark contrast, our proposed method demonstrates superior performance, achieving the best overall LPIPS score and ranking among the top performers on the PSNR and SSIM metrics. Taking the level 2 degradation scenario as an example, our method outperforms DASR, with a PSNR gain of 1.13 dB, an SSIM gain of 0.0107, and an LPIPS reduction of 0.0978. Crucially, its performance does not suffer the severe drop observed in other methods, proving its superior stability. These quantitative findings are strongly corroborated by the qualitative comparisons in Figure 7, Figure 8, Figure 9 and Figure 10. As illustrated in Figure 8, Figure 9 and Figure 10, ESRGAN and DAT struggle to effectively suppress noise and restore sharp edges in complex scenes. Their performance is also largely limited to scenarios involving fixed bicubic degradation, as shown in Figure 6. Conversely, BSRGAN, Real-ESRGAN, DASR, A-ESRGAN, and DRCT exhibit a distinct trade-off, as while generating sharp details, they introduce unnatural textures and visual artifacts or result in excessively smooth regions. This compromises the realism of the reconstructed images, as evidenced in Figure 8. In contrast, our method, which employs a “static + dynamic” reconstruction strategy, provides a more balanced and effective solution, yielding images with superior visual clarity and fewer artifacts.
Table 2.
Quantitative comparisons of different methods on datasets with different degradations. The PSNR results are calculated in the Y channel of YCbCr space.
Figure 7.
Qualitative comparisons of different methods on images with bicubic degradation. Please zoom in for a better view.
Figure 8.
Qualitative comparisons of different methods on images with level 1 degradations. Please zoom in for a better view.
Figure 9.
Qualitative comparisons of different methods on images with level 2 degradations. Please zoom in for a better view.
Figure 10.
Qualitative comparisons of different methods on images with level 3 degradations. Please zoom in for a better view.
From the results in Table 2, it is evident that DASR represents the state of the art among the baseline methods, second only to our own. Given this and since our method for degradation modeling builds upon and significantly refines the approach used in this model, we regard it as the most relevant and critical baseline for comparison. To ensure a fair and comprehensive evaluation, we adapted DASR by re-training it on our custom degradation datasets. As the results in Table 3 reveal, this adaptation yielded notable improvements for DASR—in particular, a substantial gain in the LPIPS metric. Despite this enhancement, our proposed method still maintains a decisive lead, delivering superior results across the board. We attribute DASR’s initial success to its multi-expert joint optimization strategy. However, our work makes a fundamental advance by integrating static and dynamic reconstruction within a unified framework, which fosters greater robustness and ultimately achieves a higher level of performance.
Table 3.
Quantitative comparisons of re-trained DASR and our method.
To further assess the efficacy of the proposed method, we conducted an ablation study using the dataset. The quantitative and qualitative results of the ablation study on images with level 2 degradation are shown in Table 4 and Figure 11, respectively. For the static and dynamic stages, which are executed sequentially, we replaced the removed components with a simple convolutional module to maintain the model’s structural integrity during the experiment. The experimental results clearly demonstrate that the model’s performance degrades most significantly when the static stage is removed. This is because the feature maps generated in this stage serve as the foundational input for the following reconstruction process. Furthermore, the removal of the SPAB attention module compromises the model’s ability to extract fine features, which, in turn, degrades its performance. Likewise, the absence of the dynamic stage impairs the model’s capacity to manage complex types of degradation, leading to a similar performance drop. These findings underscore the distinct and critical role each component plays in the model and demonstrate the effectiveness of our proposed model.
Table 4.
Quantitative results of the ablation study.
Figure 11.
Qualitative results of the ablation study. Please zoom in for a better view.
Furthermore, we conducted experiments on public real-world LR natural images without down-sampling. In this part, experiments were conducted on the images from the public RealSRSet [31]. Figure 12 presents the qualitative results of the performance of different methods on these images with a scale of 4. It can be intuitively seen from the comparison in the figure that our model produces results with visibly clearer details and fewer blurring artifacts, which demonstrates its generalization capacity.
Figure 12.
Qualitative comparisons of different methods on real-world images. Please zoom in for a better view.
6. Conclusions
The expanding application of drones across critical domains is fundamentally constrained by the complex degradations inherent in aerial imagery, which obscure the underlying data structures essential for reliable analysis. For example, in the context of vessel monitoring, image fidelity is a decisive factor for successful pattern recognition, yet degradation can lead to relatively high information entropy. In this study, a novel adaptive super-resolution method for drone-captured images is proposed, which can be applied to the super-resolution reconstruction tasks of drone images in complex scenes. First, to better align with real-world scenes, we optimize the degradation model by integrating the actual flight state of the drones. Second, we introduce a novel network architecture for drone image super-resolution that leverages a “static + dynamic” design to achieve adaptive reconstruction of input images. Finally, we construct a novel dataset of ship images captured by drones and conduct a thorough series of experiments for verification. The results from quantitative and qualitative analyses show that our method produces reconstructed images of higher quality and demonstrates superiority over most current representative algorithms. Furthermore, the restored structural details are expected to significantly enhance the performance of downstream tasks like clustering and object recognition.
Drones are finding increasingly widespread applications, and integrating super-resolution technology to enhance the quality of drone-captured imagery is crucial for improving their performance in downstream tasks that demand high precision. The proposed method is able to address the challenges of SR in complex scenes, featuring an adaptive ability to process diverse input drone images. While our method has shown promising results, its performance is still contingent upon the availability of substantial training data that is well-aligned with the target scenarios. Furthermore, the depth of its exploration of underlying data structures could be enhanced, and its capacity for reconstructing more detailed semantic information for downstream applications deserves further investigation. Looking ahead, a promising direction for future work is to extend super-resolution technology to zero-shot or few-shot learning scenarios, which would further enhance its practical applicability and robustness in real-world conditions. Moreover, the leveraging of large models offers a significant avenue for progress, as their superior generalization allows for the development of super-resolution methods with minimal reliance on large-scale, domain-specific training data.
Author Contributions
Conceptualization, H.L. and W.X.; methodology, H.L.; data curation, H.L. and Y.C.; writing—original draft preparation, H.L.; writing—review and editing, W.X. and L.Y.; supervision, W.X., L.Y. and Y.C.; funding acquisition, W.X. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the National Natural Science Foundation of China (grant number U2433216).
Data Availability Statement
Due to privacy regulations and continued use for a follow-up project, part of the data presented in this study are available upon request from the corresponding author.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Dutta, G.; Goswami, P. Application of Drone in Agriculture: A Review. Int. J. Chem. Stud. 2020, 8, 181–187. [Google Scholar] [CrossRef] [Scilit]
- Mishra, B.; Garg, D.; Narang, P.; Mishra, V. Drone-Surveillance for Search and Rescue in Natural Disaster. Comput. Commun. 2020, 156, 1–10. [Google Scholar] [CrossRef] [Scilit]
- Zeng, B.; Gao, S.; Xu, Y.; Zhang, Z.; Li, F.; Wang, C. Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective. Remote Sens. 2024, 16, 1288. [Google Scholar] [CrossRef] [Scilit]
- Ma, S.; Zhao, L.; Lu, M.; Guo, Y.; Xu, B. Consistency-Aware Padding for Incomplete Multi-Modal Alignment Cluster-ing Based on Self-Repellent Greedy Anchor Search. In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, Montreal, QC, Canada, 16–22 August 2025. [Google Scholar]
- Zhao, L.; Xie, Q.; Li, Z.; Wu, S.; Yang, Y. Dynamic Graph Guided Progressive Partial View-Aligned Clustering. IEEE Trans. Neural Netw. Learn. Syst. 2025, 36, 9370–9382. [Google Scholar] [CrossRef] [Scilit]
- Lepcha, D.C.; Goyal, B.; Dogra, A.; Goyal, V. Image Super-Resolution: A Comprehensive Review, Recent Trends, Challenges and Applications. Inf. Fusion 2023, 91, 230–260. [Google Scholar] [CrossRef] [Scilit]
- Xu, D.; Fan, X.; Gao, W. Multiscale Attention Fusion for Depth Map Super-Resolution Generative Adversarial Networks. Entropy 2023, 25, 836. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yang, J.; Ren, H.; Zeng, M.; He, Z. HSFAN: A Dual-Branch Hybrid-Scale Feature Aggregation Network for Remote Sensing Image Super-Resolution. Entropy 2025, 27, 1189. [Google Scholar] [CrossRef] [Scilit]
- Gao, S.; Liu, X.; Zeng, B.; Xu, S.; Li, Y.; Luo, X.; Liu, J.; Zhen, X.; Zhang, B. Implicit Diffusion Models for Continuous Super-Resolution. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Vancouver, BC, Canada, 2023; pp. 10021–10030. [Google Scholar]
- Lu, Z.; Li, J.; Liu, H.; Huang, C.; Zhang, L.; Zeng, T. Transformer for Single Image Super-Resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA, 19–20 June 2022; pp. 457–466. [Google Scholar]
- Xiao, Y.; Yuan, Q.; Jiang, K.; Chen, Y.; Zhang, Q.; Lin, C.-W. Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution. IEEE Trans. Multimed. 2025, 27, 1783–1796. [Google Scholar] [CrossRef] [Scilit]
- Qiu, D.; Cheng, Y.; Wang, X. Medical Image Super-Resolution Reconstruction Algorithms Based on Deep Learning: A Survey. Comput. Methods Programs Biomed. 2023, 238, 107590. [Google Scholar] [CrossRef] [Scilit]
- Jiang, K.; Wang, Z.; Yi, P.; Lu, T.; Jiang, J.; Xiong, Z. Dual-Path Deep Fusion Network for Face Image Hallucination. IEEE Trans. Neural Netw. Learn. Syst. 2022, 33, 378–391. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dong, C.; Loy, C.C.; He, K.; Tang, X. Learning a Deep Convolutional Network for Image Super-Resolution. In Proceedings of the Computer Vision—ECCV 2014, Zurich, Switzerland, 6–12 September 2014; pp. 184–199. [Google Scholar]
- Al-Kaff, A.; Martin, D.; Garcia, F.; de la Escalera, A.; Armingol, J.M. Survey of Computer Vision Algorithms and Applications for Unmanned Aerial Vehicles. Expert Syst. Appl. 2018, 92, 447–463. [Google Scholar] [CrossRef] [Scilit]
- Xu, X.; Zhang, X.; Yu, B.; Hu, X.S.; Rowen, C.; Hu, J.; Shi, Y. Dac-Sdc Low Power Object Detection Challenge for Uav Applications. IEEE Trans. Pattern Anal. Mach. Intell. 2019, 43, 392–403. [Google Scholar] [CrossRef] [Scilit]
- Fang, H.; Ding, L.; Wang, X.; Chang, Y.; Yan, L.; Liu, L.; Fang, J. SCINet: Spatial and Contrast Interactive Super-Resolution Assisted Infrared UAV Target Detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 1–22. [Google Scholar] [CrossRef] [Scilit]
- Agarwal, A.; Ratha, N.; Vatsa, M.; Singh, R. Impact of Super-Resolution and Human Identification in Drone Surveillance. In Proceedings of the 2021 IEEE International Workshop on Information Forensics and Security (WIFS), Montpellier, France, 7–10 December 2021; pp. 1–6. [Google Scholar]
- Su, H.; Li, Y.; Xu, Y.; Fu, X.; Liu, S. A Review of Deep-Learning-Based Super-Resolution: From Methods to Applications. Pattern Recognit. 2025, 157, 110935. [Google Scholar] [CrossRef] [Scilit]
- Ledig, C.; Theis, L.; Huszár, F.; Caballero, J.; Cunningham, A.; Acosta, A.; Aitken, A.; Tejani, A.; Totz, J.; Wang, Z.; et al. Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 105–114. [Google Scholar]
- Lin, X.; Ozaydin, B.; Vidit, V.; El Helou, M.; Süsstrunk, S. DSR: Towards Drone Image Super-Resolution. In Proceedings of the Computer Vision—ECCV 2022 Workshops, Tel Aviv, Israel, 23–27 October 2022; pp. 361–377. [Google Scholar]
- Zhao, Z.; Zhang, Y.; Li, C.; Xiao, Y.; Tang, J. Thermal UAV Image Super-Resolution Guided by Multiple Visible Cues. IEEE Trans. Geosci. Remote Sens. 2023, 61, 1–14. [Google Scholar] [CrossRef] [Scilit]
- Zhao, Z.; Gu, J.; Li, C.; Wang, C.; Huang, Z.; Tang, J. Guidance Disentanglement Network for Optics-Guided Thermal UAV Image Super-Resolution. ISPRS J. Photogramm. Remote Sens. 2025, 228, 64–82. [Google Scholar] [CrossRef] [Scilit]
- Han, H.; Du, W.; Feng, Z.; Guo, Z.; Xu, T. An Effective Res-Progressive Growing Generative Adversarial Network-Based Cross-Platform Super-Resolution Reconstruction Method for Drone and Satellite Images. Drones 2024, 8, 452. [Google Scholar] [CrossRef] [Scilit]
- Li, W.; Li, C.; Jiang, H.; Wang, Y.; Wu, S.; Wu, Z. High-Resolution Aerial Image Restoration with Latent Diffusion Models. In Proceedings of the 2024 IEEE International Conference on Unmanned Systems (ICUS), Nanjing, China, 18–20 October 2024; pp. 1874–1878. [Google Scholar]
- Weng, Z.; Liu, X.; Liu, C.; Guo, X.; Shi, Y.; Lin, L. DroneSR: Rethinking Few-Shot Thermal Image Super-Resolution from Drone-Based Perspective. IEEE Sens. J. 2025, 25, 37722–37731. [Google Scholar] [CrossRef] [Scilit]
- Johnson, J.; Alahi, A.; Fei-Fei, L. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Proceedings of the Computer Vision—ECCV 2016; Leibe, B., Matas, J., Sebe, N., Welling, M., Eds.; Springer International Publishing: Amsterdam, The Netherlands, 2016; pp. 694–711. [Google Scholar]
- Lim, B.; Son, S.; Kim, H.; Nah, S.; Lee, K.M. Enhanced Deep Residual Networks for Single Image Super-Resolution. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 21–26 July 2017; pp. 1132–1140. [Google Scholar]
- Liu, A.; Liu, Y.; Gu, J.; Qiao, Y.; Dong, C. Blind Image Super-Resolution: A Survey and Beyond. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 5461–5480. [Google Scholar] [CrossRef] [Scilit]
- Gu, J.; Lu, H.; Zuo, W.; Dong, C. Blind Super-Resolution with Iterative Kernel Correction. In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019; pp. 1604–1613. [Google Scholar]
- Zhang, K.; Liang, J.; Van Gool, L.; Timofte, R. Designing a Practical Degradation Model for Deep Blind Image Super-Resolution. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10–17 October 2021; pp. 4771–4780. [Google Scholar]
- Wang, X.; Xie, L.; Dong, C.; Shan, Y. Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada, 11–17 October 2021; pp. 1905–1914. [Google Scholar]
- Wang, L.; Wang, Y.; Dong, X.; Xu, Q.; Yang, J.; An, W.; Guo, Y. Unsupervised Degradation Representation Learning for Blind Super-Resolution. In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 10576–10585. [Google Scholar]
- Liang, J.; Zeng, H.; Zhang, L. Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolution. In Proceedings of the Computer Vision—ECCV 2022; Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T., Eds.; Springer Nature Switzerland: Tel Aviv, Israel, 2022; pp. 574–591. [Google Scholar]
- Wan, C.; Yu, H.; Li, Z.; Chen, Y.; Zou, Y.; Liu, Y.; Yin, X.; Zuo, K. Swift Parameter-Free Attention Network for Efficient Super-Resolution. In Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 17–18 June 2024; pp. 6246–6256. [Google Scholar]
- Chen, Y.; Dai, X.; Liu, M.; Chen, D.; Yuan, L.; Liu, Z. Dynamic Convolution: Attention over Convolution Kernels. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 13–19 June 2020; pp. 11027–11036. [Google Scholar]
- Wang, X.; Yu, K.; Wu, S.; Gu, J.; Liu, Y.; Dong, C.; Qiao, Y.; Loy, C.C. ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. In Proceedings of the Computer Vision—ECCV 2018 Workshops; Leal-Taixé, L., Roth, S., Eds.; Springer International Publishing: Munich, Germany, 2018; pp. 63–79. [Google Scholar]
- Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
- Kingma, D.P.; Ba, J. Adam: A Method for Stochastic Optimization. arXiv 2014, arXiv:1412,6980. [Google Scholar]
- Tanchenko, A. Visual-PSNR Measure of Image Quality. J. Vis. Commun. Image Represent. 2014, 25, 874–878. [Google Scholar] [CrossRef] [Scilit]
- Horé, A.; Ziou, D. Image Quality Metrics: PSNR vs. SSIM. In Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey, 23–26 August 2010; pp. 2366–2369. [Google Scholar]
- Bakurov, I.; Buzzelli, M.; Schettini, R.; Castelli, M.; Vanneschi, L. Structural Similarity Index (SSIM) Revisited: A Data-Driven Approach. Expert Syst. Appl. 2022, 189, 116087. [Google Scholar] [CrossRef] [Scilit]
- Zhang, R.; Isola, P.; Efros, A.A.; Shechtman, E.; Wang, O. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 586–595. [Google Scholar]
- Wei, Z.; Huang, Y.; Chen, Y.; Zheng, C.; Gao, J. A-ESRGAN: Training Real-World Blind Super-Resolution with Attention U-Net Discriminators. In Proceedings of the PRICAI 2023: Trends in Artificial Intelligence, Jakarta, Indonesia, 15–19 November 2024; pp. 16–27. [Google Scholar]
- Chen, Z.; Zhang, Y.; Gu, J.; Kong, L.; Yang, X.; Yu, F. Dual Aggregation Transformer for Image Super-Resolution. In Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: Paris, France, 2023; pp. 12278–12287. [Google Scholar]
- Hsu, C.-C.; Lee, C.-M.; Chou, Y.-S. DRCT: Saving Image Super-Resolution Away from Information Bottleneck. In Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: Seattle, WA, USA, 2024; pp. 6133–6142. [Google Scholar]
- Xiao, Y.; Yuan, Q.; Jiang, K.; He, J.; Wang, Y.; Zhang, L. From Degrade to Upgrade: Learning a Self-Supervised Degradation Guided Adaptive Network for Blind Remote Sensing Image Super-Resolution. Inf. Fusion 2023, 96, 297–311. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.











