Next Article in Journal
Computational Evaluation of Stress Distribution in Endocrown-Restored Immature Mandibular Molars: A Finite Element Approach
Previous Article in Journal
Comparison of Selected Sensory and Physicochemical Indicators of Insect Powders and Flours During Storage
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

HGLN: Hybrid Gated Large-Kernel Network for Lightweight Image Super-Resolution

School of Computer Science, China University of Geosciences, Wuhan 430074, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(3), 1382; https://doi.org/10.3390/app16031382
Submission received: 6 January 2026 / Revised: 23 January 2026 / Accepted: 27 January 2026 / Published: 29 January 2026

Abstract

Recent large-kernel based SISR methods often struggle to balance global structural consistency with local texture preservation while maintaining computational efficiency. To address this, we propose the Hybrid Gated Large-kernel Network (HGLN). First, the Hybrid Multi-Scale Aggregation (HMSA) decouples features into structural and detailed streams via dual-path processing, utilizing a modified Large Kernel Attention to capture long-range interactions. Second, the Local–Global Synergistic Attention (LGSA) recalibrates features by integrating local spatial context with dual global statistics (mean and standard deviation). Finally, the Structure-Gated Feed-forward Network (SGFN) leverages high-frequency residuals to modulate the gating mechanism for precise edge restoration. Extensive experiments demonstrate that HGLN outperforms state-of-the-art methods. Notably, on the challenging Urban100 dataset ( × 4 ), HGLN achieves significant PSNR gains with extremely low complexity (only 11G Multi-Adds), proving its suitability for resource-constrained applications.

1. Introduction

The primary objective of Single Image Super-Resolution (SISR) is to reconstruct high-quality images with rich details from their degraded low-resolution counterparts. This technology plays a pivotal role in various multimedia applications, ranging from enhancing mobile photography to optimizing video streaming quality. The landscape of SISR has been transformed since the advent of SRCNN [1]. Following this, deep architectures leveraging residual [2,3] and dense connections [4,5] have delivered remarkable improvements in reconstruction fidelity. However, the substantial computational overhead and memory requirements of these models often prohibit their deployment on edge devices with limited resources.
Consequently, the development of lightweight SISR models has garnered significant research interest. To mitigate computational redundancy, information distillation has emerged as a standard paradigm. Representative methods, such as IMDN [6], RFDN [7], AIDN [8], and the recently proposed FIWHN [9], adopt a hierarchical refinement strategy that progressively separates features to balance inference speed and performance. Beyond distillation, researchers have investigated alternative acceleration strategies. For example, sparsity-based methods like SMSR [10] and DIPNet [11] utilize dynamic masks to prune unnecessary computations in smooth regions. Meanwhile, efficient operator designs, such as the channel shuffling in ShuffleMixer [12], have been proposed for effective feature mixing. These innovations trace their roots back to early lightweight explorations like CARN [13], which utilized cascading structures to minimize parameter counts. Despite these strides, a majority of existing lightweight networks rely heavily on small-kernel convolutions, which inherently restricts their capacity to model broad contextual information.
Current CNN-based lightweight methods generally face two critical bottlenecks. First, they are constrained by limited effective receptive fields (ERF). Compared to Transformer-based architectures like SwinIR [14] or PCT [15], CNNs with small kernels often fail to capture global structural patterns. Lacking sufficient context, these models struggle to accurately reconstruct large-scale edges and repetitive textures. Although large-kernel designs like VAN [16] and Conv2Former [17] provide a potential solution, adapting them efficiently for lightweight SR remains a non-trivial challenge. Second, standard channel attention mechanisms (e.g., SE-Block [18]) depend heavily on Global Average Pooling (GAP). As highlighted in frequency-based [19] and higher-order statistics [20] studies, GAP tends to suppress feature variance, leading to the inevitable loss of high-frequency texture details that are crucial for perceptual quality. Specifically, relying solely on mean statistics hinders the network’s ability to distinguish between flat areas and texture-rich regions.
To overcome these limitations, we propose the Hybrid Gated Large-kernel Network (HGLN), which aims to achieve a synergy between maintaining structural consistency and preserving detailed textures. We design a Hybrid Multi-Scale Aggregation (HMSA) module to explicitly decouple features into a structural stream via down-sampling and a detailed stream via Large Kernel Attention. Furthermore, to address the texture loss associated with standard pooling, we introduce Local–Global Synergistic Attention (LGSA). This mechanism integrates local spatial context with dual-statistic descriptors (mean and standard deviation) for more discriminative feature recalibration. Finally, we propose a Structure-Gated Feed-forward Network (SGFN) to inject high-frequency residuals into the gating mechanism, thereby emphasizing edge restoration. By integrating these innovative designs, HGLN effectively captures multi-scale features while maintaining a compact computational footprint. As illustrated in Figure 1, our HGLN achieves a superior trade-off between reconstruction quality (PSNR) and model complexity (Parameters) compared to state-of-the-art methods.
The main contributions are summarized as follows:
  • We propose HGLN, a lightweight architecture that balances long-range dependency modeling with local detail preservation through a frequency-aware hybrid design.
  • We introduce the HMSA module for efficient frequency decoupling and the LGSA mechanism to enhance texture sensitivity using dual statistics, overcoming the limitations of standard global pooling.
  • Extensive experiments demonstrate that HGLN achieves superior performance compared to state-of-the-art methods in terms of both reconstruction quality and computational efficiency.

2. Related Work

2.1. CNN-Based Single Image Super-Resolution

The field of Single Image Super-Resolution (SISR) underwent a paradigm shift with the introduction of deep learning techniques. This era began with the seminal SRCNN [1] framework, which successfully demonstrated the feasibility of learning a direct end-to-end mapping function between low-resolution and high-resolution image pairs. Following this breakthrough, research efforts shifted towards increasing network depth to boost reconstruction fidelity. For example, LapSRN [2] utilized a deep Laplacian pyramid architecture to progressively predict high-frequency residuals, facilitating the training of deeper networks, while EDSR [3] achieved significant performance gains by removing redundant batch normalization layers from standard residual blocks. To further capitalize on hierarchical features, RDN [4] combined residual connections with dense connectivity to create the Residual Dense Network. Moreover, to enhance representational power, DBPN [5] exploited iterative up-and-down sampling layers to provide an error feedback mechanism, effectively capturing mutual dependencies between low- and high-resolution features. While these deep architectures deliver impressive visual quality, they typically incur massive parameter counts and high computational costs (Multi-Adds), rendering them unsuitable for resource-constrained edge applications.

2.2. Lightweight Single Image Super-Resolution

To bridge the gap between high performance and deployment efficiency, lightweight SISR has attracted considerable attention. Early attempts, such as CARN [13], employed cascading mechanisms to ensure efficient information flow. Contemporary lightweight solutions can generally be classified into three distinct strategies. The first and most prevalent strategy is information distillation. Approaches like IMDN [6], RFDN [7], and AIDN [8] utilize a split-and-process strategy. By dividing features into preserved and processed pathways at each step, these methods achieve a significant reduction in channel redundancy. The second strategy involves exploring network sparsity. Techniques such as SMSR [10] and DIPNet [11] implement dynamic masking mechanisms to identify and skip redundant computations in smooth areas (e.g., flat backgrounds), thereby accelerating inference speed. The third strategy focuses on efficient operator design. For instance, ShuffleMixer [12] leverages channel shuffling combined with depth-wise convolutions for efficient feature mixing, while ACN [21] uses asymmetric convolution blocks to strengthen feature extraction capability without increasing inference burden. More recently, hybrid architectures [22] and State Space Models (SSMs) [23] have emerged as promising directions, specifically aiming for linear computational complexity. However, existing distillation-based and hybrid methods often treat all features uniformly, neglecting the inherent difference between low-frequency structures and high-frequency textures. This unified processing can lead to the insufficient restoration of fine details, necessitating a frequency-aware approach.

2.3. Large Kernel and Attention Mechanisms

Capturing long-range dependencies is essential for high-quality SR, particularly when recovering textures from severely downsampled inputs. Transformer-based models, such as SwinIR [14] and PCT [15], have set new performance benchmarks by utilizing self-attention mechanisms to model global interactions. However, the high computational complexity and memory footprint associated with attention mechanisms often lead to significant latency, impeding real-time deployment. As an alternative, Large Kernel Convolutions have been revisited as a cost-efficient surrogate for expanding receptive fields. Modern architectures like VAN [16] and Conv2Former [17] have demonstrated that carefully optimized large kernels (e.g., via decomposition or modulation) can achieve a performance comparable to Transformers while maintaining CNN-level efficiency. Recent advancements, such as A++ [24] and Hi-Mamba [23], further refine this paradigm through advanced attention mechanisms and state space modeling. Despite this progress, applying large kernels to lightweight SR faces a dilemma. Standard channel attention (e.g., SE-Block [18]) relies on Global Average Pooling (GAP), which suppresses feature variance and inevitably losses high-frequency details. Conversely, pure large-kernel designs often introduce excessive parameters. This highlights the need for a mechanism that can capture global contexts without relying on detail-suppressing pooling operations.

2.4. Motivation and Design Strategy

Synthesizing the limitations discussed above, current lightweight SR research faces three unresolved challenges that directly motivate the design of our HGLN:
  • Frequency Indistinction in Distillation: Most distillation methods process features indiscriminately. To address this, we propose the HMSA module, which explicitly decouples features into frequency-specific streams, allowing the network to focus computational resources on restoring high-frequency details while preserving low-frequency structures.
  • Loss of Detail in Global Context: Existing attention mechanisms either suffer from heavy computation (Self-Attention) or information loss due to GAP (Channel Attention). In response, we introduce the LGSA module. It leverages gated large-kernel convolutions to establish long-range dependencies efficiently, bypassing the detail-suppressing pooling operations found in standard attention blocks.
  • Static Spatial Activation: Conventional activation functions lack spatial adaptability. To overcome this, we design the SGFN, which introduces a spatial gating mechanism to modulate activations dynamically, further enhancing the non-linear representation capability of the network.
By systematically addressing these specific bottlenecks, HGLN transitions from a simple combination of modules to a logically necessary architecture for high-performance lightweight SR.

3. Methodology

3.1. Overall Architecture

The primary objective of our proposed Hybrid Gated Large-kernel Network (HGLN) is to reconstruct a high-quality super-resolved image I S R R 3 × s H × s W from its corresponding low-resolution input I L R R 3 × H × W , where s represents the scale factor. As depicted in Figure 2, the overall framework is structured into three distinct phases: shallow feature extraction, deep feature learning, and high-resolution reconstruction.
Shallow Feature Extraction. Upon receiving the input I L R , we utilize a shallow extraction module H h e a d , typically consisting of a single 3 × 3 convolutional layer. This step transforms the input from pixel space into a high-dimensional feature domain to capture basic visual elements, such as edges and corners. The resulting shallow feature map F 0 R C × H × W is obtained as follows:
F 0 = H h e a d ( I L R ) .
These shallow features fulfill a dual role: they serve as the foundational input for the subsequent deep extraction stage and are simultaneously forwarded to the end of the network through a global residual connection to retain low-frequency information.
Deep Feature Extraction. At the core of HGLN lies the deep feature extractor H b o d y , which is tasked with generating hierarchical feature representations. It is constructed by stacking N units of the Hybrid Gated Large-kernel Block (HGLB).
Inside every HGLB, the three proposed components work in tandem to progressively enhance the features. First, the HMSA module separates the input features into different frequency streams, ensuring that fine-grained textures and global structures are handled with suitable receptive fields. Next, the LGSA recalibrates the features by integrating global statistics with local context, thereby filtering out redundant information. Finally, the SGFN applies spatial modulation to the activations using high-frequency residuals, boosting the network’s non-linear expressive capacity. The output of this deep feature extraction stage is denoted as F d e e p :
F d e e p = H b o d y ( F 0 ) .
High-Resolution Reconstruction. In the concluding phase, the initial shallow features are combined with the refined deep features via element-wise summation. Adopting this global residual learning strategy compels the network to prioritize learning high-frequency residuals rather than the full image content, which significantly stabilizes the training process. Subsequently, the fused features undergo upsampling via the reconstruction module H t a i l (generally comprising a convolution layer followed by PixelShuffle) to generate the final output:
I S R = H t a i l ( F 0 + F d e e p ) .

3.2. Hybrid Multi-Scale Aggregation

In single image super-resolution, image features exhibit diverse frequency characteristics: low-frequency components represent global structures (e.g., shapes, backgrounds) that require large receptive fields, while high-frequency components correspond to fine details (e.g., textures, edges) that need local precision. Standard CNNs typically process these components uniformly with fixed kernels, leading to either insufficient context for structures or noise amplification for details. To resolve this dilemma, we propose the Hybrid Multi-Scale Aggregation (HMSA) module. The core idea is to explicitly decouple features into dual paths—a structure path and a detail path—allowing the network to apply distinct processing strategies tailored to the frequency of the information.

3.2.1. Dual-Path Feature Extraction

Let the input features to the HMSA module be X R C × H × W . We first project X and split it along the channel dimension into two distinct streams: structure components X s t r R C 2 × H × W and detail components X d e t R C 2 × H × W .
(1) Structure Path. The structure path aims to capture robust low-frequency priors. Since structural information implies high redundancy and scale invariance, processing it at the original resolution is computationally wasteful. Therefore, we employ a down-sampling strategy. By applying Max Pooling, we filter out high-frequency noise and effectively expand the receptive field to capture global shapes. A depth-wise convolution then models the spatial context before upsampling. This process modulates the input features, highlighting the main structural skeleton:
Y s t r = X s t r ϕ ( Up ( DWConv ( MaxPool ( X s t r ) ) ) ) ,
where ϕ denotes the GELU activation function, Up ( · ) represents bilinear interpolation, and ⊙ is the Hadamard product.
(2) Detail Path (Modified LKA). The detail path is responsible for recovering fine-grained textures, which requires precise local modeling and long-range dependency to hallucinate missing details. To achieve this, we adopt a modified Large Kernel Attention (LKA) mechanism. While the original LKA in VAN [16] decomposes large kernels to capture long-range dependencies, it treats all features within the window equally. However, in SR, not all high-frequency signals are informative (e.g., noise vs. texture).
To overcome this limitation, we introduce a gating branch inspired by the Gated Linear Unit (GLU). As illustrated in Figure 3, two parallel branches are generated from X d e t : an attention map branch A t t n and a content value branch V. The attention branch utilizes a large kernel (e.g., 9 × 9 ) to view a wide context, while the value branch preserves the semantic information:
A t t n = LK d w ( ϕ ( Conv 1 × 1 ( X d e t ) ) ) ,
V = Conv 1 × 1 ( X d e t ) ,
where LK d w represents the large-kernel depth-wise convolution. The final detail features are synthesized by modulating the value map with the attention map, allowing the network to selectively emphasize relevant high-frequency details:
Y d e t = Proj ( A t t n V ) .
Finally, the outputs from the structure path and detail path are concatenated and fused via a 1 × 1 convolution to restore the channel dimension:
Y f u s e = Conv ( [ Y s t r , Y d e t ] ) R C × H × W .
Figure 3. Structure of the Modified Large Kernel Attention (LKA) module inspired by VAN [16]. Different colors denote distinct operations. This incorporates a value branch for gated feature modulation.
Figure 3. Structure of the Modified Large Kernel Attention (LKA) module inspired by VAN [16]. Different colors denote distinct operations. This incorporates a value branch for gated feature modulation.
Applsci 16 01382 g003

3.2.2. Local-Global Synergistic Attention

Feature maps often contain redundant information across spatial and channel dimensions. Existing attention mechanisms typically focus on either global statistics (e.g., SE-Block uses GAP) or local contexts. However, relying solely on GAP leads to the loss of high-frequency variance, which is fatal for texture recovery. As shown in Figure 4, we propose the Local–Global Synergistic Attention (LGSA) to refine Y f u s e by integrating both local spatial interactions and comprehensive global statistics.
First, we inject local spatial context into the features via a depth-wise convolution ( 3 × 3 ), ensuring that neighboring pixel relationships are preserved:
Y l o c a l = Y f u s e + DWConv ( Y f u s e ) .
Next, we construct a comprehensive statistical descriptor. Unlike standard average pooling, we aggregate both the global mean μ (representing background intensity) and the standard deviation std (representing texture contrast) to form a descriptor S R C × 1 × 1 :
S = μ ( Y l o c a l ) + std ( Y l o c a l ) .
This descriptor is processed by a Multi-Layer Perceptron (MLP) with a bottleneck structure to model channel-wise dependencies. The resulting attention weights A are applied to the fused features:
A = σ W 2 · δ W 1 · S , HMSA o u t = Y f u s e A ,
where σ is the Sigmoid function and δ is ReLU. This mechanism ensures that informative features are emphasized while redundant ones are suppressed.

3.3. Structure-Gated Feed-Forward Network

Feed-forward Networks (FFN) are essential for feature transformation. Recently, the Gated-Dconv Feed-forward Network (GDFN), popularized by Restormer [25], has become a standard component in image restoration. GDFN controls information flow via a gating mechanism, computed as the element-wise product of the input features and their activated counterparts. However, we argue that the standard GDFN is suboptimal for super-resolution tasks. Its gating mechanism depends solely on the magnitude of feature activations. This implies that features with larger values are always preserved, while those with smaller values are suppressed. In SR, however, high-frequency details (e.g., subtle textures) often have low magnitudes but are structurally significant. Consequently, GDFN risks filtering out these critical details.
To address this limitation, we propose the Structure-Gated Feed-forward Network (SGFN). Conceptually, SGFN improves upon GDFN by injecting a frequency-aware prior into the gating mechanism. Instead of relying purely on magnitude, SGFN explicitly leverages high-frequency residuals to modulate the gate, ensuring that structurally complex regions receive higher activation regardless of their absolute intensity.
Implementation Details: The input feature map is first expanded to a higher dimension R 2 C × H × W via a 1 × 1 convolution and then split into two halves: X 1 and X 2 . Similar to GDFN, X 1 generates the gating signal, and X 2 serves as the content.
Crucially, unlike GDFN, which directly applies an activation function, we introduce a high-frequency extraction branch. By subtracting the average-pooled version of X 1 from itself, we effectively create a high-pass filter that isolates edges and textures:
X h f = X 1 AvgPool ( X 1 ) .
This high-frequency component is then weighted by a learnable parameter α and added back to the activation branch. This injects structural awareness into the gate:
Gate = ϕ ( X 1 ) + α · X h f .
The final output is obtained by modulating X 2 with this structure-aware gate, followed by a projection layer to restore the original channel dimension:
Y = X 2 Gate .
Through this design, SGFN conceptually bridges the gap between magnitude-based gating and structure-based preservation, providing the theoretical justification for the performance gains observed in our ablation studies.

4. Experiments

4.1. Experimental Settings

Implementation Details: We implement HGLN using the PyTorch framework (version 2.1.0) and train all models on a workstation equipped with a single NVIDIA RTX 4090 GPU (24 GB VRAM). To ensure an ultra-lightweight design (<250K parameters), we configure the network with N = 8 HGLB blocks and a feature channel width of C = 36 . The expansion ratio of the SGFN is set to 2. This compact configuration allows for a fair comparison with state-of-the-art efficient models like SAFMN [26] and ShuffleMixer [12], while significantly outperforming heavier baselines such as IMDN [6].
Training Strategy: Training is performed with a batch size of 32, utilizing 64 × 64 LR patches randomly cropped from the training set. Data augmentation is applied via random horizontal flips and rotations ( 90 , 180 , 270 ). Network parameters are optimized via the ADAM algorithm [27] with default momentum terms ( β 1 = 0.9 , β 2 = 0.99 ). The learning rate is initialized at 1 × 10 3 and progressively decayed to 1 × 10 7 using a Cosine Annealing strategy [28] over the course of 1 × 10 6 iterations. The objective function L t o t a l combines L1 pixel loss with FFT frequency loss to preserve both spatial structure and spectral fidelity.
Training Stability Analysis: To verify the optimization stability of HGLN, we monitor the validation metrics throughout the training process. As illustrated in Figure 5, the validation curves for both PSNR and SSIM on the Set5 dataset ( × 4 ) demonstrate a consistent upward trajectory. Specifically, the model exhibits rapid convergence within the initial 200,000 iterations, followed by the fine-tuning of detailed textures in the subsequent stages. These smooth curves confirm that our Hybrid Gated Large-kernel architecture is robust and effectively mitigates gradient instability issues.

4.2. Datasets and Metrics

Datasets: To ensure a rigorous evaluation, we conduct experiments on widely recognized benchmark datasets. Network training utilizes the DF2K dataset, a consolidation of DIV2K [29] and Flickr2K [3], comprising a total of 3450 high-quality images with 2K resolution. This extensive collection provides diverse textural examples, facilitating the learning of robust feature representations applicable to real-world scenarios.
For testing, we assess model generalization across five standard benchmarks representing varied image complexities. Classical low-resolution scenarios are evaluated using Set5 [30] and Set14 [31]. To test performance on natural image textures and edges, we employ the B100 [32] dataset. Furthermore, to evaluate the reconstruction of complex geometric structures and aliasing-prone patterns (e.g., windows and grids), we utilize the challenging Urban100 [33] dataset. Finally, Manga109 [34] is included to verify the model’s ability to handle sharp lines and text within artistic illustrations.
Evaluation Metrics: Reconstruction fidelity is quantified using two standard metrics: Peak Signal-to-Noise Ratio (PSNR) for pixel-level accuracy and Structural Similarity Index (SSIM) for perceptual quality. Consistent with established SISR protocols, all calculations are performed on the Y channel (luminance) of the transformed YCbCr color space, as human vision is more sensitive to luminance intensity. Higher scores in both metrics indicate superior image restoration quality.

4.3. Quantitative Evaluation

We perform a comprehensive evaluation of the proposed HGLN against a wide spectrum of state-of-the-art (SOTA) lightweight SR methods. In the realm of lightweight super-resolution, a direct comparison of all methods in a single table can be misleading due to the vast differences in parameter counts and computational budgets (e.g., varying from 10 G to over 100 G Multi-Adds). To ensure a fair and structurally meaningful comparison, we categorize the competitors based on their architectural paradigms and computational intensity. Consequently, we conduct specific comparisons across three upscaling factors ( × 2 , × 3 , × 4 ), focusing on efficiency, architectural evolution, and state-of-the-art performance, respectively.
Positioning against Emerging Architectures: It is worth noting that the landscape of lightweight SR has recently evolved, with the emergence of hybrid architectures [22] and State Space Models (SSMs) such as Hi-Mamba [23]. While SSMs achieve linear complexity and impressive global modeling capabilities, they often encounter challenges regarding hardware compatibility (e.g., lack of optimized CUDA kernels for edge devices) and training stability. In contrast, HGLN is explicitly positioned as a pure CNN-based solution that rivals the receptive field of Transformers/SSMs through our proposed Hybrid Gated Large-kernel mechanism. By avoiding complex self-attention operators and state-space recursive calculations, HGLN maintains superior deployment friendliness and determinism on standard hardware, offering a pragmatic balance between the theoretical advantages of recent paradigms and the practical constraints of real-world edge applications.
Significance of Performance Margins. It is widely recognized that the field of lightweight SR has entered a phase of performance saturation. As state-of-the-art methods approach the theoretical upper bounds of reconstruction fidelity under strict parameter constraints, achieving large numerical leaps has become increasingly challenging. In this context, performance gains in the range of 0.05–0.2 dB are statistically significant and represent meaningful architectural breakthroughs rather than random variance. As demonstrated in the following comparisons, HGLN consistently achieves such margins (e.g., +0.26 dB on Manga109 × 2 ), confirming the robustness of our design beyond statistical fluctuations.
In the following tables, the best performance is highlighted in bold.
(1) Evaluation on Scale × 2 : Efficiency Comparison: The × 2 upscaling task generally preserves more original information, making it an ideal testing ground for ultra-lightweight architectures where every floating-point operation (FLOP) counts. In this subsection, we benchmark HGLN against methods designed for extreme efficiency (<100 G Multi-Adds), including the classic FSRCNN [35], the attention-based AIDN [8], and recent efficient operators like SAFMN [26] and ShuffleMixer [12].
As detailed in Table 1, HGLN demonstrates an unprecedented trade-off between reconstruction quality and computational cost:
  • Breaking the Saturation Ceiling: On classical datasets like Set5 and Set14, performance gains are typically saturated in the lightweight domain. However, HGLN still manages to secure the top spot (38.08 dB on Set5), marginally outperforming heavier models.
  • Handling High-Frequency Details: The advantage becomes substantial on the Manga109 dataset, which is replete with sharp text and high-contrast lines. While AIDN achieves a respectable 38.89 dB, HGLN surges to 39.15 dB, delivering a remarkable gain of 0.26 dB. This improvement is directly attributed to our Structure-Gated Feed-forward Network (SGFN), which injects high-frequency residuals into the gating mechanism, preventing the blurring of sharp boundaries that is common in ultra-lightweight models.
  • Computational Economy: Perhaps most importantly, HGLN achieves these results with only 41 G Multi-Adds. Compared to AIDN (69 G), this represents a 40% reduction in computational load. This proves that our hybrid gated design is far more efficient at extracting informative features from low-degradation inputs than standard attention mechanisms, making it highly suitable for battery-powered devices.
Table 1. Quantitative comparison with Ultra-Lightweight Methods on Scale × 2 . The best results are bolded.
Table 1. Quantitative comparison with Ultra-Lightweight Methods on Scale × 2 . The best results are bolded.
MethodParams [K]GFLOPsSet5Set14BSD100Urban100Manga109
PSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIM
FSRCNN [35]13637.00/0.955832.63/0.908831.53/0.892029.88/0.902036.67/0.9710
AIDN [8]3236938.07/0.960733.72/0.919232.18/0.899532.24/0.928938.89/0.9744
SAFMN [26]2285238.00/0.960533.54/0.917732.16/0.899531.84/0.925638.71/0.9771
ShuffleMixer [12]3949138.01/0.960633.63/0.918032.17/0.899531.89/0.925738.83/0.9774
HGLN(Ours)1924138.08/0.960833.75/0.918932.24/0.900632.29/0.929839.15/0.9781
(2) Evaluation on Scale × 3 : Comparison with Distillation Networks: At the intermediate × 3 scale, we benchmarked HGLN against the established baseline of Information Distillation Networks, including CARN [13], IMDN [6], RFDN [7], and CFM [36]. These methods primarily rely on channel splitting and progressive refinement to reduce parameter redundancy, a paradigm that has dominated lightweight SR for years.
Table 2 highlights the architectural superiority of HGLN over these classical approaches:
  • Limitations of Distillation: While IMDN and RFDN successfully reduce parameters, their reliance on small-kernel convolutions (typically 3 × 3 ) inherently limits their ERF. Consequently, they struggle to capture global patterns in complex scenes. For instance, on Urban100, IMDN achieves 28.17 dB.
  • Superiority of Large Kernels: In contrast, HGLN leverages the Hybrid Multi-Scale Aggregation (HMSA) module to explicitly decouple structure and detail features. By employing a modified large-kernel mechanism, HGLN outperforms IMDN by 0.10 dB (28.27 dB vs. 28.17 dB) on Urban100.
  • Parameter Efficiency: This performance gain is particularly impressive given that HGLN uses only 28% of the parameters (196K vs. 703K) required by IMDN. Similarly, compared to RFDN, which is an optimized version of IMDN, HGLN maintains a clear lead in both PSNR and SSIM across all datasets. This confirms that our large-kernel strategy provides a more effective mechanism for feature representation than traditional distillation blocks, offering a better “Pareto frontier” between model size and performance.
Table 2. Quantitative comparison with classic distillation methods in terms of Scale × 3 . HGLN outperforms these baselines with significantly fewer parameters. The best results are bolded.
Table 2. Quantitative comparison with classic distillation methods in terms of Scale × 3 . HGLN outperforms these baselines with significantly fewer parameters. The best results are bolded.
MethodParams [K]GFLOPsSet5Set14BSD100Urban100Manga109
PSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIM
CARN [13]159211934.29/0.925530.29/0.840729.06/0.803428.06/0.849333.50/0.9440
IMDN [6]7037234.36/0.927030.32/0.841729.09/0.804628.17/0.851933.61/0.9445
RFDN [7]5414234.41/0.927330.34/0.842029.09/0.805028.21/0.852533.67/0.9449
CFM [36]3193434.37/0.927230.33/0.841929.09/0.806028.02/0.849533.49/0.9441
HGLN(Ours)1961934.46/0.927830.47/0.844629.17/0.807028.27/0.854134.01/0.9466
(3) Evaluation on Scale × 4 : Comparison with SOTA Methods. The × 4 scale presents the most severe degradation challenge, requiring the network to hallucinate substantial missing high-frequency details. Here, we conduct a definitive comparison against the most competitive State-of-the-Art (SOTA) methods, including the sparsity-based SMSR [10], the attention-based DIPNet [11], and we revisit the strong competitors ShuffleMixer [12] and SAFMN [26] to demonstrate HGLN’s robustness under extreme conditions.
Table 3 validates that HGLN achieves a dominating performance on complex benchmarks, effectively solving the “large receptive field vs. low complexity” dilemma.
  • Robustness on Complex Structures: On the Urban100 dataset, which contains rich architectural details and repeating grids, HGLN reaches 26.22 dB, consistently surpassing DIPNet (26.16 dB) and ShuffleMixer (26.08 dB). The improvement of 0.14 dB over ShuffleMixer is critical in lightweight SR, indicating that our gating mechanism effectively suppresses noise while the large kernels capture the long-range dependencies necessary for reconstructing regular grids.
  • Structural Integrity: On Manga109, HGLN achieves 30.85 dB, exceeding ShuffleMixer (30.65 dB) by a remarkable margin of 0.20 dB. The high SSIM score (0.9112) further confirms that our dual-path processing successfully maintains the structural integrity of lines, avoiding the aliasing artifacts common in other methods.
  • Deployment Feasibility: Most importantly, HGLN achieves these SOTA results with the lowest computational cost among all deep methods—only 11 G Multi-Adds. This represents a 31% reduction compared to DIPNet (16G) and a staggering 60% reduction compared to ShuffleMixer (28G). This extreme efficiency implies that HGLN can be deployed on edge devices with significantly lower latency and power consumption, marking a substantial step forward for practical SISR applications.
Table 3. Quantitative comparison with State-of-the-Art (SOTA) Methods on Scale × 4 . HGLN achieves the best performance on complex datasets (Urban100, Manga109) with the lowest computational cost. The best results are bolded.
Table 3. Quantitative comparison with State-of-the-Art (SOTA) Methods on Scale × 4 . HGLN achieves the best performance on complex datasets (Urban100, Manga109) with the lowest computational cost. The best results are bolded.
MethodParams [K]GFLOPsSet5Set14BSD100Urban100Manga109
PSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIMPSNR/SSIM
SMSR [10]10064232.12/0.893228.55/0.780827.55/0.735126.11/0.786830.54/0.9085
SAFMN [26]2401432.18/0.894828.60/0.781327.58/0.735925.97/0.780930.43/0.9063
DIPNet [11]5431632.20/0.895028.58/0.781127.59/0.736426.16/0.787930.53/0.9087
ShuffleMixer [12]4112832.21/0.895328.66/0.782727.61/0.736626.08/0.783530.65/0.9093
HGLN(Ours)2031132.29/0.896328.73/0.784227.64/0.738426.22/0.787930.85/0.9112

4.4. Qualitative Architectural Analysis

While quantitative metrics demonstrate the performance superiority of HGLN, it is equally important to understand the architectural distinctions that lead to these improvements. In Table 4, we provide a qualitative comparison between HGLN and other representative lightweight methods.
As summarized in the table, most existing lightweight networks (e.g., IMDN, RFDN, SAFMN) rely on small-kernel convolutions (typically 3 × 3 ) and standard attention mechanisms. Although efficient, these designs inherently limit the effective receptive field. In contrast, HGLN introduces a hybrid paradigm that explicitly decouples structural and detailed features. By leveraging large-kernel convolutions ( 9 × 9 ) and the structure-aware SGFN, HGLN effectively balances long-range dependency capture with local detail preservation.

4.5. Model Complexity Analysis

In real-world scenarios, particularly for mobile and edge devices, the deployment of Super-Resolution models is constrained not only by reconstruction quality but also by hardware limitations such as memory bandwidth and battery capacity. Therefore, we conduct a deep analysis of model complexity from two distinct perspectives: Parameter Efficiency (storage footprint) and Computational Efficiency (inference latency and power consumption).
Parameter Efficiency: As illustrated in the “Params” column of our comparison tables, HGLN maintains an extremely compact size. At scale × 4 , the model contains only 203 K parameters. When compared to the attention-based AIDN (339 K), HGLN reduces the model size by approximately 40%. More strikingly, compared to the pruning-based SMSR (1006 K), which relies on sparsity to speed up inference but requires a large number of parameters to maintain capacity, HGLN requires merely 20% of its parameters. This compactness is attributed to our HMSA module, which employs a split–transform–merge strategy. By processing structural and detail features in parallel streams with halved channels, we significantly reduce feature redundancy without sacrificing representational power.
Computational Efficiency: While parameter count determines storage, the number of Multi-Adds (FLOPs) is a more direct indicator of execution speed and energy efficiency. HGLN demonstrates the lowest computational cost among all compared deep networks. Calculating on a 1280 × 720 output at × 4 scale, HGLN consumes only 11 G Multi-Adds.
  • Compared to DIPNet (16 G), which is designed for efficiency, HGLN achieves a 31% reduction in computations.
  • Compared to ShuffleMixer (28 G), HGLN reduces the workload by a massive 60%.
  • Even when pitted against the highly optimized SAFMN (14 G), our model saves roughly 21% of computations while delivering higher PSNR scores (e.g., +0.25 dB on Urban100).
This ultra-low computational cost is primarily achieved by our use of large-kernel depth-wise convolutions within the LKA branch, which expands the receptive field with negligible arithmetic cost compared to standard dense convolutions.
Consequently, HGLN achieves a superior Pareto frontier between performance and complexity. The combination of minimal storage requirements and ultra-low FLOPs makes HGLN an ideal candidate for real-time applications on resource-constrained edge devices, ensuring longer battery life and lower heat generation during high-fidelity image reconstruction.

4.6. Visual Quality Comparison

While quantitative metrics like PSNR and SSIM provide an objective measure of reconstruction accuracy, they do not always align perfectly with human perceptual judgment. Therefore, we further evaluate the perceptual quality of the reconstructed images by inspecting the restoration results on challenging benchmarks.
(1) Restoration of Architectural Structures: Restoring repetitive geometric patterns remains a significant challenge, often leading to aliasing artifacts. Figure 6 presents comparisons on the Urban100 dataset. It is evident that small-kernel-based methods like IMDN and SAFMN fail to capture global periodic information, resulting in severe Moiré patterns and structural distortions in img_049 and img_061. In contrast, HGLN leverages the HMSA module to effectively capture long-range dependencies. By expanding the effective receptive field, our model successfully resolves aliasing ambiguities, restoring sharp and correct grid structures that closely match the Ground Truth.
(2) Restoration of Text and Characters: In addition to geometric structures, the legibility of text is a critical metric for real-world SR applications, such as document restoration and screen content enhancement. Figure 7 illustrates the performance on text-heavy images from Manga109 (“Hamlet”) and Set14 (“ppt3”).
  • Complex Artistic Text: As shown in the top row (“Hamlet”), the comic text contains varying stroke widths and high-contrast edges. Competitors like ShuffleMixer and IMDN tend to produce over-smoothed results, where distinct strokes merge into “mushy” blobs, severely compromising readability. This occurs because simple channel-mixing operations often act as low-pass filters, discarding high-frequency edge information. However, HGLN maintains the structural integrity of the strokes, delivering clear separation between characters.
  • Screen Content Text: Similarly, in the “ppt3” example (bottom row), which simulates a digital screen scenario with small fonts, HGLN exhibits a distinct advantage. While other methods introduce ringing artifacts (ghosting shadows around letters) or fail to reconstruct the sharp corners of the alphabet, HGLN effectively suppresses these artifacts.
Figure 7. Visual comparison of text reconstruction capabilities ( × 4 ). The top row shows the results on Hamlet (Manga109), and the bottom row shows the results on ppt3 (Set14). By arranging the comparisons vertically, we highlight the fine-grained details. HGLN (Ours) demonstrates superior performance in recovering sharp character edges and suppressing blurring artifacts in both scenarios.
Figure 7. Visual comparison of text reconstruction capabilities ( × 4 ). The top row shows the results on Hamlet (Manga109), and the bottom row shows the results on ppt3 (Set14). By arranging the comparisons vertically, we highlight the fine-grained details. HGLN (Ours) demonstrates superior performance in recovering sharp character edges and suppressing blurring artifacts in both scenarios.
Applsci 16 01382 g007
This superior text restoration capability is attributed to our SGFN. By explicitly gating the feature flow with high-frequency residuals, SGFN ensures that sharp boundaries are preserved and enhanced, making HGLN highly robust for restoring content with rich semantic information.

4.7. Ablation Study

To thoroughly investigate the effectiveness of the proposed HGLN, we conduct comprehensive ablation studies on the challenging Urban100 dataset ( × 4 ). All ablation models are trained on the DF2K dataset. To balance experimental efficiency and reliability, we adopt a rapid validation protocol: all variants are trained for 200,000 iterations with a batch size of 32 using the Adam optimizer ( β 1 = 0.9 , β 2 = 0.999 ). The initial learning rate is set to 2 × 10 4 and halved at 100,000 iterations. Except for the specific module being tested, all other configurations remain consistent with the final HGLN model to ensure fair comparisons.
(1)
Effectiveness of Core Components: The architectural superiority of HGLN stems from its three novel components: the Hybrid Multi-Scale Aggregation (HMSA) module, the Local–Global Synergistic Attention (LGSA), and the Structure-Gated Feed-forward Network (SGFN). To validate their individual contributions, we replace them with their standard counterparts in the existing literature:
  • HMSA → LKA (Large Kernel Attention) [16];
  • LGSA → SE-Block (Squeeze-and-Excitation) [18];
  • SGFN → GDFN (Gated-Dconv Feed-forward Network) [25].
The quantitative results are summarized in Table 5. First, replacing HMSA with the standard LKA leads to a drastic performance degradation of 0.32 dB in PSNR (25.72 dB vs. 26.04 dB). Although LKA significantly reduces the parameter count to 126.62 K, its reliance on simple depth-wise convolutions limits its ability to capture complex feature correlations. In contrast, our HMSA leverages a dual-path design to aggregate both local identity and long-range dependencies, proving indispensable for high-fidelity reconstruction. Second, replacing LGSA with the standard SE-Block results in a 0.03 dB drop. While the SE-Block captures global channel interdependencies, it neglects local statistical information. LGSA addresses this by incorporating local variance, which is crucial for texture awareness. Third, the SGFN outperforms the standard GDFN by 0.02 dB. This confirms that the proposed structure-aware gating mechanism is more effective at preserving high-frequency details than the conventional gating used in Restormer.
(2)
Internal Mechanisms of LGSA and SGFN: We further delve into the micro-designs of our attention and feed-forward modules. specifically, we investigate the necessity of the standard deviation branch in LGSA (w/o Std) and the high-frequency injection path in SGFN (w/o HF-Inject).
As shown in Table 6, removing the standard deviation branch (‘w/o Std’) leads to a performance drop of 0.02 dB. Theoretically, while mean pooling extracts background intensity, the standard deviation serves as a contrast detector, capturing the richness of local textures. The combination of both statistics enables robust feature recalibration. Similarly, omitting the High-Frequency Injection (‘w/o HF-Inject’) results in a 0.01 dB degradation. This injection strategy acts as a structural prior, guiding the network to focus on edges and boundaries. Considering that these components introduce virtually zero computational overhead, they are highly cost-effective designs for enhancing perceptual quality.
(3)
Impact of Kernel Size: The kernel size k in the HMSA module determines the ERF of the network. We analyze the trade-off between receptive field expansion and optimization difficulty by varying k from 5 to 11.
The results in Table 7 reveal an interesting trend. Increasing k from 5 to 9 yields consistent gains, improving PSNR from 25.99 dB to a peak of 26.04 dB. This validates that larger kernels effectively capture long-range dependencies, which are crucial for hallucinating high-frequency architectural details in Urban100. However, further enlarging k to 11 brings no improvement, with performance dropping back to 25.99 dB. This suggests that excessively large kernels may introduce optimization difficulties due to sparse correlations or vanishing gradients in depth-wise convolutions. Consequently, we adopt k = 9 as the optimal setting, achieving the best balance between model complexity (203.30 K parameters) and restoration fidelity.

4.8. Internal Mechanism and Interpretability

In this section, we provide a deeper investigation into the working mechanism of HGLN from two perspectives: the ERF and the intermediate feature response.

4.8.1. Effective Receptive Field Analysis

To verify whether HGLN truly utilizes long-range dependencies as designed, we employ the Local Attribution Map (LAM) [37] method. LAM visualizes the pixel usage of the input image that contributes the most to the reconstruction of a specific patch. Figure 8 compares the LAM results and the corresponding Diffusion Index (DI) [37] of HGLN against state-of-the-art lightweight models (ShuffleMixer, SAFMN, and IMDN) on the Urban100 dataset.
It is important to note that the Diffusion Index (DI) serves as a critical quantitative metric for the scope of information utilization. Mathematically, DI quantifies the spatial distribution of contributing pixels in the input image. A higher DI value indicates a broader Effective Receptive Field (ERF), implying that the model is capable of harnessing a wider-ranging spatial context to reconstruct local details. In the ill-posed problem of super-resolution, local information is often insufficient to recover missing high-frequency textures. Therefore, a high DI score signifies that the network can successfully perform non-local reasoning, aggregating useful features (such as repetitive geometric patterns) from distant regions to correct aliasing and hallucinate realistic details.
  • Wider Effective Receptive Field (High DI vs. Low DI): As illustrated in Figure 8, the red areas represent the pixels that contribute significantly to the reconstruction. It is evident that the attribution maps of competitive models like ShuffleMixer and SAFMN are confined to a very small local region (e.g., ShuffleMixer only achieves a DI of 2.94 on img_020). This low DI suggests a “tunnel vision” limitation: these models rely heavily on immediate neighboring pixels and fail to utilize surrounding texture information effectively, often leading to blurred edges in complex structures.
  • Global Dependency Capture: In contrast, HGLN activates a significantly broader range of pixels, extending along the direction of the structural textures. On img_074, HGLN achieves a remarkable DI score of 14.15, which is nearly 4 × higher than that of ShuffleMixer (3.42). This substantial increase in DI confirms that our hybrid gated large-kernel design successfully breaks the locality constraint of standard CNNs, enabling the model to capture long-range dependencies that are essential for consistent structural restoration.
This visualization provides strong empirical evidence that our large-kernel hybrid design successfully expands the ERF. By aggregating information from a wider context, HGLN can reconstruct repetitive patterns more accurately, avoiding the hallucinations common in local-window-based methods.

4.8.2. Intermediate Feature Visualization

To further validate the frequency decoupling mechanism of our proposed Hybrid Multi-Scale Aggregation (HMSA) module, we visualize the intermediate feature maps produced by its two internal pathways: the Structure Path and the Detail Path.
As shown in Figure 9, we visualize the feature responses on samples from the BSD100 dataset:
  • Structure Path (Low-Frequency): The Structure Path (Figure 9b) mainly activates on the global shapes and skeletal outlines of the objects (e.g., the building edges in the bottom row). It effectively suppresses high-frequency noise, confirming its role in capturing structural priors.
  • Detail Path (High-Frequency): Conversely, the Detail Path (Figure 9c), powered by Large Kernel Attention (LKA), exhibits strong activation in regions with rich textures (e.g., the pyramid surface in the top row). This demonstrates that the large-kernel design is crucial for preserving fine-grained details.
The distinct activation patterns between the two paths verify the effectiveness of our hybrid strategy in separating and processing different frequency components.
Figure 9. Visualizations of intermediate feature maps. Top Row: Sample 260058 (landscape scene), showing texture details on the pyramid surface activated by the Detail Path. Bottom Row: Sample 78004 (portrait scene), highlighting the structural edges of the building in the Structure Path. In each group, the left panel shows the HR image where the red box indicates the Region of Interest (ROI), and (ad) visualize the shallow, structure, detail, and deep features, respectively.
Figure 9. Visualizations of intermediate feature maps. Top Row: Sample 260058 (landscape scene), showing texture details on the pyramid surface activated by the Detail Path. Bottom Row: Sample 78004 (portrait scene), highlighting the structural edges of the building in the Structure Path. In each group, the left panel shows the HR image where the red box indicates the Region of Interest (ROI), and (ad) visualize the shallow, structure, detail, and deep features, respectively.
Applsci 16 01382 g009

5. Conclusions

In this paper, we proposed a novel HGLN for efficient and accurate single-image super-resolution. Addressing the critical challenge of balancing computational efficiency with reconstruction fidelity, we introduced a suite of architectural innovations designed to maximize the effective receptive field while minimizing parameter redundancy. Specifically, the HMSA module decouples features into structural and detailed streams, utilizing large-kernel convolutions to explicitly capture long-range dependencies and global periodic patterns. Meanwhile, the LGSA overcomes the limitations of standard global pooling by incorporating local context embeddings and dual-statistic descriptors, enabling highly discriminative feature recalibration. Furthermore, the SGFN leverages a high-frequency injection mechanism to adaptively emphasize edge and texture restoration. Extensive quantitative experiments on standard benchmarks demonstrate that HGLN achieves superior performance compared to state-of-the-art lightweight methods. Qualitative evaluations, including visual comparisons on urban scenes and text, along with Local Attribution Map (LAM) analysis, further empirically validate that HGLN successfully resolves aliasing artifacts and utilizes a broader range of input pixels for reconstruction.

Limitations and Future Research Directions

Despite the promising performance of HGLN, challenges and avenues remain for future exploration:
  • Generalization to Real-World Degradations: Currently, HGLN is optimized for the standard bicubic degradation model, which assumes a noise-free input. However, in practical applications—especially under low-light conditions—images are inevitably corrupted by sensor thermal noise, typically modeled as Additive White Gaussian Noise (AWGN). HGLN is designed to aggressively recover high-frequency details via the SGFN module; there is a potential risk that the network might interpret random noise patterns as valid textures, leading to artifact amplification. In this work, we have not exhaustively evaluated this trade-off between detail restoration and noise suppression. In the future, we plan to address this by incorporating Gaussian noise into the training data augmentation pipeline or exploring a joint denoising-and-super-resolution framework to enhance the model’s robustness against sensor noise.
  • Hardware Optimization for Large Kernels: Although HGLN maintains a low parameter count, the use of large-kernel convolutions (e.g., 9 × 9 ) can sometimes lead to higher memory access costs on specific hardware accelerators compared to small kernels. Future work will focus on optimizing the inference efficiency through structural re-parameterization techniques or model quantization (e.g., INT8 quantization) to facilitate deployment on edge devices.
  • Extension to Video Super-Resolution: HGLN’s strong ability to capture structural information makes it a potential candidate for video tasks. We plan to explore the use of temporal alignment modules to adapt the HGLN architecture for Video Super-Resolution (VSR), aiming to maintain temporal consistency while restoring high-frequency details.

Author Contributions

Conceptualization, M.Z. and J.N.; methodology, J.N.; software, J.N.; validation, J.N. and X.L.; formal analysis, J.N.; investigation, J.N.; resources, M.Z.; data curation, J.N.; writing—original draft preparation, J.N.; writing—review and editing, J.N., M.Z. and X.L.; visualization, J.N.; supervision, M.Z.; project administration, M.Z.; funding acquisition, M.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Publicly available datasets were analyzed in this study. These datasets can be found here: DIV2K dataset (https://data.vision.ee.ethz.ch/cvl/DIV2K/, accessed on 30 March 2025), Flickr2K dataset (https://github.com/LimBee/NTIRE2017, accessed on 30 March 2025), Set5 dataset (https://github.com/jbhuang0604/SelfExSR, accessed on 30 March 2025), Set14 dataset (https://github.com/jbhuang0604/SelfExSR, accessed on 30 March 2025), B100 dataset (https://github.com/jbhuang0604/SelfExSR, accessed on 30 March 2025), Urban100 dataset (https://github.com/jbhuang0604/SelfExSR, accessed on 30 March 2025), and Manga109 dataset (http://www.manga109.org/en/, accessed on 30 March 2025). Note that all low-resolution (LR) images used in our experiments were generated from the high-resolution (HR) ground truth using MATLAB (R2021a) bicubic downsampling to ensure consistency with standard benchmarks.

Acknowledgments

The authors would like to express their gratitude to the members of the Computer Vision research group of Electronic Information for their insightful discussions and constructive suggestions during this work. Furthermore, the authors gratefully acknowledge the technical assistance provided by Xiang Li and Man Zhao.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dong, C.; Loy, C.C.; He, K.; Tang, X. Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 2015, 38, 295–307. [Google Scholar] [CrossRef] [PubMed]
  2. Lai, W.-S.; Huang, J.-B.; Ahuja, N.; Yang, M.-H. Fast and accurate image super-resolution with deep laplacian pyramid networks. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 41, 2599–2613. [Google Scholar] [CrossRef]
  3. Lim, B.; Son, S.; Kim, H.; Nah, S.; Lee, K.M. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 21–26 July 2017; pp. 136–144. [Google Scholar] [CrossRef]
  4. Zhang, Y.; Tian, Y.; Kong, Y.; Zhong, B.; Fu, Y. Residual dense network for image restoration. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 43, 2480–2495. [Google Scholar] [CrossRef]
  5. Haris, M.; Shakhnarovich, G.; Ukita, N. Deep back-projecti networks for single image super-resolution. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 43, 4323–4337. [Google Scholar] [CrossRef]
  6. Hui, Z.; Gao, X.; Yang, Y.; Wang, X. Lightweight image super-resolution with information multi-distillation network. In Proceedings of the 27th ACM International Conference on Multimedia, Nice, France, 21–25 October 2019; pp. 2024–2032. [Google Scholar] [CrossRef]
  7. Liu, J.; Tang, J.; Wu, G. Residual feature distillation network for lightweight image super-resolution. In Proceedings of the European Conference on Computer Vision, Glasgow, UK, 23–28 August 2020; pp. 41–55. [Google Scholar] [CrossRef]
  8. Zong, Z.; Zha, L.; Jiang, J.; Liu, X. Asymmetric information distillation network for lightweight super resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 19–20 June 2022; pp. 1249–1258. [Google Scholar] [CrossRef]
  9. Li, W.; Li, J.; Gao, G.; Deng, W.; Yang, J.; Qi, G.-J.; Lin, C.-W. Efficient image super-resolution with feature interaction weighted hybrid network. IEEE Trans. Multimed. 2024, 26, 8461–8473. [Google Scholar] [CrossRef]
  10. Wang, L.; Guo, Y.; Dong, X.; Wang, Y.; Ying, X.; Lin, Z.; An, W. Exploring fine-grained sparsity in convolutional neural networks for efficient inference. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 4474–4493. [Google Scholar] [CrossRef]
  11. Yu, L.; Li, X.; Li, Y.; Jiang, T.; Wu, Q.; Fan, H.; Liu, S. Dipnet: Efficiency distillation and iterative pruning for image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023; pp. 1692–1701. [Google Scholar] [CrossRef]
  12. Sun, L.; Pan, J.; Tang, J. Shufflemixer: An efficient convnet for image super-resolution. Adv. Neural Inf. Process. Syst. 2022, 35, 17314–17326. [Google Scholar] [CrossRef]
  13. Ahn, N.; Kang, B.; Sohn, K.-A. Fast, accurate, and lightweight super-resolution with cascading residual network. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 252–268. [Google Scholar] [CrossRef]
  14. Han, K.; Wang, Y.; Chen, H.; Chen, X.; Guo, J.; Liu, Z.; Tang, Y.; Xiao, A.; Xu, C.; Xu, Y.; et al. A survey on vision transformer. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 87–110. [Google Scholar] [CrossRef] [PubMed]
  15. Li, M.; Ma, B.; Zhang, Y. Lightweight image super-resolution with pyramid clustering transformer. IEEE Trans. Circuits Syst. Video Technol. 2023, 35, 12167–12181. [Google Scholar] [CrossRef]
  16. Guo, M.-H.; Lu, C.-Z.; Liu, Z.-N.; Cheng, M.-M.; Hu, S.-M. Visual attention network. Comput. Vis. Media 2023, 9, 733–752. [Google Scholar] [CrossRef]
  17. Hou, Q.; Lu, C.-Z.; Cheng, M.-M.; Feng, J. Conv2former: A simple transformer-style convnet for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 8274–8283. [Google Scholar] [CrossRef]
  18. Hu, J.; Shen, L.; Albanie, S.; Sun, G.; Wu, E. Squeeze-and-excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 2011–2023. [Google Scholar] [CrossRef] [PubMed]
  19. Wang, Z.; Chen, J.; Hoi, S.C.H. Deep learning for image super-resolution: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 43, 3365–3387. [Google Scholar] [CrossRef]
  20. Wang, Q.; Xie, J.; Zuo, W.; Zhang, L.; Li, P. Deep cnns meet global covariance pooling: Better representation and generalization. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 43, 2582–2597. [Google Scholar] [CrossRef] [PubMed]
  21. Tian, C.; Xu, Y.; Zuo, W.; Lin, C.-W.; Zhang, D. Asymmetric CNN for image superresolution. IEEE Trans. Syst. Man Cybern. Syst. 2021, 52, 3718–3730. [Google Scholar] [CrossRef]
  22. Jing, T.; Liu, C.; Chen, Y. A lightweight single-image super-resolution method based on the parallel connection of convolution and swin transformer blocks. Appl. Sci. 2025, 15, 1806. [Google Scholar] [CrossRef]
  23. Qiao, J.; Liao, J.; Li, W.; Zhang, Y.; Guo, Y.; Xie, J.; Hu, J.; Lin, S. Hi-mamba: Hierarchical mamba for efficient image super-resolution. IEEE Trans. Image Process. 2025, 34, 8461–8473. [Google Scholar] [CrossRef]
  24. Wu, W.; Hao, X.; Luo, X.; Li, Z. Attention-plus-plus network for lightweight image super-resolution. IEEE Signal Process. Lett. 2025, 32, 3201–3205. [Google Scholar] [CrossRef]
  25. Zamir, S.W.; Arora, A.; Khan, S.; Hayat, M.; Khan, F.S.; Yang, M.-H. Restormer: Efficient transformer for high-resolution image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 5728–5739. [Google Scholar] [CrossRef]
  26. Sun, L.; Dong, J.; Tang, J.; Pan, J. Spatially-adaptive feature modulation for efficient image super-resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 1–6 October 2023; pp. 13190–13199. [Google Scholar] [CrossRef]
  27. Kingma, D.P. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar] [CrossRef]
  28. Loshchilov, I.; Hutter, F. Sgdr: Stochastic gradient descent with warm restarts. arXiv 2016, arXiv:1608.03983. [Google Scholar] [CrossRef]
  29. Agustsson, E.; Timofte, R. Ntire 2017 challenge on single image super-resolution: Dataset and study. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 21–26 July 2017; pp. 126–135. [Google Scholar] [CrossRef]
  30. Bevilacqua, M.; Roumy, A.; Guillemot, C.; Alberi-Morel, M.L. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In Proceedings of the British Machine Vision Conference (BMVC), Surrey, UK, 3–7 September 2012. [Google Scholar] [CrossRef]
  31. Yang, J.; Wright, J.; Huang, T.S.; Ma, Y. Image super-resolution via sparse representation. IEEE Trans. Image Process. 2010, 19, 2861–2873. [Google Scholar] [CrossRef] [PubMed]
  32. Martin, D.R.; Fowlkes, C.C.; Malik, J. Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26, 530–549. [Google Scholar] [CrossRef] [PubMed]
  33. Huang, J.-B.; Singh, A.; Ahuja, N. Single image super-resolution from transformed self-exemplars. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 7–12 June 2015; pp. 5197–5206. [Google Scholar] [CrossRef]
  34. Matsui, Y.; Ito, K.; Aramaki, Y.; Fujimoto, A.; Ogawa, T.; Yamasaki, T.; Aizawa, K. Sketch-based manga retrieval using manga109 dataset. Multimed. Tools Appl. 2017, 76, 21811–21838. [Google Scholar] [CrossRef]
  35. Dong, C.; Loy, C.C.; Tang, X. Accelerating the super-resolution convolutional neural network. In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 8–16 October 2016; pp. 391–407. [Google Scholar] [CrossRef]
  36. Wu, Z.; Liu, W.; Huang, D. When handcrafted filter meets cnn: A lightweight conv-filter mixer network for efficient image super-resolution. In Proceedings of the 2024 International Conference on Multimedia Retrieval, Phuket, Thailand, 10–14 June 2024; pp. 722–730. [Google Scholar] [CrossRef]
  37. Gu, J.; Dong, C. Interpreting super-resolution networks with local attribution maps. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 9199–9208. [Google Scholar] [CrossRef]
Figure 1. Comparison of performance and parameters on Manga109 for × 4 SR. The circle area represents Multi-Adds. Our HGLN achieves a superior trade-off with minimal computational cost.
Figure 1. Comparison of performance and parameters on Manga109 for × 4 SR. The circle area represents Multi-Adds. Our HGLN achieves a superior trade-off with minimal computational cost.
Applsci 16 01382 g001
Figure 2. Overview of the HGLN architecture. Different colors indicate distinct functional components. The network consists of multiple Hybrid Gated Large-kernel Blocks (HGLB). Each HGLB integrates a Hybrid Multi-Scale Aggregation (HMSA) module for feature extraction and a Structure-Gated Feed-forward Network (SGFN) for feature transformation.
Figure 2. Overview of the HGLN architecture. Different colors indicate distinct functional components. The network consists of multiple Hybrid Gated Large-kernel Blocks (HGLB). Each HGLB integrates a Hybrid Multi-Scale Aggregation (HMSA) module for feature extraction and a Structure-Gated Feed-forward Network (SGFN) for feature transformation.
Applsci 16 01382 g002
Figure 4. Structure of Local–Global Synergistic Attention (LGSA). Different colors and shapes distinguish between various operations and feature map dimensions.
Figure 4. Structure of Local–Global Synergistic Attention (LGSA). Different colors and shapes distinguish between various operations and feature map dimensions.
Applsci 16 01382 g004
Figure 5. Training convergence curves of HGLN on the Set5 dataset ( × 4 ) over 1 × 10 6 iterations. The left chart shows the PSNR progression, and the right chart shows the SSIM progression. The curves demonstrate that our model converges rapidly in the early stages and maintains high stability throughout the training process, validating the effectiveness of our optimization strategy.
Figure 5. Training convergence curves of HGLN on the Set5 dataset ( × 4 ) over 1 × 10 6 iterations. The left chart shows the PSNR progression, and the right chart shows the SSIM progression. The curves demonstrate that our model converges rapidly in the early stages and maintains high stability throughout the training process, validating the effectiveness of our optimization strategy.
Applsci 16 01382 g005
Figure 6. Visual comparisons for × 4 SR on Urban100 dataset. The red boxes indicate the cropped regions for detailed comparison. Our HGLN effectively suppresses aliasing and restores clear structural patterns.
Figure 6. Visual comparisons for × 4 SR on Urban100 dataset. The red boxes indicate the cropped regions for detailed comparison. Our HGLN effectively suppresses aliasing and restores clear structural patterns.
Applsci 16 01382 g006
Figure 8. LAM and DI score comparison on img_020 and img_074 from Urban100. The left column shows the HR reference images (red boxes indicate the patches). The right panels display the LAM results (top rows) and SR patches (bottom rows). Our HGLN consistently achieves the highest DI scores (14.15 on img_074). Note that a higher DI represents a wider range of utilized spatial context, confirming our model’s superior ability to capture long-range dependencies.
Figure 8. LAM and DI score comparison on img_020 and img_074 from Urban100. The left column shows the HR reference images (red boxes indicate the patches). The right panels display the LAM results (top rows) and SR patches (bottom rows). Our HGLN consistently achieves the highest DI scores (14.15 on img_074). Note that a higher DI represents a wider range of utilized spatial context, confirming our model’s superior ability to capture long-range dependencies.
Applsci 16 01382 g008
Table 4. Qualitative comparison between HGLN and state-of-the-art lightweight SR methods.
Table 4. Qualitative comparison between HGLN and state-of-the-art lightweight SR methods.
MethodCore ParadigmKernelAttentionKey Design
IMDN [6]Distillation 3 × 3 CCAProgressive feature splitting
RFDN [7]Distillation 3 × 3 ESAResidual feature distillation
SMSR [10]Sparsity 3 × 3 Sparse MaskPruning in smooth regions
ShuffleMixer [12]Efficient Operator 7 × 7 (Sim.)ProjectionChannel shuffle mixing
SAFMN [26]Modulation 3 × 3 ScaledSpatially adaptive modulation
HGLN (Ours)Hybrid Gated 9 × 9 Dual-GatedDecoupled structure & detail
Table 5. Ablation study on core components. Our proposed modules (HMSA, LGSA, SGFN) are replaced by standard baselines (LKA, SE-Block, GDFN) to verify their effectiveness. The best results are bolded.
Table 5. Ablation study on core components. Our proposed modules (HMSA, LGSA, SGFN) are replaced by standard baselines (LKA, SE-Block, GDFN) to verify their effectiveness. The best results are bolded.
Model VariantParam. (K)M-Adds (G)PSNR (dB)SSIM
HMSA → LKA126.626.9625.720.7730
LGSA → SE-Block200.3510.6826.010.7816
SGFN → GDFN202.7310.8226.020.7821
HGLN (Full)203.3010.8226.040.7827
Table 6. Ablation study on the internal mechanisms. We investigate the impact of the standard deviation branch in LGSA and the High-Frequency Injection in SGFN. The best results are bolded.
Table 6. Ablation study on the internal mechanisms. We investigate the impact of the standard deviation branch in LGSA and the High-Frequency Injection in SGFN. The best results are bolded.
ModuleVariantPSNR (dB)SSIM
LGSAw/o Std (Mean Only)26.020.7819
Full LGSA26.040.7827
SGFNw/o HF-Inject26.030.7823
Full SGFN26.040.7827
Table 7. Ablation study on the kernel size (k) of the HMSA module. The results indicate that 9 × 9 provides the optimal trade-off. The best results are bolded.
Table 7. Ablation study on the kernel size (k) of the HMSA module. The results indicate that 9 × 9 provides the optimal trade-off. The best results are bolded.
Kernel ( k × k )Param. (K)M-Adds (G)PSNR (dB)SSIM
5 × 5 187.189.9025.990.7809
7 × 7 194.0910.2926.030.7821
9 × 9203.3010.8226.040.7827
11 × 11 214.8211.4925.990.7816
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, M.; Niu, J.; Li, X. HGLN: Hybrid Gated Large-Kernel Network for Lightweight Image Super-Resolution. Appl. Sci. 2026, 16, 1382. https://doi.org/10.3390/app16031382

AMA Style

Zhao M, Niu J, Li X. HGLN: Hybrid Gated Large-Kernel Network for Lightweight Image Super-Resolution. Applied Sciences. 2026; 16(3):1382. https://doi.org/10.3390/app16031382

Chicago/Turabian Style

Zhao, Man, Jinkai Niu, and Xiang Li. 2026. "HGLN: Hybrid Gated Large-Kernel Network for Lightweight Image Super-Resolution" Applied Sciences 16, no. 3: 1382. https://doi.org/10.3390/app16031382

APA Style

Zhao, M., Niu, J., & Li, X. (2026). HGLN: Hybrid Gated Large-Kernel Network for Lightweight Image Super-Resolution. Applied Sciences, 16(3), 1382. https://doi.org/10.3390/app16031382

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop