4.1. Experimental Settings
Implementation Details: We implement HGLN using the PyTorch framework (version 2.1.0) and train all models on a workstation equipped with a single NVIDIA RTX 4090 GPU (24 GB VRAM). To ensure an ultra-lightweight design (<250K parameters), we configure the network with
HGLB blocks and a feature channel width of
. The expansion ratio of the SGFN is set to 2. This compact configuration allows for a fair comparison with state-of-the-art efficient models like SAFMN [
26] and ShuffleMixer [
12], while significantly outperforming heavier baselines such as IMDN [
6].
Training Strategy: Training is performed with a batch size of 32, utilizing
LR patches randomly cropped from the training set. Data augmentation is applied via random horizontal flips and rotations (
,
,
). Network parameters are optimized via the ADAM algorithm [
27] with default momentum terms (
). The learning rate is initialized at
and progressively decayed to
using a Cosine Annealing strategy [
28] over the course of
iterations. The objective function
combines L1 pixel loss with FFT frequency loss to preserve both spatial structure and spectral fidelity.
Training Stability Analysis: To verify the optimization stability of HGLN, we monitor the validation metrics throughout the training process. As illustrated in
Figure 5, the validation curves for both PSNR and SSIM on the Set5 dataset (
) demonstrate a consistent upward trajectory. Specifically, the model exhibits rapid convergence within the initial 200,000 iterations, followed by the fine-tuning of detailed textures in the subsequent stages. These smooth curves confirm that our Hybrid Gated Large-kernel architecture is robust and effectively mitigates gradient instability issues.
4.2. Datasets and Metrics
Datasets: To ensure a rigorous evaluation, we conduct experiments on widely recognized benchmark datasets. Network training utilizes the DF2K dataset, a consolidation of DIV2K [
29] and Flickr2K [
3], comprising a total of 3450 high-quality images with 2K resolution. This extensive collection provides diverse textural examples, facilitating the learning of robust feature representations applicable to real-world scenarios.
For testing, we assess model generalization across five standard benchmarks representing varied image complexities. Classical low-resolution scenarios are evaluated using Set5 [
30] and Set14 [
31]. To test performance on natural image textures and edges, we employ the B100 [
32] dataset. Furthermore, to evaluate the reconstruction of complex geometric structures and aliasing-prone patterns (e.g., windows and grids), we utilize the challenging Urban100 [
33] dataset. Finally, Manga109 [
34] is included to verify the model’s ability to handle sharp lines and text within artistic illustrations.
Evaluation Metrics: Reconstruction fidelity is quantified using two standard metrics: Peak Signal-to-Noise Ratio (PSNR) for pixel-level accuracy and Structural Similarity Index (SSIM) for perceptual quality. Consistent with established SISR protocols, all calculations are performed on the Y channel (luminance) of the transformed YCbCr color space, as human vision is more sensitive to luminance intensity. Higher scores in both metrics indicate superior image restoration quality.
4.3. Quantitative Evaluation
We perform a comprehensive evaluation of the proposed HGLN against a wide spectrum of state-of-the-art (SOTA) lightweight SR methods. In the realm of lightweight super-resolution, a direct comparison of all methods in a single table can be misleading due to the vast differences in parameter counts and computational budgets (e.g., varying from 10 G to over 100 G Multi-Adds). To ensure a fair and structurally meaningful comparison, we categorize the competitors based on their architectural paradigms and computational intensity. Consequently, we conduct specific comparisons across three upscaling factors (), focusing on efficiency, architectural evolution, and state-of-the-art performance, respectively.
Positioning against Emerging Architectures: It is worth noting that the landscape of lightweight SR has recently evolved, with the emergence of hybrid architectures [
22] and State Space Models (SSMs) such as Hi-Mamba [
23]. While SSMs achieve linear complexity and impressive global modeling capabilities, they often encounter challenges regarding hardware compatibility (e.g., lack of optimized CUDA kernels for edge devices) and training stability. In contrast, HGLN is explicitly positioned as a pure CNN-based solution that rivals the receptive field of Transformers/SSMs through our proposed Hybrid Gated Large-kernel mechanism. By avoiding complex self-attention operators and state-space recursive calculations, HGLN maintains superior deployment friendliness and determinism on standard hardware, offering a pragmatic balance between the theoretical advantages of recent paradigms and the practical constraints of real-world edge applications.
Significance of Performance Margins. It is widely recognized that the field of lightweight SR has entered a phase of performance saturation. As state-of-the-art methods approach the theoretical upper bounds of reconstruction fidelity under strict parameter constraints, achieving large numerical leaps has become increasingly challenging. In this context, performance gains in the range of 0.05–0.2 dB are statistically significant and represent meaningful architectural breakthroughs rather than random variance. As demonstrated in the following comparisons, HGLN consistently achieves such margins (e.g., +0.26 dB on Manga109 ), confirming the robustness of our design beyond statistical fluctuations.
In the following tables, the best performance is highlighted in bold.
(1) Evaluation on Scale
: Efficiency Comparison: The
upscaling task generally preserves more original information, making it an ideal testing ground for ultra-lightweight architectures where every floating-point operation (FLOP) counts. In this subsection, we benchmark HGLN against methods designed for extreme efficiency (<100 G Multi-Adds), including the classic FSRCNN [
35], the attention-based AIDN [
8], and recent efficient operators like SAFMN [
26] and ShuffleMixer [
12].
As detailed in
Table 1, HGLN demonstrates an unprecedented trade-off between reconstruction quality and computational cost:
Breaking the Saturation Ceiling: On classical datasets like Set5 and Set14, performance gains are typically saturated in the lightweight domain. However, HGLN still manages to secure the top spot (38.08 dB on Set5), marginally outperforming heavier models.
Handling High-Frequency Details: The advantage becomes substantial on the Manga109 dataset, which is replete with sharp text and high-contrast lines. While AIDN achieves a respectable 38.89 dB, HGLN surges to 39.15 dB, delivering a remarkable gain of 0.26 dB. This improvement is directly attributed to our Structure-Gated Feed-forward Network (SGFN), which injects high-frequency residuals into the gating mechanism, preventing the blurring of sharp boundaries that is common in ultra-lightweight models.
Computational Economy: Perhaps most importantly, HGLN achieves these results with only 41 G Multi-Adds. Compared to AIDN (69 G), this represents a 40% reduction in computational load. This proves that our hybrid gated design is far more efficient at extracting informative features from low-degradation inputs than standard attention mechanisms, making it highly suitable for battery-powered devices.
Table 1.
Quantitative comparison with Ultra-Lightweight Methods on Scale . The best results are bolded.
Table 1.
Quantitative comparison with Ultra-Lightweight Methods on Scale . The best results are bolded.
| Method | Params [K] | GFLOPs | Set5 | Set14 | BSD100 | Urban100 | Manga109 |
|---|
| PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM |
|---|
| FSRCNN [35] | 13 | 6 | 37.00/0.9558 | 32.63/0.9088 | 31.53/0.8920 | 29.88/0.9020 | 36.67/0.9710 |
| AIDN [8] | 323 | 69 | 38.07/0.9607 | 33.72/0.9192 | 32.18/0.8995 | 32.24/0.9289 | 38.89/0.9744 |
| SAFMN [26] | 228 | 52 | 38.00/0.9605 | 33.54/0.9177 | 32.16/0.8995 | 31.84/0.9256 | 38.71/0.9771 |
| ShuffleMixer [12] | 394 | 91 | 38.01/0.9606 | 33.63/0.9180 | 32.17/0.8995 | 31.89/0.9257 | 38.83/0.9774 |
| HGLN(Ours) | 192 | 41 | 38.08/0.9608 | 33.75/0.9189 | 32.24/0.9006 | 32.29/0.9298 | 39.15/0.9781 |
(2) Evaluation on Scale
: Comparison with Distillation Networks: At the intermediate
scale, we benchmarked HGLN against the established baseline of Information Distillation Networks, including CARN [
13], IMDN [
6], RFDN [
7], and CFM [
36]. These methods primarily rely on channel splitting and progressive refinement to reduce parameter redundancy, a paradigm that has dominated lightweight SR for years.
Table 2 highlights the architectural superiority of HGLN over these classical approaches:
Limitations of Distillation: While IMDN and RFDN successfully reduce parameters, their reliance on small-kernel convolutions (typically ) inherently limits their ERF. Consequently, they struggle to capture global patterns in complex scenes. For instance, on Urban100, IMDN achieves 28.17 dB.
Superiority of Large Kernels: In contrast, HGLN leverages the Hybrid Multi-Scale Aggregation (HMSA) module to explicitly decouple structure and detail features. By employing a modified large-kernel mechanism, HGLN outperforms IMDN by 0.10 dB (28.27 dB vs. 28.17 dB) on Urban100.
Parameter Efficiency: This performance gain is particularly impressive given that HGLN uses only 28% of the parameters (196K vs. 703K) required by IMDN. Similarly, compared to RFDN, which is an optimized version of IMDN, HGLN maintains a clear lead in both PSNR and SSIM across all datasets. This confirms that our large-kernel strategy provides a more effective mechanism for feature representation than traditional distillation blocks, offering a better “Pareto frontier” between model size and performance.
Table 2.
Quantitative comparison with classic distillation methods in terms of Scale . HGLN outperforms these baselines with significantly fewer parameters. The best results are bolded.
Table 2.
Quantitative comparison with classic distillation methods in terms of Scale . HGLN outperforms these baselines with significantly fewer parameters. The best results are bolded.
| Method | Params [K] | GFLOPs | Set5 | Set14 | BSD100 | Urban100 | Manga109 |
|---|
| PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM |
|---|
| CARN [13] | 1592 | 119 | 34.29/0.9255 | 30.29/0.8407 | 29.06/0.8034 | 28.06/0.8493 | 33.50/0.9440 |
| IMDN [6] | 703 | 72 | 34.36/0.9270 | 30.32/0.8417 | 29.09/0.8046 | 28.17/0.8519 | 33.61/0.9445 |
| RFDN [7] | 541 | 42 | 34.41/0.9273 | 30.34/0.8420 | 29.09/0.8050 | 28.21/0.8525 | 33.67/0.9449 |
| CFM [36] | 319 | 34 | 34.37/0.9272 | 30.33/0.8419 | 29.09/0.8060 | 28.02/0.8495 | 33.49/0.9441 |
| HGLN(Ours) | 196 | 19 | 34.46/0.9278 | 30.47/0.8446 | 29.17/0.8070 | 28.27/0.8541 | 34.01/0.9466 |
(3) Evaluation on Scale
: Comparison with SOTA Methods. The
scale presents the most severe degradation challenge, requiring the network to hallucinate substantial missing high-frequency details. Here, we conduct a definitive comparison against the most competitive State-of-the-Art (SOTA) methods, including the sparsity-based SMSR [
10], the attention-based DIPNet [
11], and we revisit the strong competitors ShuffleMixer [
12] and SAFMN [
26] to demonstrate HGLN’s robustness under extreme conditions.
Table 3 validates that HGLN achieves a dominating performance on complex benchmarks, effectively solving the “large receptive field vs. low complexity” dilemma.
Robustness on Complex Structures: On the Urban100 dataset, which contains rich architectural details and repeating grids, HGLN reaches 26.22 dB, consistently surpassing DIPNet (26.16 dB) and ShuffleMixer (26.08 dB). The improvement of 0.14 dB over ShuffleMixer is critical in lightweight SR, indicating that our gating mechanism effectively suppresses noise while the large kernels capture the long-range dependencies necessary for reconstructing regular grids.
Structural Integrity: On Manga109, HGLN achieves 30.85 dB, exceeding ShuffleMixer (30.65 dB) by a remarkable margin of 0.20 dB. The high SSIM score (0.9112) further confirms that our dual-path processing successfully maintains the structural integrity of lines, avoiding the aliasing artifacts common in other methods.
Deployment Feasibility: Most importantly, HGLN achieves these SOTA results with the lowest computational cost among all deep methods—only 11 G Multi-Adds. This represents a 31% reduction compared to DIPNet (16G) and a staggering 60% reduction compared to ShuffleMixer (28G). This extreme efficiency implies that HGLN can be deployed on edge devices with significantly lower latency and power consumption, marking a substantial step forward for practical SISR applications.
Table 3.
Quantitative comparison with State-of-the-Art (SOTA) Methods on Scale . HGLN achieves the best performance on complex datasets (Urban100, Manga109) with the lowest computational cost. The best results are bolded.
Table 3.
Quantitative comparison with State-of-the-Art (SOTA) Methods on Scale . HGLN achieves the best performance on complex datasets (Urban100, Manga109) with the lowest computational cost. The best results are bolded.
| Method | Params [K] | GFLOPs | Set5 | Set14 | BSD100 | Urban100 | Manga109 |
|---|
| PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM | PSNR/SSIM |
|---|
| SMSR [10] | 1006 | 42 | 32.12/0.8932 | 28.55/0.7808 | 27.55/0.7351 | 26.11/0.7868 | 30.54/0.9085 |
| SAFMN [26] | 240 | 14 | 32.18/0.8948 | 28.60/0.7813 | 27.58/0.7359 | 25.97/0.7809 | 30.43/0.9063 |
| DIPNet [11] | 543 | 16 | 32.20/0.8950 | 28.58/0.7811 | 27.59/0.7364 | 26.16/0.7879 | 30.53/0.9087 |
| ShuffleMixer [12] | 411 | 28 | 32.21/0.8953 | 28.66/0.7827 | 27.61/0.7366 | 26.08/0.7835 | 30.65/0.9093 |
| HGLN(Ours) | 203 | 11 | 32.29/0.8963 | 28.73/0.7842 | 27.64/0.7384 | 26.22/0.7879 | 30.85/0.9112 |
4.4. Qualitative Architectural Analysis
While quantitative metrics demonstrate the performance superiority of HGLN, it is equally important to understand the architectural distinctions that lead to these improvements. In
Table 4, we provide a qualitative comparison between HGLN and other representative lightweight methods.
As summarized in the table, most existing lightweight networks (e.g., IMDN, RFDN, SAFMN) rely on small-kernel convolutions (typically ) and standard attention mechanisms. Although efficient, these designs inherently limit the effective receptive field. In contrast, HGLN introduces a hybrid paradigm that explicitly decouples structural and detailed features. By leveraging large-kernel convolutions () and the structure-aware SGFN, HGLN effectively balances long-range dependency capture with local detail preservation.
4.5. Model Complexity Analysis
In real-world scenarios, particularly for mobile and edge devices, the deployment of Super-Resolution models is constrained not only by reconstruction quality but also by hardware limitations such as memory bandwidth and battery capacity. Therefore, we conduct a deep analysis of model complexity from two distinct perspectives: Parameter Efficiency (storage footprint) and Computational Efficiency (inference latency and power consumption).
Parameter Efficiency: As illustrated in the “Params” column of our comparison tables, HGLN maintains an extremely compact size. At scale , the model contains only 203 K parameters. When compared to the attention-based AIDN (339 K), HGLN reduces the model size by approximately 40%. More strikingly, compared to the pruning-based SMSR (1006 K), which relies on sparsity to speed up inference but requires a large number of parameters to maintain capacity, HGLN requires merely 20% of its parameters. This compactness is attributed to our HMSA module, which employs a split–transform–merge strategy. By processing structural and detail features in parallel streams with halved channels, we significantly reduce feature redundancy without sacrificing representational power.
Computational Efficiency: While parameter count determines storage, the number of Multi-Adds (FLOPs) is a more direct indicator of execution speed and energy efficiency. HGLN demonstrates the lowest computational cost among all compared deep networks. Calculating on a output at scale, HGLN consumes only 11 G Multi-Adds.
Compared to DIPNet (16 G), which is designed for efficiency, HGLN achieves a 31% reduction in computations.
Compared to ShuffleMixer (28 G), HGLN reduces the workload by a massive 60%.
Even when pitted against the highly optimized SAFMN (14 G), our model saves roughly 21% of computations while delivering higher PSNR scores (e.g., +0.25 dB on Urban100).
This ultra-low computational cost is primarily achieved by our use of large-kernel depth-wise convolutions within the LKA branch, which expands the receptive field with negligible arithmetic cost compared to standard dense convolutions.
Consequently, HGLN achieves a superior Pareto frontier between performance and complexity. The combination of minimal storage requirements and ultra-low FLOPs makes HGLN an ideal candidate for real-time applications on resource-constrained edge devices, ensuring longer battery life and lower heat generation during high-fidelity image reconstruction.
4.6. Visual Quality Comparison
While quantitative metrics like PSNR and SSIM provide an objective measure of reconstruction accuracy, they do not always align perfectly with human perceptual judgment. Therefore, we further evaluate the perceptual quality of the reconstructed images by inspecting the restoration results on challenging benchmarks.
(1) Restoration of Architectural Structures: Restoring repetitive geometric patterns remains a significant challenge, often leading to aliasing artifacts.
Figure 6 presents comparisons on the Urban100 dataset. It is evident that small-kernel-based methods like IMDN and SAFMN fail to capture global periodic information, resulting in severe Moiré patterns and structural distortions in img_049 and img_061. In contrast, HGLN leverages the HMSA module to effectively capture long-range dependencies. By expanding the effective receptive field, our model successfully resolves aliasing ambiguities, restoring sharp and correct grid structures that closely match the Ground Truth.
(2) Restoration of Text and Characters: In addition to geometric structures, the legibility of text is a critical metric for real-world SR applications, such as document restoration and screen content enhancement.
Figure 7 illustrates the performance on text-heavy images from Manga109 (“Hamlet”) and Set14 (“ppt3”).
Complex Artistic Text: As shown in the top row (“Hamlet”), the comic text contains varying stroke widths and high-contrast edges. Competitors like ShuffleMixer and IMDN tend to produce over-smoothed results, where distinct strokes merge into “mushy” blobs, severely compromising readability. This occurs because simple channel-mixing operations often act as low-pass filters, discarding high-frequency edge information. However, HGLN maintains the structural integrity of the strokes, delivering clear separation between characters.
Screen Content Text: Similarly, in the “ppt3” example (bottom row), which simulates a digital screen scenario with small fonts, HGLN exhibits a distinct advantage. While other methods introduce ringing artifacts (ghosting shadows around letters) or fail to reconstruct the sharp corners of the alphabet, HGLN effectively suppresses these artifacts.
Figure 7.
Visual comparison of text reconstruction capabilities (). The top row shows the results on Hamlet (Manga109), and the bottom row shows the results on ppt3 (Set14). By arranging the comparisons vertically, we highlight the fine-grained details. HGLN (Ours) demonstrates superior performance in recovering sharp character edges and suppressing blurring artifacts in both scenarios.
Figure 7.
Visual comparison of text reconstruction capabilities (). The top row shows the results on Hamlet (Manga109), and the bottom row shows the results on ppt3 (Set14). By arranging the comparisons vertically, we highlight the fine-grained details. HGLN (Ours) demonstrates superior performance in recovering sharp character edges and suppressing blurring artifacts in both scenarios.
This superior text restoration capability is attributed to our SGFN. By explicitly gating the feature flow with high-frequency residuals, SGFN ensures that sharp boundaries are preserved and enhanced, making HGLN highly robust for restoring content with rich semantic information.
4.7. Ablation Study
To thoroughly investigate the effectiveness of the proposed HGLN, we conduct comprehensive ablation studies on the challenging Urban100 dataset (). All ablation models are trained on the DF2K dataset. To balance experimental efficiency and reliability, we adopt a rapid validation protocol: all variants are trained for 200,000 iterations with a batch size of 32 using the Adam optimizer (). The initial learning rate is set to and halved at 100,000 iterations. Except for the specific module being tested, all other configurations remain consistent with the final HGLN model to ensure fair comparisons.
- (1)
Effectiveness of Core Components: The architectural superiority of HGLN stems from its three novel components: the Hybrid Multi-Scale Aggregation (HMSA) module, the Local–Global Synergistic Attention (LGSA), and the Structure-Gated Feed-forward Network (SGFN). To validate their individual contributions, we replace them with their standard counterparts in the existing literature:
HMSA → LKA (Large Kernel Attention) [
16];
LGSA → SE-Block (Squeeze-and-Excitation) [
18];
SGFN → GDFN (Gated-Dconv Feed-forward Network) [
25].
The quantitative results are summarized in
Table 5. First, replacing HMSA with the standard LKA leads to a drastic performance degradation of 0.32 dB in PSNR (25.72 dB vs. 26.04 dB). Although LKA significantly reduces the parameter count to 126.62 K, its reliance on simple depth-wise convolutions limits its ability to capture complex feature correlations. In contrast, our HMSA leverages a dual-path design to aggregate both local identity and long-range dependencies, proving indispensable for high-fidelity reconstruction. Second, replacing LGSA with the standard SE-Block results in a 0.03 dB drop. While the SE-Block captures global channel interdependencies, it neglects local statistical information. LGSA addresses this by incorporating local variance, which is crucial for texture awareness. Third, the SGFN outperforms the standard GDFN by 0.02 dB. This confirms that the proposed structure-aware gating mechanism is more effective at preserving high-frequency details than the conventional gating used in Restormer.
- (2)
Internal Mechanisms of LGSA and SGFN: We further delve into the micro-designs of our attention and feed-forward modules. specifically, we investigate the necessity of the standard deviation branch in LGSA (w/o Std) and the high-frequency injection path in SGFN (w/o HF-Inject).
As shown in
Table 6, removing the standard deviation branch (‘w/o Std’) leads to a performance drop of 0.02 dB. Theoretically, while mean pooling extracts background intensity, the standard deviation serves as a contrast detector, capturing the richness of local textures. The combination of both statistics enables robust feature recalibration. Similarly, omitting the High-Frequency Injection (‘w/o HF-Inject’) results in a 0.01 dB degradation. This injection strategy acts as a structural prior, guiding the network to focus on edges and boundaries. Considering that these components introduce virtually zero computational overhead, they are highly cost-effective designs for enhancing perceptual quality.
- (3)
Impact of Kernel Size: The kernel size k in the HMSA module determines the ERF of the network. We analyze the trade-off between receptive field expansion and optimization difficulty by varying k from 5 to 11.
The results in
Table 7 reveal an interesting trend. Increasing
k from 5 to 9 yields consistent gains, improving PSNR from 25.99 dB to a peak of 26.04 dB. This validates that larger kernels effectively capture long-range dependencies, which are crucial for hallucinating high-frequency architectural details in Urban100. However, further enlarging
k to 11 brings no improvement, with performance dropping back to 25.99 dB. This suggests that excessively large kernels may introduce optimization difficulties due to sparse correlations or vanishing gradients in depth-wise convolutions. Consequently, we adopt
as the optimal setting, achieving the best balance between model complexity (203.30 K parameters) and restoration fidelity.
4.8. Internal Mechanism and Interpretability
In this section, we provide a deeper investigation into the working mechanism of HGLN from two perspectives: the ERF and the intermediate feature response.
4.8.1. Effective Receptive Field Analysis
To verify whether HGLN truly utilizes long-range dependencies as designed, we employ the Local Attribution Map (LAM) [
37] method. LAM visualizes the pixel usage of the input image that contributes the most to the reconstruction of a specific patch.
Figure 8 compares the LAM results and the corresponding Diffusion Index (DI) [
37] of HGLN against state-of-the-art lightweight models (ShuffleMixer, SAFMN, and IMDN) on the Urban100 dataset.
It is important to note that the Diffusion Index (DI) serves as a critical quantitative metric for the scope of information utilization. Mathematically, DI quantifies the spatial distribution of contributing pixels in the input image. A higher DI value indicates a broader Effective Receptive Field (ERF), implying that the model is capable of harnessing a wider-ranging spatial context to reconstruct local details. In the ill-posed problem of super-resolution, local information is often insufficient to recover missing high-frequency textures. Therefore, a high DI score signifies that the network can successfully perform non-local reasoning, aggregating useful features (such as repetitive geometric patterns) from distant regions to correct aliasing and hallucinate realistic details.
Wider Effective Receptive Field (High DI vs. Low DI): As illustrated in
Figure 8, the red areas represent the pixels that contribute significantly to the reconstruction. It is evident that the attribution maps of competitive models like ShuffleMixer and SAFMN are confined to a very small local region (e.g., ShuffleMixer only achieves a DI of 2.94 on img_020). This low DI suggests a “tunnel vision” limitation: these models rely heavily on immediate neighboring pixels and fail to utilize surrounding texture information effectively, often leading to blurred edges in complex structures.
Global Dependency Capture: In contrast, HGLN activates a significantly broader range of pixels, extending along the direction of the structural textures. On img_074, HGLN achieves a remarkable DI score of 14.15, which is nearly higher than that of ShuffleMixer (3.42). This substantial increase in DI confirms that our hybrid gated large-kernel design successfully breaks the locality constraint of standard CNNs, enabling the model to capture long-range dependencies that are essential for consistent structural restoration.
This visualization provides strong empirical evidence that our large-kernel hybrid design successfully expands the ERF. By aggregating information from a wider context, HGLN can reconstruct repetitive patterns more accurately, avoiding the hallucinations common in local-window-based methods.
4.8.2. Intermediate Feature Visualization
To further validate the frequency decoupling mechanism of our proposed Hybrid Multi-Scale Aggregation (HMSA) module, we visualize the intermediate feature maps produced by its two internal pathways: the Structure Path and the Detail Path.
As shown in
Figure 9, we visualize the feature responses on samples from the BSD100 dataset:
Structure Path (Low-Frequency): The Structure Path (
Figure 9b) mainly activates on the global shapes and skeletal outlines of the objects (e.g., the building edges in the bottom row). It effectively suppresses high-frequency noise, confirming its role in capturing structural priors.
Detail Path (High-Frequency): Conversely, the Detail Path (
Figure 9c), powered by Large Kernel Attention (LKA), exhibits strong activation in regions with rich textures (e.g., the pyramid surface in the top row). This demonstrates that the large-kernel design is crucial for preserving fine-grained details.
The distinct activation patterns between the two paths verify the effectiveness of our hybrid strategy in separating and processing different frequency components.
Figure 9.
Visualizations of intermediate feature maps. Top Row: Sample 260058 (landscape scene), showing texture details on the pyramid surface activated by the Detail Path. Bottom Row: Sample 78004 (portrait scene), highlighting the structural edges of the building in the Structure Path. In each group, the left panel shows the HR image where the red box indicates the Region of Interest (ROI), and (a–d) visualize the shallow, structure, detail, and deep features, respectively.
Figure 9.
Visualizations of intermediate feature maps. Top Row: Sample 260058 (landscape scene), showing texture details on the pyramid surface activated by the Detail Path. Bottom Row: Sample 78004 (portrait scene), highlighting the structural edges of the building in the Structure Path. In each group, the left panel shows the HR image where the red box indicates the Region of Interest (ROI), and (a–d) visualize the shallow, structure, detail, and deep features, respectively.