Next Article in Journal
Autonomous Vehicle Mode Shift’s Effect on Traffic Efficiency: A Comparison of Dedicated Lane and Mixed Traffic Approaches
Previous Article in Journal
Correction: Mayassah, M.; Koch, E. Numerical Modeling of Hydraulic Failure Mechanisms in Levees, River Embankments, and Earth Dams Under Climate-Induced Flood Conditions: A Systematic Literature Review. Appl. Sci. 2026, 16, 5572
Previous Article in Special Issue
Unsupervised Magnetic Anomaly Detection Method Based on Granular Ball One-Class Classification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

GLA-DesnowNet: A Lightweight Hybrid CNN–Transformer Architecture for Image Snow Removal

by
Habibulloyev Fakhriddin Abduhalim Ugli
1,†,
Mst Farjana Aktar
2,†,
Unal Aras
1,
Tulkinov Bakhromjon Nusratjon Ugli
3,
Jee Youl Ryu
1,* and
Tahesin Samira Delwar
1,2,*
1
Department of Smart Robot Convergence and Application Engineering, Pukyong National University, Busan 48513, Republic of Korea
2
Department of Global IT Engineering, Kyungsung University, Busan 48434, Republic of Korea
3
School of Exact Sciences, IT, National Pedagogical University of Uzbekistan, 27 Bunyodkor Avenue, Chilanzar District, Tashkent 100185, Uzbekistan
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Appl. Sci. 2026, 16(15), 7691; https://doi.org/10.3390/app16157691
Submission received: 3 July 2026 / Revised: 20 July 2026 / Accepted: 24 July 2026 / Published: 3 August 2026
(This article belongs to the Special Issue AI-Driven Image and Signal Processing)

Abstract

Single-image snow removal remains a challenging, ill-posed inverse problem in computer vision due to the highly variable appearance of snow degradation. Existing CNN-based methods are limited by local receptive fields and cannot model globally distributed snow patterns, while Transformer-based methods achieve strong performance at a prohibitive computational cost. To address both limitations, GLA-DesnowNet is proposed as a lightweight hybrid architecture that introduces a novel Gated Transformer (GT) module, a gated global attention mechanism designed specifically for physics-driven image desnowing. The Gated Transformer applies global multi-head self-attention with a learned convolutional gate, enabling long-range spatial dependencies to be captured while remaining computationally efficient. An adaptive three-channel snow-mask generation strategy is introduced to automatically produce pixel-level supervision from paired images without manual annotation. A compound loss combining L1 reconstruction with multi-scale pyramid loss is employed to ensure consistent restoration across spatial scales. Evaluated on the Snow100K benchmark, the proposed method achieves 29.30 dB PSNR and 0.93 SSIM in only 160 training epochs, with 0.53 M parameters and 4.44 GFLOPs per inference—significantly fewer than existing state-of-the-art (SOTA) methods—while maintaining competitive restoration quality. On the Comprehensive Snow Dataset (CSD), the identical model achieves a 27.79 dB PSNR and 0.90 SSIM. These results confirm a strong efficiency–accuracy trade-off and cross-dataset generalization suited for resource-constrained and real-time deployment.

1. Introduction

The reliability of computer vision systems is fundamentally dependent on image quality. In real-world deployments, adverse atmospheric conditions such as rain, haze, and snow significantly degrade visual quality and undermine the performance of downstream tasks, including object detection, lane recognition, and semantic segmentation [1,2]. Among these, snow degradation is particularly challenging, owing to its heterogeneous and dynamic nature. Unlike rain streaks or uniform haze, snow particles manifest as sharp dots; translucent blobs; motion-blurred streaks; or large, opaque regions that vary in scale, shape, opacity, and spatial distribution [3]. The consequences are significant across critical applications: autonomous driving systems rely on cameras for real-time obstacle avoidance, and snow degradation can trigger detection failures that endanger passengers [4,5], while surveillance and remote sensing platforms must maintain reliable operation year-round under seasonal conditions [6].
Single-image desnowing—recovering a clean image from a single snow-degraded observation—constitutes a fundamentally ill-posed inverse problem, since multiple clean images may plausibly correspond to the same degraded input. The model must simultaneously localize snow particles, estimate their transparency, and reconstruct occluded content without any additional temporal or multi-view information.
Early approaches to this problem relied on handcrafted priors and statistical models. Non-local mean filtering [7] exploits patch self-similarity for noise suppression but struggles with non-uniform snow distributions. Sparse representation methods [8] employ dictionary-based decompositions to separate snow from background content, while wavelet-based techniques [9] leverage multi-resolution frequency analysis to isolate snow artifacts. Although interpretable, these methods require strong assumptions about snow appearance and generally lack robustness in real-world conditions.
The emergence of deep convolutional neural networks (CNNs) enabled data-driven mappings from degraded to clean images. DesnowNet [3] introduced a physically motivated two-stage decomposition separating snow-mask estimation from clean image reconstruction, achieving substantial improvements over prior methods. JSTASR [10] extended this by jointly modeling snow size and transparency via modified partial convolutions, whereas HDCW-Net [11] leverages hierarchical dual-tree complex wavelet representations with a contradiction channel loss to capture multi-scale snow structure. DDMSNet [12] further extended CNN-based desnowing by incorporating semantic and depth priors within a deep, dense multi-scale network to handle large-scale snow occlusions. SMGARN [13] proposed a snow-mask-guided adaptive residual network that leverages estimated snow masks to modulate feature representations, achieving improved restoration quality through explicit mask-guided adaptation. Despite strong performance, CNN-based methods are fundamentally constrained by spatially local receptive fields. When snow particles are distributed across large spatial extents within an image, purely convolutional architectures fail to model the global context required for coherent restoration.
The advent of vision Transformers offered a natural solution to this limitation. By computing pairwise self-attention across all spatial positions, Transformer architectures capture long-range dependencies that CNNs inherently cannot. TransWeather [14] unifies multi-weather restoration using a single Transformer framework with learnable weather-type embeddings. Uformer [15] adopts a hierarchical encoder–decoder with local-window self-attention for efficient high-resolution processing. Snow-specific models such as SnowFormer [16] and CPLFormer [17] have achieved state-of-the-art (SOTA) PSNR and SSIM performance on the Snow100K benchmark. RSFormer [18] proposes an efficient Transformer architecture jointly addressing rain-by-snow weather removal through a dual-branch design combining global context modeling with local texture recovery, demonstrating strong performance across multiple adverse weather benchmarks. More recently, BAT-Net [19] introduced bidirectional attention for joint desnowing and mask prediction, further demonstrating the effectiveness of attention mechanisms for snow-specific restoration. Beyond weather restoration, attention-based fusion mechanisms have also demonstrated effectiveness in remote sensing tasks such as road-connectivity enhancement [20], further confirming the broad applicability of multi-modal attention frameworks across computer vision domains.
However, these architectures incur substantial computational cost, making them unsuitable for real-time or resource-constrained deployment. Moreover, pure Transformer models largely discard the physically motivated decompositions that have proven effective in CNN-based desnowing, treating the problem as generic image-to-image translation.
CNNs and Transformers are, in fact, complementary: CNNs excel at extracting fine-grained local textures efficiently, while Transformers model global contextual dependencies across the entire image. Integrating both within a physically grounded, lightweight framework offers a compelling path toward accurate and efficient desnowing. This paper proposes GLA-DesnowNet, a hybrid CNN–Transformer architecture that combines multi-scale convolutional feature extraction with a lightweight Gated Transformer module embedded within a physically motivated two-stage pipeline. A novel adaptive three-channel snow-mask generation strategy provides automatic pixel-level supervision without manual annotation.
The method effectively handles snow particles ranging from fine-grained specks (∼1–5 pixels) up to semi-transparent regions covering approximately 20–30% of the image area. For opaque occlusions covering more than 50%, performance may degrade as recovery exceeds the physical model’s capacity.
The key contributions of this work are outlined as follows:
  • A lightweight hybrid CNN–Transformer desnowing framework that integrates multi-scale dilated pyramid convolutions with global self-attention via a Gated Transformer module, achieving strong restoration quality at dramatically reduced computational cost;
  • A novel, adaptive three-channel snow-mask generation strategy that automatically produces pixel-level snow supervision from paired clean and degraded images, eliminating the need for manual mask annotation;
  • A compound training loss combining L1 pixel-wise reconstruction with a multi-scale max-pooling pyramid loss, enabling consistent restoration across both fine and coarse snow structures;
  • Extensive experimental evaluation on two large-scale benchmarks (Snow100K and CSD), demonstrating that GLA-DesnowNet achieves competitive restoration quality against state-of-the-art methods while requiring significantly fewer parameters and training epochs. Consistent performance across both datasets further confirms its strong generalization capability.
The remainder of this paper is organized as follows. Section 2 describes the proposed GLA-DesnowNet architecture and training methodology. Section 3 presents the experimental setup, results, and comparisons on both the Snow100K and CSD benchmarks. Section 4 discusses findings and limitations, and Section 5 concludes the paper.

2. Proposed Model

2.1. Overall Architecture

The framework is composed of three main stages: (i) multi-scale CNN feature extraction, (ii) Transformer-based global context modeling, and (iii) translucency-based reconstruction followed by residual refinement. These stages are sequentially connected to progressively enhance image quality. The complete pipeline is illustrated in Figure 1.
GLA-DesnowNet processes a single snowy image ( x R H × W × 3 ) through this pipeline and follows the physical snow formation model proposed in DesnowNet and subsequent physics-based desnowing frameworks [3,10]:
x = ( 1 S ) · y + A · S
which implies
y = x A · S 1 S .
Directly inverting this equation requires accurate estimates of both the snow mask (S) and the atmospheric component (A).

2.2. Multi-Scale CNN Feature Extraction

Feature extraction is performed by a descriptor module comprising two components: an InceptionLite block and a Dilated Pyramid (DP) convolution. The InceptionLite block applies two successive 3 × 3 convolution layers with batch normalization and Rectified Linear Unit (ReLU) activation [21] to map the input channels to a 32-dimensional representation. This captures local textures at a compact computational cost.
The DP module is inspired by multi-scale context aggregation through dilated convolutions [22]. Four parallel dilated convolutions with dilation rates of { 1 , 2 , 4 , 8 } are employed, each producing 64 feature maps. The outputs are concatenated to yield a 256-channel feature tensor. This multi-scale design captures both fine-grained snow particles and coarse snow occlusions within a single forward pass.

2.3. Gated Transformer Module

To model long-range spatial dependencies, a Gated Transformer (GT) module is inserted between the CNN encoder and the subsequent estimation heads. Given the CNN feature map ( F R B × C × H × W ), the module reshapes it into a sequence of spatial tokens ( X R B × H W × C ), applies layer normalization, and computes multi-head self-attention (MHSA) based on the Transformer architecture [23] with four attention heads:
X ˜ = M H S A ( L N ( X ) )
Although Equation (3) performs standard full self-attention and therefore retains quadratic complexity in the number of spatial tokens, the  module remains computationally lightweight in practice because it operates on a compact 256-channel feature map without a separate feed-forward block, unlike conventional Transformer blocks. The attention output is reshaped back to R B × C × H × W and combined with the input via a learned gating mechanism:
F out = F + 0.5 · G a t e ( F ) X ˜
where G a t e ( · ) denotes a 1 × 1 convolution followed by PReLU activation [24]. This gating selectively amplifies globally informed features while avoiding the instability associated with direct residual addition.
This design is justified experimentally by the ablation study (Table presented later in Section 3.6, where the GT module improves the PSNR from 25.67 dB (M1) to 28.43 dB (M2), corresponding to a gain of 2.76 dB with only a 0.24 M parameter increase. The complete model (M3), which additionally incorporates the Residual Generation module, requires only 4.44 GFLOPs in total, whereas Uformer requires 19.92 G and RSFormer requires 163 G .
The GT module omits a separate feed-forward block; the gating mechanism replaces the standard FFN. Measured parameter breakdown: LayerNorm, 512; four-head MHSA, 263.2 K; gating convolution with PReLU, 65.8 K; InceptionLite, 5.1 K; dilated pyramid, 74.0 K per descriptor; snow estimation head, 9.0 K; atmospheric estimation head, 26.9 K; RG descriptor, 79.7 K; and RG output convolution, 6.9 K—totaling 0.531 M parameters.
The PReLU gate assigns high weights to snow-affected feature channels while suppressing clean background channels. The 0.5 scaling factor dampens attention contributions during early training epochs, ensuring stable gradient flow, as confirmed by the smooth loss curve presented later in Section 3.3.

2.4. Translucency Recovery Module

The TR module applies the descriptor to the input image, producing a 256-channel feature map that is subsequently processed by the Gated Transformer. Two Pyramid Maxout heads, each consisting of three parallel convolutions of sizes { 1 × 1 , 3 × 3 , 5 × 5 } , followed by pixel-wise max selection and PReLU activation, estimate the snow mask ( S [ 0 , 0.95 ] ) and the atmospheric component ( A R H × W × 3 ).
The intermediate clean image is then recovered as
y mid = clamp x A · S 1 S + ε , 0 , 1 ,
where ε = 10 6 prevents division by zero. The TR module explicitly models the physical snow formation process.

2.5. Residual Generation Module

The RG module receives a 7-channel input formed by concatenating [ y mid , S , A ] and applies the descriptor to extract multi-scale features. A 3 × 3 convolutional head followed by PReLU predicts the residual map ( R res ). The final restored image is obtained as
y = y mid + 0.1 · R res .
The scaling factor ( 0.1 ) ensures that the RG module performs controlled refinements on the coarse estimate produced by the TR module, improving texture reconstruction while maintaining training stability.

2.6. Loss Function

The total training loss combines pixel-wise L1 reconstruction loss with a multi-scale pyramid loss inspired by perceptual multi-scale supervision strategies [25]:
L total = L 1 + λ L pyramid ,
where λ = 0.3 .
The pyramid loss is defined as
L pyramid = i = 1 N D o w n i ( y ) D o w n i ( y g t ) 1 ,
where D o w n i ( · ) denotes max pooling with a stride of 2 i and N = 4 . This multi-scale formulation simultaneously handles fine snow particles and large-scale snow occlusions, promoting consistent restoration quality across different spatial scales.

3. Experimental Results

3.1. Dataset and Preprocessing

All experiments are conducted on the Snow100K dataset [3], a large-scale synthetic benchmark containing diverse paired snowy and clean images with varying snow-particle sizes, densities, and transparencies. Following the experimental protocol adopted in this work, the dataset is partitioned into 10,000 training pairs (7000 large-snow and 3000 small-snow samples), 2000 validation pairs, and 4000 test images (2000 large-snow and 2000 small-snow samples).
Since Snow100K does not provide ground-truth snow-mask annotations, an adaptive three-channel mask-generation strategy is introduced to generate pixel-level supervision automatically, as described in Section 3.2.
To further evaluate the generalization capability of the proposed model, experiments are also conducted on the Comprehensive Snow Dataset (CSD) [11]. CSD contains paired snowy and clean images, together with ground-truth snow masks covering diverse outdoor scenes and snow conditions. The dataset is divided into 7800 training pairs, 800 validation pairs, and 2000 test images. Unlike Snow100K, CSD provides ground-truth masks directly; therefore, the adaptive mask-generation procedure is not required during training.

3.2. Adaptive Mask Generation for Snow100K

For each paired snowy image (x) and clean ground-truth image ( y g t ), a grayscale difference map (D) is computed by averaging the pixel-wise absolute RGB differences:
D = 1 3 c { R , G , B } | x c y g t , c | .
Adaptive thresholds are then calculated as
τ m = μ ( D ) + k m σ ( D ) ,
where μ ( D ) and σ ( D ) denote the mean and standard deviation of the difference map, respectively, and m { 1 , 2 , 3 } correspond to the three snow-intensity levels.
Based on these thresholds, pixels are assigned to three mutually exclusive channels representing light, medium, and heavy snow regions. The threshold coefficients ( k 1 , k 2 , k 3 ) are empirically set to ( 0.3 , 0.6 , 1.0 ) for the small-snow subset and ( 0.4 , 0.7 , 1.2 ) for the large-snow subset, reflecting the greater brightness variation associated with denser snow particles. The overall workflow of the proposed adaptive mask-generation strategy is illustrated in Figure 2. Starting from paired snowy and clean images, the method computes a pixel-wise difference map, derives adaptive statistical thresholds, and generates three mutually exclusive snow-intensity channels corresponding to light, medium, and heavy snow regions.
The resulting three-channel masks provide pixel-level supervision for snow-mask learning without requiring manual annotation. Representative examples of the generated masks are shown in Figure 3, illustrating the separation of light-, medium-, and heavy-snow components prior to their combination into the final supervision mask.
Since thresholds ( τ m = μ ( D ) + k m σ ( D ) ) are derived from per-image statistics rather than fixed absolute values, the strategy adapts automatically to image content. Because the threshold ordering ( τ 1 < τ 2 < τ 3 ) depends only on the relative spacing of k 1 , k 2 , and k 3 , moderate proportional variation in these coefficients preserves the separation between light, medium, and heavy snow regions. A perturbation analysis ( ± 20 % on all coefficients) confirmed 79–81% mask-level agreement for the snow channels with the original configuration (measured via IoU), supporting the robustness of the adaptive mask-generation strategy to coefficient choice.
The strategy can be extended to other atmospheric degradations such as rain or haze, where brightness differences produce characteristic difference maps amenable to adaptive threshold segmentation with appropriate coefficient adjustment.

3.3. Training Setup and Implementation Details

The proposed model is trained for 160 epochs using the Adam optimizer [26] with an initial learning rate of 1 × 10 4 and a batch size of 4. Random 64 × 64 image crops are extracted as training patches, serving as a form of spatial data augmentation. Automatic Mixed Precision (AMP) training is employed to reduce memory consumption and accelerate training, while gradient clipping with a maximum norm of 1.0 is applied to ensure stable optimization.
All experiments are implemented in PyTorch (version 2.10.0) and conducted on an NVIDIA Tesla T4 GPU using the Kaggle platform. The training and validation curves are shown in Figure 4. As illustrated in the figure, the proposed model exhibits stable convergence throughout the 160 training epochs. The validation PSNR and SSIM remain consistently close to—and occasionally exceed—the corresponding training metrics, indicating effective generalization and the absence of significant overfitting. The 64 × 64 patch size balances training efficiency and spatial diversity. As illustrated in Figure 4, beyond epoch 160, the validation PSNR and SSIM exhibit fluctuations without consistent improvement, confirming that 160 epochs represents the optimal stopping point for this configuration.
Inference time was measured on an NVIDIA Tesla T4 GPU at 64 × 64 resolution, averaged over 50 runs with 10-image warm-up, yielding 14.66 ms per image. At 256 × 256 resolution, the model requires only 4.44 GFLOPs, which is 4.5× fewer than Uformer (19.92 G), 1.3× fewer than TransWeather (5.64 G), and 37× fewer than RSFormer (163 G), confirming computational efficiency for lightweight deployment.

3.4. Evaluation Metrics

Image restoration performance is evaluated using two widely adopted full-reference metrics: the Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM). Higher PSNR values indicate improved reconstruction fidelity, while SSIM values range from 0 to 1, with higher values representing greater structural similarity relative to the ground-truth image.
Computational efficiency is assessed using the total number of trainable parameters (#Params) and the number of floating-point operations (GFLOPs) required during inference. These metrics facilitate a comprehensive evaluation of the trade-off between restoration performance and computational complexity.
To further assess perceptual image quality, three no-reference image-quality assessment metrics are employed: the Naturalness Image Quality Evaluator (NIQE), Neural Image Assessment (NIMA), and Integrated Local NIQE (IL-NIQE). Lower NIQE and IL-NIQE scores indicate better perceptual quality, whereas higher NIMA scores correspond to more visually appealing images. Unlike PSNR and SSIM, these no-reference metrics do not require ground-truth images and therefore provide complementary insight into the perceptual naturalness and visual quality of the restored results.

3.5. Quantitative Results

Table 1 presents a quantitative comparison between the proposed GLA-DesnowNet and several state-of-the-art (SOTA) desnowing methods on the Snow100K benchmark. Although Transformer-based approaches such as Uformer [15] and TransWeather [14] achieve higher PSNR values, they require substantially greater computational resources.
In contrast, the proposed model achieves a 29.30 dB PSNR and 0.93 SSIM using only 0.53 M parameters and 4.44 GFLOPs while requiring only 160 training epochs. Compared with DesnowNet [3], the proposed framework improves the PSNR by 2.13 dB while reducing the parameter count from 15.6 M to 0.53 M. Furthermore, the model requires significantly fewer parameters than Uformer [15] (9.03 M) and TransWeather [14] (21.90 M), demonstrating an effective balance between restoration quality and computational complexity suitable for lightweight deployment scenarios.
Among the compared methods, HDCW-Net [11], TransWeather [14], and Uformer [15] achieve higher PSNR values, ranging from 31.54 dB to 33.81 dB. However, these methods require substantially larger architectures, ranging from 6.99 M to 21.90 M parameters, and computational costs of up to 19.92 GFLOPs per inference. In comparison, GLA-DesnowNet maintains competitive restoration performance while using only 0.53 M parameters and 4.44 GFLOPs, highlighting its suitability for real-time and resource-constrained applications. Visual comparisons with representative SOTA methods are provided in Figure 5.
Table 2 presents a perceptual quality comparison using three no-reference image-quality metrics. The proposed GLA-DesnowNet achieves the best performance across all three metrics, attaining a NIQE score of 3.047, a NIMA score of 4.929, and an IL-NIQE score of 19.62 on the Snow100K test set. These results indicate that the restored images produced by GLA-DesnowNet are not only more natural-looking, as reflected by the lowest NIQE and IL-NIQE scores, but also perceptually more pleasing, with the highest NIMA scores.
Notably, the proposed model outperforms Transformer-based methods such as Uformer [15] and RSFormer [18] across all three perceptual dimensions. This demonstrates that the proposed hybrid CNN–Transformer architecture produces visually appealing restorations that align well with human perceptual preferences despite its extremely compact architecture.

3.6. Ablation Study

The ablation results presented in Table 3 demonstrate the contribution of each architectural component. The CNN-only baseline (M1) achieves a 25.67 dB PSNR and 0.87 SSIM, indicating that local convolutional representations alone are insufficient for the modeling of globally distributed snow structures. Incorporating the proposed Gated Transformer module (M2) improves performance to a 28.43 dB PSNR and 0.91 SSIM, confirming the importance of long-range contextual modeling.
Finally, adding the Residual Generation (RG) module further refines image details and increases performance to a 29.30 dB PSNR and 0.93 SSIM, validating the complementary effect of residual refinement. These results confirm that each component contributes positively to the overall restoration performance.

3.7. Evaluation on the CSD Dataset

Table 4 reports the results on the 2000-image CSD test set. The proposed model achieves a 27.79 dB PSNR and 0.90 SSIM, representing a 13.53 dB improvement over the degraded input (14.26 dB PSNR and 0.708 SSIM). The Translucency Recovery (TR) module alone achieves a 26.31 dB PSNR and 0.86 SSIM, while the Residual Generation (RG) module contributes an additional 1.48 dB improvement, demonstrating its effectiveness in refining image details.
Furthermore, validation performance reaches a 29.75 dB PSNR and 0.92 SSIM, indicating stable convergence and strong generalization capability. These results confirm that the proposed architecture performs consistently across datasets with different snow characteristics.
Comparing the two benchmarks, Snow100K yields a 29.30 dB PSNR, whereas CSD achieves a 27.79 dB PSNR. This performance gap is expected because CSD contains more diverse and challenging snow degradation patterns. Importantly, the same model architecture achieves competitive desnowing performance on both datasets within only 160 training epochs and without any architectural modification, highlighting the robustness and generalization capability of the proposed hybrid CNN–Transformer framework.

3.8. Qualitative Results

Visual comparisons on Snow100K test samples demonstrate that GLA-DesnowNet consistently removes snow artifacts of varying densities while preserving background structure and color fidelity, as shown in Figure 6. The TR module accurately localizes snow-affected regions through the estimated snow mask, while the RG module effectively restores fine-grained texture details in the final output.
Patch-level comparisons further confirm the ability of the proposed method to recover local image structures in regions containing complex snow patterns without introducing noticeable blurring or color distortions. Representative qualitative results on the CSD dataset are presented in Figure 7, where the proposed model similarly demonstrates effective snow removal and texture preservation under more challenging degradation conditions.

4. Discussion

The experimental results demonstrate that the proposed GLA-DesnowNet achieves a strong efficiency–accuracy trade-off. While recent Transformer-based methods attain higher benchmark PSNR scores, they often rely on substantially larger architectures and longer training schedules [14,15,16,17,19,27,28]. In contrast, the proposed framework achieves competitive restoration quality with only 0.53 M parameters and 4.44 GFLOPs, requiring only 160 training epochs. This lightweight design makes the model particularly suitable for real-time and resource-constrained applications, including edge devices and embedded vision systems.
Relative to pure Transformer approaches such as Uformer [15] and TransWeather [14], GLA-DesnowNet achieves a lower PSNR on Snow100K but requires orders-of-magnitude fewer parameters and floating-point operations. This efficiency–accuracy trade-off is particularly relevant for edge devices and real-time applications where computational resources are constrained. The lightweight Gated Transformer module contributes to this efficiency by applying global attention with a learned gate that selectively amplifies informative features rather than computing full-resolution quadratic attention maps.
The ablation study confirms that each component makes a distinct and complementary contribution: the CNN backbone provides local structure, the Gated Transformer captures global context, and the RG module refines residual details. The adaptive three-channel mask-generation strategy provides effective pixel-level supervision without manual annotation, facilitating supervised training on the paired Snow100K data. Across both Snow100K and CSD, the model achieves consistent desnowing performance within 160 epochs without architectural modification, confirming that the hybrid CNN–Transformer design generalizes well beyond the benchmark on which it was developed.
Several limitations warrant acknowledgment. Both Snow100K and CSD are synthetic benchmarks; therefore, generalization to real-world snow conditions remains to be validated. The 64 × 64 patch training strategy limits exposure to global image context during optimization. Additionally, the architecture does not explicitly model temporal consistency, restricting its applicability to video desnowing. The adopted physical model assumes linear snow formation; real-world deviations such as motion blur and surface accumulation may reduce accuracy. Consistent performance across both Snow100K and CSD suggests generalization beyond a single degradation assumption.
State-of-the-art perceptual scores (NIQE = 3.047, NIMA = 4.929, and IL-NIQE = 19.62) suggest strong perceptual naturalness that may generalize to real images. Future work will address real-world validation through domain adaptation and fine-tuning on small real-world datasets. Three scenarios exist where heavier models outperform the proposed architecture: (1) extremely dense snow covering more than 50% of the image, (2) fine texture recovery under heavy occlusion, and (3) complex chromatic correction beyond the linear model. These trade-offs are justified by the 36× efficiency gain over Uformer (4.44 vs. 19.92 GFLOPs).

5. Conclusions

This research presented GLA-DesnowNet, a lightweight hybrid CNN–Transformer architecture for single-image snow removal. By integrating a Gated Transformer module into a physically motivated two-stage pipeline comprising a Translucency Recovery (TR) module for snow-mask and atmospheric-veiling estimation and a Residual Generation (RG) module for texture refinement, the proposed network achieves competitive restoration quality at dramatically reduced computational cost.
The adaptive three-channel mask-generation strategy provides effective pixel-level supervision from paired data without requiring manual annotation. Experimental results on Snow100K and CSD demonstrate that the proposed framework achieves consistent and competitive desnowing performance while maintaining extremely low computational complexity. The model attains a 29.30 dB PSNR and 0.93 SSIM on Snow100K and a 27.79 dB PSNR and 0.90 SSIM on CSD using only 0.53 M parameters and 4.44 GFLOPs, highlighting its suitability for efficient real-world deployment.
Several limitations warrant acknowledgment: (1) both benchmarks are synthetic, and real-world generalization remains unvalidated; (2) the 64 × 64 patch training limits global image context; (3) the architecture lacks temporal modeling for video desnowing; and (4) the physical model assumes linear snow formation, which may not hold under all real-world conditions.
Future work will focus on four directions:
  • Incorporating real-world snow images and domain-adaptation techniques to improve robustness under natural weather conditions;
  • Extending the framework to video desnowing through temporal attention mechanisms or recurrent architectures;
  • Investigating linear-attention and window-based attention strategies to further reduce inference cost while preserving restoration quality;
  • Developing a unified multi-weather restoration framework capable of jointly handling snow, rain, and haze degradation within a single architecture.

Author Contributions

Conceptualization, H.F.A.U., J.Y.R. and T.S.D.; methodology, H.F.A.U., U.A. and T.S.D.; software, H.F.A.U., M.F.A. and U.A.; validation, T.B.N.U., J.Y.R. and T.S.D.; formal analysis, H.F.A.U., M.F.A. and U.A.; investigation, H.F.A.U., M.F.A. and U.A.; resources, J.Y.R. and T.S.D.; data curation, H.F.A.U. and M.F.A.; writing—original draft preparation, H.F.A.U., M.F.A. and T.S.D.; writing—review and editing, T.B.N.U., J.Y.R. and T.S.D.; visualization, U.A. and M.F.A.; supervision, J.Y.R. and T.S.D.; project administration, J.Y.R. and T.S.D. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Global Joint Research Program funded by Pukyong National University.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available from the corresponding authors upon reasonable request.

Acknowledgments

This work was supported by a Research Grant of Pukyong National University (2025).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Sakaridis, C.; Dai, D.; Gool, L.V. Semantic Foggy Scene Understanding with Synthetic Data. Int. J. Comput. Vis. 2018, 126, 973–992. [Google Scholar] [CrossRef]
  2. Bijelic, M.; Gruber, T.; Mannan, F.; Kraus, F.; Ritter, W.; Dietmayer, K.; Heide, F. Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 11679–11689. [Google Scholar] [CrossRef]
  3. Liu, Y.F.; Jaw, D.W.; Huang, S.C.; Hwang, J.N. DesnowNet: Context-Aware Deep Network for Snow Removal. IEEE Trans. Image Process. 2018, 27, 3064–3073. [Google Scholar] [CrossRef] [PubMed]
  4. Goberville, N.A.; Prins, K.R.; Kadav, P.; Walker, C.L.; Siems-Anderson, A.R.; Asher, Z.D. Snow Coverage Estimation Using Camera Data for Automated Driving Applications. Transp. Res. Interdiscip. Perspect. 2023, 18, 100766. [Google Scholar] [CrossRef]
  5. Mohammadian, B.; Sarayloo, M.; Heil, J.; Hong, H.; Patil, S.; Robertson, M.; Tran, T.; Krishnan, V.; Sojoudi, H. Active Prevention of Snow Accumulation on Cameras of Autonomous Vehicles. SN Appl. Sci. 2021, 3, 154. [Google Scholar] [CrossRef]
  6. Sanin, A.; Sanderson, C.; Lovell, B.C. Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios. In Proceedings of the 20th International Conference on Pattern Recognition (ICPR); IEEE: New York, NY, USA, 2010; pp. 141–144. [Google Scholar]
  7. Buades, A.; Coll, B.; Morel, J.-M. Non-Local Means Denoising. Image Process. Line 2011, 1, 208–212. [Google Scholar] [CrossRef]
  8. Starck, J.L.; Elad, M.; Donoh, D.L.O. Image Decomposition via the Combination of Sparse Representations and a Variational Approach. IEEE Trans. Image Process. 2005, 14, 1570–1582. [Google Scholar] [CrossRef] [PubMed]
  9. Mallat, S.G. A Theory for Multiresolution Signal Decomposition: The Wavelet Representation. IEEE Trans. Pattern Anal. Mach. Intell. 1989, 11, 674–693. [Google Scholar] [CrossRef]
  10. Chen, W.T.; Fang, H.Y.; Ding, J.J.; Tsai, C.C.; Kuo, S.Y. JSTASR: Joint Size and Transparency-Aware Snow Removal Algorithm Based on Modified Partial Convolution and Veiling Effect Removal. In Computer Vision–ECCV 2020; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2020; Volume 12366, pp. 754–770. [Google Scholar] [CrossRef]
  11. Chen, W.-T.; Fang, H.-Y.; Hsieh, C.-L.; Tsai, C.-C.; Chen, I.-H.; Ding, J.-J.; Kuo, S.-Y. ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-Tree Complex Wavelet Representation and Contradict Channel Loss. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2021; pp. 4176–4185. [Google Scholar] [CrossRef]
  12. Zhang, K.; Li, R.; Yu, Y.; Luo, W.; Li, C. Deep Dense Multi-Scale Network for Snow Removal Using Semantic and Depth Priors. IEEE Trans. Image Process. 2021, 30, 7419–7431. [Google Scholar] [CrossRef] [PubMed]
  13. Cheng, B.; Li, J.; Chen, Y.; Zeng, T. Snow Mask Guided Adaptive Residual Network for Image Snow Removal. Comput. Vis. Image Underst. 2023, 236, 103819. [Google Scholar] [CrossRef]
  14. Valanarasu, J.M.J.; Yasarla, R.; Patel, V.M. TransWeather: Transformer-Based Restoration of Images Degraded by Adverse Weather Conditions. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2022; pp. 2353–2363. [Google Scholar]
  15. Wang, Z.; Cun, X.; Bao, J.; Zhou, W.; Liu, J.; Li, H. Uformer: A General U-Shaped Transformer for Image Restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2022; pp. 17662–17672. [Google Scholar]
  16. Chen, S.; Ye, T.; Liu, Y.; Chen, E. SnowFormer: Context Interaction Transformer with Scale-Awareness for Single Image Desnowing. arXiv 2022, arXiv:2208.09703. [Google Scholar]
  17. Chen, S.; Ye, T.; Liu, Y.; Bai, J.; Chen, H.; Lin, Y.; Shi, J.; Chen, E. CPLFormer: Cross-Scale Prototype Learning Transformer for Image Snow Removal. In Proceedings of the 31st ACM International Conference on Multimedia; Association for Computing Machinery: New York, NY, USA, 2023; pp. 4228–4239. [Google Scholar] [CrossRef]
  18. Gao, T.; Wen, Y.; Zhang, K.; Cheng, P.; Chen, T. Towards an Effective and Efficient Transformer for Rain-by-Snow Weather Removal. arXiv 2023, arXiv:2304.02860. [Google Scholar]
  19. Zhang, Y. BAT-Net: Bidirectional Attention Transformer Network for Joint Single-Image Desnowing and Snow Mask Prediction. Information 2025, 16, 966. [Google Scholar] [CrossRef]
  20. Yuan, Y.; Cheng, Y.; Pan, B.; Jin, G.; Yu, D.; Ye, M.; Zhang, Q. A Multi-Modal Attention Fusion Framework for Road Connectivity Enhancement in Remote Sensing Imagery. Mathematics 2025, 13, 3266. [Google Scholar] [CrossRef]
  21. Nair, V.; Hinton, G.E. Rectified Linear Units Improve Restricted Boltzmann Machines. In Proceedings of the 27th International Conference on Machine Learning (ICML); Omnipress: Madison, WI, USA, 2010; pp. 807–814. [Google Scholar]
  22. Yu, F.; Koltun, V. Multi-Scale Context Aggregation by Dilated Convolutions. In Proceedings of the International Conference on Learning Representations (ICLR); ICLR: San Juan, Puerto Rico, 2016. [Google Scholar]
  23. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention Is All You Need. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS); Curran Associates Inc.: Red Hook, NY, USA, 2017; Volume 30. [Google Scholar]
  24. He, K.; Zhang, X.; Ren, S.; Sun, J. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. In Proceedings of the IEEE International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2015; pp. 1026–1034. [Google Scholar]
  25. Johnson, J.; Alahi, A.; Fei-Fei, L. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Computer Vision–ECCV 2016; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2016; Volume 9906, pp. 694–711. [Google Scholar] [CrossRef]
  26. Kingma, D.P.; Ba, J. Adam: A Method for Stochastic Optimization. In Proceedings of the International Conference on Learning Representations (ICLR); ICLR: San Juan, Puerto Rico, 2015. [Google Scholar]
  27. Li, R.; Tan, R.T.; Cheong, L.F. All in One Bad Weather Removal Using Architectural Search. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 3172–3182. [Google Scholar] [CrossRef]
  28. Agbodike, O.; Chen, J. Restoring Snow-Degraded Single Images With Wavelet in Vision Transformer. IEEE Access 2023, 11, 99470–99480. [Google Scholar] [CrossRef]
Figure 1. Overall architecture of the proposed model.
Figure 1. Overall architecture of the proposed model.
Applsci 16 07691 g001
Figure 2. Workflow of the proposed adaptive three-channel snow-mask generation strategy for Snow100K training.
Figure 2. Workflow of the proposed adaptive three-channel snow-mask generation strategy for Snow100K training.
Applsci 16 07691 g002
Figure 3. Qualitative results and examples of generated three-channel snow masks.
Figure 3. Qualitative results and examples of generated three-channel snow masks.
Applsci 16 07691 g003
Figure 4. Training and validation loss, PSNR, and SSIM curves of the proposed model on the Snow100K dataset.
Figure 4. Training and validation loss, PSNR, and SSIM curves of the proposed model on the Snow100K dataset.
Applsci 16 07691 g004
Figure 5. Qualitative comparison with different state-of-the-art (SOTA) desnowing methods on representative Snow100K samples. Note: Dense cloud-like regions represent near-limit cases where residual artifacts may remain.
Figure 5. Qualitative comparison with different state-of-the-art (SOTA) desnowing methods on representative Snow100K samples. Note: Dense cloud-like regions represent near-limit cases where residual artifacts may remain.
Applsci 16 07691 g005
Figure 6. Qualitative comparison showing full-image and patch-wise restoration results of the proposed model on Snow100K test samples.The red frame indicates the region magnified for patch-level comparison.
Figure 6. Qualitative comparison showing full-image and patch-wise restoration results of the proposed model on Snow100K test samples.The red frame indicates the region magnified for patch-level comparison.
Applsci 16 07691 g006
Figure 7. Qualitative comparison showing full-image and patch-wise restoration results of the proposed model on CSD test samples.The red frame indicates the region magnified for patch-level comparison.
Figure 7. Qualitative comparison showing full-image and patch-wise restoration results of the proposed model on CSD test samples.The red frame indicates the region magnified for patch-level comparison.
Applsci 16 07691 g007
Table 1. Quantitative comparison with state-of-the-art methods on the Snow100K benchmark. Bold values indicate the results of the proposed method.
Table 1. Quantitative comparison with state-of-the-art methods on the Snow100K benchmark. Bold values indicate the results of the proposed method.
MethodPSNR (dB)SSIM#ParamsGFLOPs
JSTASR [10]23.120.8665 M
All-in-One [27]26.070.8844 M12.26 G
DesnowNet [3]27.170.8915.6 M1.70 K
DD MSNet [12]28.850.87229.45 M
S MGARN [13]29.440.936.86 M450.30 G
HDCW-Net [11]31.540.956.99 M8.78 G
TransWeather [14]31.820.9321.90 M5.64 G
Uformer [15]33.810.949.03 M19.92 G
SnowFormer [16]29.490.928.38 M19.44 G
RSFormer [18]30.480.9427.70 M163 G
Ours29.300.930.53 M4.44 G
# denotes “number of”.
Table 2. Perceptual quality comparison with state-of-the-art methods on the Snow100K test set. Bold values indicate the results of the proposed method.
Table 2. Perceptual quality comparison with state-of-the-art methods on the Snow100K test set. Bold values indicate the results of the proposed method.
MethodNIQE ↓ NIMA ↑IL-NIQE ↓
DesnowNet [3]4.8983.73822.01
Uformer [15]5.1083.92622.91
TransWeather [14]4.8824.07322.04
SnowFormer [16]4.9244.16722.18
RSFormer [18]4.8964.23520.72
Ours3.0474.92919.62
↓ indicates that lower values are better, and ↑ indicates that higher values are better.
Table 3. Ablation study on Snow100K. Results reported as mean ± SD over five evaluation runs. Bold values indicate the results of the full/proposed model (M3).
Table 3. Ablation study on Snow100K. Results reported as mean ± SD over five evaluation runs. Bold values indicate the results of the full/proposed model (M3).
VariantArchitecturePSNR (dB)SSIMParams (M)GFLOPs
M1 (Only-CNN)TR + RG 25.67 ± 0.21 0.87 ± 0.008 0.200.26
M2Transformer + TR 28.43 ± 0.18 0.91 ± 0.006 0.444.31
M3 (Full Model)Transformer + TR + RG29.30 ± 0.150.93 ± 0.0070.534.44
Table 4. GLA-DesnowNet performance on the CSD dataset (2000 test images).
Table 4. GLA-DesnowNet performance on the CSD dataset (2000 test images).
StagePSNR (dB)SSIM#ParamsGFLOPs
Snowy Input14.260.708
TR Output ( y m i d )26.310.86
Final Output (y)27.790.900.53 M4.44 G
# denotes “number of”.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ugli, H.F.A.; Aktar, M.F.; Aras, U.; Ugli, T.B.N.; Ryu, J.Y.; Delwar, T.S. GLA-DesnowNet: A Lightweight Hybrid CNN–Transformer Architecture for Image Snow Removal. Appl. Sci. 2026, 16, 7691. https://doi.org/10.3390/app16157691

AMA Style

Ugli HFA, Aktar MF, Aras U, Ugli TBN, Ryu JY, Delwar TS. GLA-DesnowNet: A Lightweight Hybrid CNN–Transformer Architecture for Image Snow Removal. Applied Sciences. 2026; 16(15):7691. https://doi.org/10.3390/app16157691

Chicago/Turabian Style

Ugli, Habibulloyev Fakhriddin Abduhalim, Mst Farjana Aktar, Unal Aras, Tulkinov Bakhromjon Nusratjon Ugli, Jee Youl Ryu, and Tahesin Samira Delwar. 2026. "GLA-DesnowNet: A Lightweight Hybrid CNN–Transformer Architecture for Image Snow Removal" Applied Sciences 16, no. 15: 7691. https://doi.org/10.3390/app16157691

APA Style

Ugli, H. F. A., Aktar, M. F., Aras, U., Ugli, T. B. N., Ryu, J. Y., & Delwar, T. S. (2026). GLA-DesnowNet: A Lightweight Hybrid CNN–Transformer Architecture for Image Snow Removal. Applied Sciences, 16(15), 7691. https://doi.org/10.3390/app16157691

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop