Frequency-Guided Multi-Scale Dehazing Network with Cross-Domain Spatial–Spectral Gating
Abstract
1. Introduction
2. Related Work
2.1. Single Image Dehazing
2.2. Frequency-Aware Restoration and Dehazing
2.3. Benchmark Datasets
3. Methods
3.1. Overall Architecture
3.2. Gated Convolutional Backbone
3.3. Frequency Split and Refinement
3.4. Cross-Domain Spatial–Spectral Gating
3.5. Training Objective
4. Experiments
4.1. Datasets, Evaluation Protocol, and Implementation Details
4.2. Quantitative Results
4.3. Comparison with Representative State-of-the-Art Methods
4.4. Ablation Study
4.5. Sensitivity to the Low-Frequency Ratio ρ
4.6. Ablation on the Number of FFT-Equipped Encoder Stages
4.7. Model Efficiency
4.8. Decomposed Ablation of the FFT Branch and the FFT Amplitude Loss
4.9. Real-Haze Fine-Tuning and the Synthetic-to-Real Gap
5. Discussion
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| FGDNet | Frequency-guided multi-scale dehazing network |
References
- Liu, Z.; He, Y.; Wang, C.; Song, R. Analysis of the influence of foggy weather environment on the detection effect of machine vision obstacles. Sensors 2020, 20, 349. [Google Scholar] [CrossRef] [PubMed]
- Liu, W.; Ren, G.; Yu, R.; Guo, S.; Zhu, J.; Zhang, L. Image-adaptive YOLO for object detection in adverse weather conditions. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI Press: Washington, DC, USA, 2022; Volume 36, pp. 1796–1804. [Google Scholar]
- Mohapatra, J.B.; Monikantan, J.; Nishchal, N.K. Object recognition in foggy and hazy conditions using dark channel prior-based fringe-adjusted joint transform correlator. Photonics 2024, 11, 1142. [Google Scholar] [CrossRef]
- Florea, H.; Petrovai, I.; Racoviteanu, A.; Moldoveanu, A.; Moldoveanu, F. Enhanced perception for autonomous driving using semantic and geometric data fusion. Sensors 2022, 22, 5061. [Google Scholar] [CrossRef] [PubMed]
- Hahner, M.; Dai, D.; Sakaridis, C.; Zaech, J.-N.; Van Gool, L. Semantic understanding of foggy scenes with purely synthetic data. In Proceedings of the IEEE Intelligent Transportation Systems Conference (ITSC); IEEE: New York, NY, USA, 2019. [Google Scholar]
- Bijelic, M.; Gruber, T.; Ritter, W. A benchmark for lidar sensors in fog: Is detection breaking down? In Proceedings of the IEEE Intelligent Vehicles Symposium (IV); IEEE: New York, NY, USA, 2018; pp. 760–767. [Google Scholar]
- Xie, Y.; Wei, H.; Liu, Z.; Wang, X.; Ji, X. SynFog: A photo-realistic synthetic fog dataset based on end-to-end imaging simulation for advancing real-world defogging in autonomous driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2024; pp. 13813–13822. [Google Scholar]
- Liu, J.; Wu, Y.; Xiao, Z.; Sun, X.; Alhalbi, J.M.A. A review of remote sensing image dehazing. Sensors 2021, 21, 3928. [Google Scholar] [CrossRef] [PubMed]
- Jiang, B.; Zhang, Y.; Lu, X.; Chen, S.; Chen, L.; Liu, J. Deep dehazing network for remote sensing image with non-uniform haze. Remote Sens. 2021, 13, 4443. [Google Scholar] [CrossRef]
- Makarau, A.; Richter, R.; Müller, R.; Reinartz, P. Haze detection and removal in remotely sensed multispectral imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52, 5895–5905. [Google Scholar] [CrossRef]
- He, K.; Sun, J.; Tang, X. Single image haze removal using dark channel prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2009; pp. 1956–1963. [Google Scholar]
- Cai, B.; Xu, X.; Jia, K.; Qing, C.; Tao, D. DehazeNet: An end-to-end system for single image haze removal. IEEE Trans. Image Process. 2016, 25, 5187–5198. [Google Scholar] [CrossRef] [PubMed]
- Ren, W.; Liu, S.; Zhang, H.; Pan, J.; Cao, X.; Yang, M.-H. Single image dehazing via multi-scale convolutional neural networks. In Proceedings of the European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2016; pp. 154–169. [Google Scholar]
- Li, B.; Peng, X.; Wang, Z.; Xu, J.; Feng, D. AOD-Net: All-in-one dehazing network. In Proceedings of the IEEE International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2017; pp. 4770–4778. [Google Scholar]
- Liu, X.; Ma, Y.; Shi, Z.; Chen, J. GridDehazeNet: Attention-based multi-scale network for image dehazing. In Proceedings of the IEEE International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2019; pp. 7314–7323. [Google Scholar]
- Qin, X.; Wang, Z.; Bai, Y.; Xie, X.; Jia, H. FFA-Net: Feature fusion attention network for single image dehazing. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI Press: Washington, DC, USA, 2020; Volume 34, pp. 11908–11915. [Google Scholar]
- Dong, H.; Pan, J.; Xiang, Z.; Hu, L.; Zhang, X.; Wang, F.; Yang, J. Multi-scale boosted dehazing network with dense feature fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 2157–2167. [Google Scholar]
- Guo, C.-L.; Yan, Q.; Anwar, S.; Cong, R.; Ren, W.; Li, C. Image dehazing transformer with transmission-aware 3D position embedding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2022; pp. 5812–5820. [Google Scholar]
- Song, Y.; He, Y.; Qian, H.; Du, X. Vision transformers for single image dehazing. IEEE Trans. Image Process. 2023, 32, 1927–1941. [Google Scholar] [CrossRef] [PubMed]
- Song, Y.; Zhou, Y.; Qian, H.; Du, X. Rethinking performance gains in image dehazing networks. arXiv 2022, arXiv:2209.11448. [Google Scholar] [CrossRef]
- Chen, Z.; He, Z.; Lu, Z.-M. DEA-Net: Single image dehazing based on detail-enhanced convolution and content-guided attention. IEEE Trans. Circuits Syst. Video Technol. 2024, 33, 1002–1015. [Google Scholar] [CrossRef] [PubMed]
- Yu, H.; Zheng, N.; Zhou, M.; Huang, J.; Xiao, Z.; Zhao, F. Frequency and spatial dual guidance for image dehazing. In Proceedings of the European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2022; pp. 181–198. [Google Scholar]
- Kong, L.; Dong, J.; Ge, J.; Li, M.; Pan, J. Efficient frequency domain-based transformers for high-quality image deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2023; pp. 5886–5895. [Google Scholar]
- Zheng, Y.; Zhan, J.; He, S.; Dong, J.; Du, Y. Curricular contrastive regularization for physics-aware single image dehazing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2023; pp. 5785–5794. [Google Scholar]
- Zheng, Z.; Ren, W.; Cao, X.; Hu, X.; Wang, T.; Song, F.; Jia, X. Ultra-high-definition image dehazing via multi-guided bilateral learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 16185–16194. [Google Scholar]
- Chen, Z.; Wang, Y.; Yang, Y.; Liu, D. PSD: Principled synthetic-to-real dehazing guided by physical priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 7180–7189. [Google Scholar]
- Yang, Y.; Wang, C.; Liu, R.; Zhang, L.; Guo, X.; Tao, D. Self-augmented unpaired image dehazing via density and depth decomposition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2022; pp. 2037–2046. [Google Scholar]
- Wu, R.-Q.; Duan, Z.-P.; Guo, C.-L.; Chai, Z.; Li, C. RIDCP: Revitalizing real image dehazing via high-quality codebook priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2023; pp. 22282–22291. [Google Scholar]
- Zhou, M.; Yu, H.; Huang, J.; Zhao, F.; Gu, J.; Loy, C.C.; Meng, D.; Li, C. Deep Fourier up-sampling. In Advances in Neural Information Processing Systems (NeurIPS); Neural Information Processing Systems Foundation, Inc.: San Diego, CA, USA, 2022; Volume 35. [Google Scholar]
- Cui, Y.; Tao, Y.; Bing, Z.; Ren, W.; Gao, X.; Cao, X.; Huang, K.; Knoll, A. Selective frequency network for image restoration. In Proceedings of the International Conference on Learning Representations (ICLR); ICLR: Rio de Janeiro, Brazil, 2023. [Google Scholar]
- Wang, C.; Wu, H.; Jin, Z. FourLLIE: Boosting low-light image enhancement by Fourier frequency information. In Proceedings of the 31st ACM International Conference on Multimedia (ACM MM), Ottawa, ON, Canada, 29 October–3 November 2023; pp. 7459–7469. [Google Scholar]
- Li, B.; Ren, W.; Fu, D.; Tao, D.; Feng, W.; Zeng, W.; Wang, Z. RESIDE: A benchmark for single image dehazing. IEEE Trans. Image Process. 2019, 28, 492–505. [Google Scholar] [CrossRef] [PubMed]
- Ancuti, C.O.; Ancuti, C.; Timofte, R.; De Vleeschouwer, C. O-HAZE: A dehazing benchmark with real hazy and haze-free outdoor images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2018; pp. 754–762. [Google Scholar]
- Ancuti, C.O.; Ancuti, C.; Timofte, R.; De Vleeschouwer, C. NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2020; pp. 1798–1805. [Google Scholar]


| Training Set | Test Set | PSNR (dB)/SSIM |
|---|---|---|
| ITS | ITS | 33.3/0.983 |
| OTS | OTS | 35.1/0.988 |
| OTS | O-HAZE | 19.1/0.786 |
| OTS | NH-HAZE | 15.8/0.648 |
| ITS (canonical) | SOTS-Indoor (500 pairs) | 33.7/0.984 |
| OTS (canonical) | SOTS-Outdoor (500 pairs) | 35.4/0.988 |
| Protocol | GridDehazeNet [15] | MSBDN [17] | FFA-Net [16] | FGDNet (Ours) |
|---|---|---|---|---|
| ITS→ITS | 32.2/0.978 | 32.8/0.981 | 32.0/0.978 | 33.3/0.983 |
| OTS→OTS | 30.9/0.980 | 33.6/0.982 | 34.7/0.986 | 35.1/0.988 |
| OTS→O-HAZE | 17.2/0.712 | 18.2/0.750 | 18.3/0.766 | 19.1/0.786 |
| OTS→NH-HAZE | 13.4/0.548 | 14.1/0.602 | 14.8/0.638 | 15.8/0.648 |
| Protocol | Full Model PSNR (dB) /SSIM | w/o Cross Gating PSNR (dB) /SSIM | w/o FFT Branch PSNR(dB) /SSIM | Baseline PSNR (dB) /SSIM |
|---|---|---|---|---|
| ITS→ITS | 33.30 ± 0.07/0.983 ± 0.001 | 32.90 ± 0.08/0.982 ± 0.001 | 29.40 ± 0.10/0.971 ± 0.002 | 29.10 ± 0.09/0.968 ± 0.002 |
| OTS→OTS | 35.10 ± 0.09/0.988 ± 0.001 | 34.60 ± 0.10/0.985 ± 0.001 | 31.80 ± 0.11/0.978 ± 0.002 | 31.50 ± 0.10/0.975 ± 0.002 |
| OTS→O-HAZE | 19.10 ± 0.12/0.786 ± 0.004 | 18.70 ± 0.14/0.772 ± 0.004 | 17.70 ± 0.13/0.731 ± 0.005 | 17.30 ± 0.15/0.719 ± 0.005 |
| OTS→NH-HAZE | 15.80 ± 0.15/0.648 ± 0.005 | 15.40 ± 0.14/0.629 ± 0.006 | 14.50 ± 0.16/0.586 ± 0.006 | 14.10 ± 0.17/0.566 ± 0.007 |
| ρ | 0.10 | 0.15 | 0.18 (Ours) | 0.22 | 0.25 | 0.30 |
|---|---|---|---|---|---|---|
| PSNR (dB) | 32.8 | 33.2 | 33.3 | 33.2 | 33.0 | 32.6 |
| SSIM | 0.980 | 0.982 | 0.983 | 0.983 | 0.981 | 0.979 |
| k | PSNR (dB) | SSIM | Params (M) | FLOPS (G) |
|---|---|---|---|---|
| 0 (no FFT stage, Lfft kept) | 29.4 | 0.971 | 1.10 | 7.0 |
| 1 (stage 1) | 30.9 | 0.975 | 1.11 | 7.9 |
| 2 (stages 1–2) | 32.4 | 0.980 | 1.19 | 8.8 |
| 3 (stages 1–3, ours) | 33.3 | 0.983 | 1.35 | 9.8 |
| 4 (all stages) | 33.1 | 0.982 | 1.52 | 10.7 |
| Method | Params (M) | FLOPS (G) | Time (ms) |
|---|---|---|---|
| GridDehazeNet [15] | 0.96 | 21.5 | 17 |
| MSBDN [17] | 31.35 | 41.5 | 28 |
| FFA-Net [16] | 4.46 | 287.8 | 40 |
| DehazeFormer-T [19] | 0.69 | 6.7 | 13 |
| DEA-Net [21] | 3.60 | 32.3 | 22 |
| gUNet (backbone) [20] | 1.10 | 7.0 | 11 |
| FGDNet (ours) | 1.35 | 9.8 | 15 |
| Variant | PSNR (dB) | SSIM |
|---|---|---|
| Full (FFT branch + Lfft) | 33.30 ± 0.07 | 0.983 ± 0.001 |
| Full − Lfft (FFT branch only) | 33.00 ± 0.08 | 0.982 ± 0.001 |
| Full − FFT branch (Lfft only) | 29.40 ± 0.10 | 0.971 ± 0.002 |
| Baseline (neither) | 29.10 ± 0.09 | 0.968 ± 0.002 |
| Full, amplitude + phase L1 | 33.10 ± 0.09 | 0.982 ± 0.001 |
| Setting | PSNR (dB) | SSIM |
|---|---|---|
| OTS only (no fine-tune) | 19.10 | 0.786 |
| +1 k FT iterations (35 pairs) | 20.84 | 0.812 |
| +2 k FT iterations (35 pairs) | 21.60 | 0.827 |
| +5 k FT iterations (35 pairs) | 21.95 | 0.834 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Jin, F.; Lin, H.; Zhang, L.; Chen, Y. Frequency-Guided Multi-Scale Dehazing Network with Cross-Domain Spatial–Spectral Gating. Algorithms 2026, 19, 341. https://doi.org/10.3390/a19050341
Jin F, Lin H, Zhang L, Chen Y. Frequency-Guided Multi-Scale Dehazing Network with Cross-Domain Spatial–Spectral Gating. Algorithms. 2026; 19(5):341. https://doi.org/10.3390/a19050341
Chicago/Turabian StyleJin, Fangyuan, Hui Lin, Lu Zhang, and Yiwei Chen. 2026. "Frequency-Guided Multi-Scale Dehazing Network with Cross-Domain Spatial–Spectral Gating" Algorithms 19, no. 5: 341. https://doi.org/10.3390/a19050341
APA StyleJin, F., Lin, H., Zhang, L., & Chen, Y. (2026). Frequency-Guided Multi-Scale Dehazing Network with Cross-Domain Spatial–Spectral Gating. Algorithms, 19(5), 341. https://doi.org/10.3390/a19050341

