MPINet: Multi-Stage Progressive Illumination-Aware Network for Image Deraining
Abstract
1. Introduction
- (1)
- Illumination-Aware Rain Removal: We introduce illumination awareness to generate illumination maps that guide ICABs for targeted adaptation to local lighting variations in rainy scenes, significantly enhancing performance under diverse illumination conditions.
- (2)
- Adaptive Global-Context Modeling: We propose the UniMetaFormer block with dynamic transformations and attention mechanisms to effectively distinguish between rain streaks and underlying image content, enabling precise rain removal without over-smoothing textures.
- (3)
- Enhanced Progressive Architecture: We improve upon MPRNet’s multi-stage framework by integrating our illumination-aware modules while maintaining reasonable model complexity, demonstrating significant performance gains in deraining benchmarks.
2. Related Work
2.1. Image Deraining
2.2. Illumination-Aware Restoration
3. Framework
3.1. Illumination-Aware Module
3.2. Illumination-Conditioned Attention Block
3.3. Unified Meta-Transformer Block
3.4. Overview of the MPINet
4. Experiments and Analysis
4.1. Datasets
- (1)
- Rain100L/H [34]: A set of synthetic datasets containing light rain (Rain100L) and heavy rain (Rain100H), both including 100 image pairs (a rainy image and its corresponding clean ground truth). Rain100L features low-density rain streaks for evaluating models under light rain conditions. Rain100H presents a more challenging benchmark with higher-density and more complex patterns (e.g., multi-directional) streaks, suitable for evaluating performance under severe rain conditions.
- (2)
- RealRain1kL/H [35]: A real-world rain dataset comprising light rain (RealRain1kL) and heavy rain (RealRain1kH), each containing 1000 rainy–clean image pairs. These images are collected from real scenes and combined with synthetic enhancement. RealRain1kL provides realistic visual characteristics for light rain, while RealRain1kH contains dense, large rain streaks and severe visibility degradation, designed to evaluate model robustness in heavy-rain scenarios.
- (3)
- SPA-Data [35]: A real-world dataset with 95,000 rainy–clean image pairs collected under various weather conditions, including light rain and night scenes. We use 90,000 pairs for training and 5000 for testing.
4.2. Implementation Details
4.3. Main Results
4.4. Parameter Analysis
4.5. Ablation Studies
4.6. Generalization Studies
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional networks for biomedical image segmentation. In Proceedings of the 18th International Conference Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5–9 October 2015; pp. 234–241. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. arXiv 2017, arXiv:1706.03762. [Google Scholar] [CrossRef]
- Zamir, S.W.; Arora, A.; Khan, S.; Hayat, M.; Khan, F.S.; Yang, M.H. Restormer: Efficient transformer for high-resolution image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022; pp. 5728–5739. [Google Scholar] [CrossRef]
- Chen, H.; Wang, Y.; Guo, T.; Xu, C.; Deng, Y.; Liu, Z.; Ma, S.; Xu, C.; Xu, C.; Gao, W. Pre-trained image processing transformer. arXiv 2020, arXiv:2012.00364. [Google Scholar] [CrossRef]
- Ismail Fawaz, H.; Forestier, G.; Weber, J.; Idoumghar, L.; Muller, P.A. Deep learning for time series classification: A review. Data Min. Knowl. Discov. 2019, 33, 917–963. [Google Scholar] [CrossRef]
- Li, J.; Fang, F.; Mei, K.; Zhang, G. Multi-scale residual network for image super-resolution. In Proceedings of the 15th European Conference on Computer Vision, Munich, Germany, 8–14 September 2018; pp. 517–532. [Google Scholar] [CrossRef]
- Zamir, S.W.; Arora, A.; Khan, S.; Hayat, M.; Khan, F.S.; Yang, M.H.; Shao, L. Multi-stage progressive image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 19–25 June 2021; pp. 14821–14831. [Google Scholar] [CrossRef]
- Lin, B.; Jin, Y.; Yan, W.; Ye, W.; Yuan, Y.; Zhang, S.; Tan, R.T. Nightrain: Nighttime video deraining via adaptive-rain-removal and adaptive-correction. In Proceedings of the 38th Annual AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada, 26–27 February 2024; pp. 3378–3385. [Google Scholar] [CrossRef]
- Shi, C.; Fang, L.; Wu, H.; Xian, X.; Shi, Y.; Lin, L. NiteDR: Nighttime image deraining with cross-view sensor cooperative learning for dynamic driving scenes. IEEE Trans. Multi-Media 2024, 26, 9203–9215. [Google Scholar] [CrossRef]
- Wang, H.; Xie, Q.; Wu, Y.; Zhao, Q.; Meng, D. Single image rain streaks removal: A review and an exploration. Int. J. Mach. Learn. Cybern. 2020, 11, 853–872. [Google Scholar] [CrossRef]
- Kang, L.W.; Lin, C.W.; Fu, Y.H. Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans. Image Process. 2012, 21, 1742–1755. [Google Scholar] [CrossRef] [PubMed]
- Li, Y.; Tan, R.T.; Guo, X.; Lu, J.; Brown, M.S. Rain streak removal using layer priors. In Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 2736–2744. [Google Scholar] [CrossRef]
- Cao, X.; Hao, S.; Xu, L. Single image deraining by fully exploiting contextual information. Neural Process. Lett. 2022, 54, 853–870. [Google Scholar] [CrossRef]
- Zhang, H.; Xie, Q.; Lu, B.; Gai, S. Dual attention residual group networks for single image deraining. Digit. Signal Process. 2021, 116, 103106. [Google Scholar] [CrossRef]
- Jiang, K.; Wang, Z.; Yi, P.; Chen, C.; Huang, B.; Luo, Y.; Ma, J.; Jiang, J. Multi-scale progressive fusion network for single image deraining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 8346–8355. [Google Scholar] [CrossRef]
- Yadav, S.; Mehra, A.; Rohmetra, H.; Ratnakumar, R.; Narang, P. DerainGAN: Single image deraining using wasserstein GAN. Multimed. Tools Appl. 2021, 80, 36491–36507. [Google Scholar] [CrossRef]
- Fu, X.; Qi, Q.; Zha, Z.J.; Ding, X.; Wu, F.; Paisley, J. Successive graph convolutional network for image deraining. Int. J. Comput. Vis. 2021, 129, 1691–1711. [Google Scholar] [CrossRef]
- Nah, S.; Hyun Kim, T.; Mu Lee, K. Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 257–265. [Google Scholar] [CrossRef]
- Ren, D.; Zuo, W.; Hu, Q.; Zhu, P.; Meng, D. Progressive image deraining networks: A better and simpler baseline. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 16–20 June 2019; pp. 3937–3946. [Google Scholar] [CrossRef]
- Suin, M.; Purohit, K.; Rajagopalan, A. Spatially-attentive patch-hierarchical network for adaptive motion deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 3606–3615. [Google Scholar] [CrossRef]
- Zhang, H.; Dai, Y.; Li, H.; Koniusz, P. Deep stacked hierarchical multi-patch network for image deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 16–20 June 2019; pp. 5978–5986. [Google Scholar] [CrossRef]
- Zheng, Y.; Yu, X.; Liu, M.; Zhang, S. Residual multiscale based single image deraining. In Proceedings of the 30th British Machine Vision Conference, Cardiff, UK, 9–12 September 2019; pp. 1–12. [Google Scholar]
- Hu, J.; Shen, L.; Albanie, S.; Sun, G.; Vedaldi, A. Gather-excite: Exploiting feature context in convolutional neural networks. arXiv 2018, arXiv:1810.12348. [Google Scholar] [CrossRef]
- Yang, Y.; Wang, X.; Lin, X.; Chen, H. Demnet: A degradation difference enabled multi-stage network for image restoration. Knowl.-Based Syst. 2025. preprint. [Google Scholar] [CrossRef]
- Liu, R.; Wang, L.; He, J.; Wang, J.; Zhang, J.; Liu, X.; Wang, C.; Zhang, H.; Dai, S. Mstnet: A multi-stage progressive network with local–global transformer for image restoration. Appl. Intell. 2025. preprint. [Google Scholar] [CrossRef]
- Wang, X.; Zhang, H.; Cai, K.; Miao, D.; Zhang, Q.; Li, M. SFformer: Adaptive Sparse and Frequency-Guided Transformer Network for Single Image Derain. In Pattern Recognition and Computer Vision—PRCV 2024; Lin, Z., Zha, H., Cheng, M.-M., He, R., Liu, C.-L., Ubul, K., Silamu, W., Zhou, J., Eds.; Lecture Notes in Computer Science; Springer: Singapore, 2025; Volume 15038, pp. 482–496. [Google Scholar] [CrossRef]
- Yamashita, S.; Tsubota, K.; Ikeda, H.; Matsuo, H. Image deraining with frequency-enhanced state space model. arXiv 2024, arXiv:2405.16470. [Google Scholar]
- Pizer, S.M.; Amburn, E.P.; Austin, J.D.; Cromartie, R.; Geselowitz, A.; Greer, T.; ter Haar Romeny, B.; Zimmerman, J.B.; Zuiderveld, K. Adaptive histogram equalization and its variations. Comput. Vis. Graph. Image Process. 1987, 39, 355–368. [Google Scholar] [CrossRef]
- Land, E.H.; McCann, J.J. Lightness and retinex theory. J. Opt. Soc. Am. 1971, 61, 1–11. [Google Scholar] [CrossRef] [PubMed]
- Gong, Y.; Liao, P.; Zhang, X.; Zhang, L.; Chen, G.; Zhu, K.; Tan, X.; Lv, Z. Enlighten-gan for super resolution reconstruction in mid-resolution remote sensing images. Remote Sens. 2021, 13, 1104. [Google Scholar] [CrossRef]
- Zhang, Y.; Zhang, J.; Guo, X. Kindling the dark-ness: A practical low-light image enhancer. In Proceedings of the 27th ACM International Conference on Multimedia, Nice, France, 21–25 October 2019; pp. 1632–1640. [Google Scholar] [CrossRef]
- Xiao, J.; Fu, X.; Liu, A.; Wu, F.; Zha, Z.J. Image deraining transformer. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 12978–12995. [Google Scholar] [CrossRef] [PubMed]
- Xu, J.; Li, Z.; Du, B.; Zhang, M.; Liu, J. ReLUplex made more practical: Leaky ReLU. In Proceedings of the 2020 IEEE Symposium on Computers and Communications, Rennes, France, 7–10 July 2020; pp. 1–7. [Google Scholar] [CrossRef]
- Yang, W.; Tan, R.T.; Feng, J.; Liu, J.; Guo, Z.; Yan, S. Deep joint rain detection and removal from a single image. In Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 1357–1366. [Google Scholar] [CrossRef]
- Wang, T.; Yang, X.; Xu, K.; Chen, S.; Zhang, Q.; Lau, R.W. Spatial attentive single-image de-raining with a high quality real rain dataset. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 16–20 June 2019; pp. 12270–12279. [Google Scholar] [CrossRef]
- Fu, X.; Huang, J.; Ding, X.; Liao, Y.; Paisley, J. Clearing the skies: A deep network architecture for single-image rain removal. IEEE Trans. Image Process. 2017, 26, 2944–2956. [Google Scholar] [CrossRef] [PubMed]
- Fu, X.; Huang, J.; Ding, X.; Liao, Y.; Paisley, J. Removing rain from single images via a deep detail network. In Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 1715–1723. [Google Scholar] [CrossRef]
- Chen, L.; Chu, X.; Zhang, X.; Sun, J. Simple baselines for image restoration. arXiv 2022, arXiv:2204.04676. [Google Scholar] [CrossRef]
- Zhang, K.; Liang, J.; Van Gool, L.; Timofte, R. PromptIR: Prompting for image restoration. arXiv 2023, arXiv:2301.02127. [Google Scholar] [CrossRef]
- Chen, X.; Li, M.; Ren, W.; Zhang, J.; Zhang, L.; Tao, D. Learning a sparse transformer network for effective image deraining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023; pp. 1190–1200. [Google Scholar] [CrossRef]
- Chen, X.; Pan, J.; Dong, J. Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024; pp. 25627–25636. [Google Scholar] [CrossRef]


| Datasets | Rain100L | Rain100H | RealRain1kL | RealRain1kH | ||||
|---|---|---|---|---|---|---|---|---|
| Metrics | PSNR (dB) ↑ | SSIM ↑ | PSNR (dB) ↑ | SSIM ↑ | PSNR (dB) ↑ | SSIM ↑ | PSNR (dB) ↑ | SSIM ↑ |
| Input | 29.6 | 0.838 | 13.56 | 0.371 | 22.27 | 0.7657 | 25.93 | 0.8651 |
| CNN-based Methods | ||||||||
| DerainNet | 27.03 | 0.8841 | 14.92 | 0.5923 | 27.09 | 0.925 | 22.88 | 0.8886 |
| DDN | 32.38 | 0.9259 | 24.64 | 0.849 | 31.18 | 0.9172 | 29.17 | 0.8783 |
| PreNet | 37.48 | 0.979 | 29.46 | 0.899 | - | - | - | - |
| SPANet | 35.33 | 0.969 | 25.11 | 0.827 | 30.43 | 0.947 | 25.76 | 0.9095 |
| MPRNet | 36.4 | 0.965 | 30.41 | 0.89 | 36.29 | 0.972 | 34.74 | 0.964 |
| NAFNet | 37 | 0.978 | 29.66 | 0.9 | 38.8 | 0.986 | 36.11 | 0.976 |
| MPINet (Ours) | 39.93 | 0.9755 | 31.22 | 0.912 | 40.11 | 0.9800 | 36.11 | 0.9710 |
| Transformer-based Methods | ||||||||
| Restormer | 38.99 | 0.978 | 31.46 | 0.904 | 40.9 | 0.9849 | 39.57 | 0.9812 |
| PromptIR | 38.34 | 0.983 | 28.69 | 0.877 | 36.99 | 0.973 | 33.61 | 0.953 |
| DRSFormer | 41.32 | 0.9887 | 32.07 | 0.9316 | - | - | - | - |
| NeRD-Rain-S | 42.00 | 0.9900 | 32.86 | 0.9320 | 38.64 | 0.9790 | 36.69 | 0.9700 |
| Model | Params(M) | FLOPs (G) @ 256 × 256 | |
|---|---|---|---|
| DerainNet | 0.75 | 51.48 | |
| DDN | 0.06 | 3.79 | |
| PreNet | 0.28 | 59.37 | |
| CNN | SPANet | 0.28 | - |
| MPRNet | 3.64 | 141.28 | |
| NAFNet | 17.11 | - | |
| MPINet (Ours) | 10.40 | 158.4 | |
| Restormer | 26.10 | 174.7 | |
| Transformer | PromptIR | 32.11 | 158.1 |
| DRSFormer | 33.66 | 242.9 | |
| NeRD-Rain-S | 10.53 | 79.2 |
| Model Configuration | RealRain1kL | RealRain1kH | ||
|---|---|---|---|---|
| PSNR | SSIM | PSNR | SSIM | |
| MPRNet (Baseline) | 36.29 | 0.972 | 34.74 | 0.964 |
| +Illumination-Aware Module | 37.41 | 0.974 | 35.18 | 0.967 |
| +Illumination-Conditioned Attention (ICAB) | 38.53 | 0.976 | 35.47 | 0.969 |
| +UniMetaFormer | 39.42 | 0.978 | 35.83 | 0.970 |
| MPINet | 40.11 | 0.980 | 36.11 | 0.971 |
| Training Dataset | SPA-Data | |
|---|---|---|
| PSNR | SSIM | |
| RealRain1kL | 33.38 | 0.9501 |
| RealRain1kH | 32.32 | 0.9455 |
| Rain100L | 31.57 | 0.9107 |
| Rain100H | 30.33 | 0.8989 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Qian, Z.; Dong, X.; Li, M.; Miao, X. MPINet: Multi-Stage Progressive Illumination-Aware Network for Image Deraining. Mathematics 2026, 14, 2320. https://doi.org/10.3390/math14132320
Qian Z, Dong X, Li M, Miao X. MPINet: Multi-Stage Progressive Illumination-Aware Network for Image Deraining. Mathematics. 2026; 14(13):2320. https://doi.org/10.3390/math14132320
Chicago/Turabian StyleQian, Zhengwen, Xiaoxiong Dong, Mudong Li, and Xuewen Miao. 2026. "MPINet: Multi-Stage Progressive Illumination-Aware Network for Image Deraining" Mathematics 14, no. 13: 2320. https://doi.org/10.3390/math14132320
APA StyleQian, Z., Dong, X., Li, M., & Miao, X. (2026). MPINet: Multi-Stage Progressive Illumination-Aware Network for Image Deraining. Mathematics, 14(13), 2320. https://doi.org/10.3390/math14132320
