MS-PANet: Multi-Scale Spatial Pyramid Attention for Effective Drainage Pipeline Image Dehazing
Abstract
1. Introduction
- (a)
- We propose a novel multi-scale spatial pyramid attention (MSPA) module, which enhances multi-scale spatial feature extraction through structural regularization and efficiently constructs long-range channel dependencies, thereby enriching feature representation for subsequent analysis.
- (b)
- By incorporating the MSPA module into ResNet’s residual blocks using 3 × 3 convolutions, we develop a novel dehazing framework, MS-PANet, that integrates the Multi-Scale Boosted Dehazing Network with Dense Feature Fusion backbone. This framework enables adaptive channel attention recalibration while capturing comprehensive multi-scale feature hierarchies.
- (c)
- A stereo depth camera-equipped pipeline inspection robot was deployed to acquire clear pipeline imagery and corresponding depth maps. Utilizing these data, we generated synthetic hazy images via atmospheric scattering models and collected hazy images in real-world environments, culminating in the creation of the CDPD-55000 dataset—a valuable resource for dehazing algorithm development and evaluation.
- (d)
- Extensive experiments on the CDPD-55000 dataset demonstrate that our method achieves state-of-the-art performance in drainage pipeline dehazing scenarios, significantly outperforming contemporary algorithms across multiple evaluation metrics. These results underscore the practical utility of our approach in enhancing the intelligence and reliability of urban drainage pipeline inspection systems.
2. Related Work
2.1. Pipeline Inspections
2.2. Dehazing Algorithms
2.3. Multi-Scale Feature Extraction
2.4. Attention Mechanisms
2.5. Discussion
3. Methodology
3.1. Overall Framework
3.2. Multi-Scale Spatial Pyramid Attention
- Stage 1: Multi-scale Feature Extraction Using HPC
- Stage 2: Channel Relationship Modeling Using SPR
- Stage 3: Cross-Scale Dependency Construction Using Softmax
- Stage 4: Feature Fusion and Output
3.3. Hierarchical Pyramid Convolution Module
3.4. Spatial Pyramid Recalibration Module
4. Experiments
4.1. Drainage Pipeline Dataset
4.2. Ablation Studies
4.2.1. Importance of HPC Module, SPR Module, and Softmax Operation
4.2.2. Impact of Scale (S) and Channel () Parameters
4.3. Comparative Experiments
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Chen, S.-L.; Chou, H.-S.; Huang, C.-H.; Chen, C.-Y.; Li, L.-Y.; Huang, C.-H.; Chen, Y.-Y.; Tang, J.-H.; Chang, W.-H.; Huang, J.-S. An intelligent water monitoring IoT system for ecological environment and smart cities. Sensors 2023, 23, 8540. [Google Scholar] [CrossRef] [Scilit]
- Liu, F.; Lv, Y.; Li, B.; Gao, S.; Qin, Y. A semiphysical approach of haze removal for Landsat image. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2021, 14, 7410–7421. [Google Scholar] [CrossRef] [Scilit]
- Liang, Y.; Li, S.; Cheng, D.; Wang, W.; Li, D.; Liang, J. Image dehazing via self-supervised depth guidance. Pattern Recognit. 2025, 158, 111051. [Google Scholar] [CrossRef] [Scilit]
- Zheng, Y.; Su, J.; Zhang, S.; Tao, M.; Wang, L. Unpaired remote sensing image dehazing using enhanced skip attention-based generative adversarial networks with rotation invariance. Remote Sens. 2024, 16, 2707. [Google Scholar] [CrossRef] [Scilit]
- Zheng, Y.; Qian, L.; Zhang, Y.; Cao, J.; Liu, X.; Ma, Y. A novel image dehazing algorithm for complex natural environments. Pattern Recognit. 2025, 157, 110865. [Google Scholar] [CrossRef] [Scilit]
- Cui, T.; Dai, Q.; Zhang, M.; Li, K.; Ji, X.; Hao, J.; Yang, J. Physics-driven image dehazing from the perspective of unmanned aerial vehicles. Electronics 2024, 13, 4186. [Google Scholar] [CrossRef] [Scilit]
- Zhang, X.; Wang, T.; Wang, J.; Tang, G.; Zhao, L. Pyramid channel-based feature attention network for image dehazing. Comput. Vis. Image Underst. 2020, 197, 103003. [Google Scholar] [CrossRef] [Scilit]
- Dong, H.; Pan, J.; Xiang, L.; Hu, Z.; Zhang, X.; Wang, F.; Yang, M.-H. Multi-scale boosted dehazing network with dense feature fusion. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2020; pp. 2157–2167. [Google Scholar]
- Carlino, A.; Godio, A. Laboratory testing of FBGs for pipeline monitoring. Sensors 2020, 20, 3797. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kumar, S.S.; Abraham, D.M.; Jahanshahi, M.R.; Iseley, T.; Starr, J. Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks. Autom. Constr. 2018, 91, 273–283. [Google Scholar] [CrossRef] [Scilit]
- Tian, Y.; Ye, Q.; Doermann, D. YOLOv12: Attention-centric real-time object detectors. arXiv 2025, arXiv:2502.12524. [Google Scholar]
- Wei, W.; Li, C.; Li, S.; Chen, Z.; Yang, F. SewerOD: A visual sewer disease detection dataset for machine learning. J. Physics Conf. Ser. 2023, 2646, 012011. [Google Scholar] [CrossRef] [Scilit]
- Yan, W.; Cui, L. Image dehaze algorithm based on improved atmospheric scattering models. IEEE Access 2024, 12, 98971–98976. [Google Scholar] [CrossRef] [Scilit]
- He, K.; Sun, J.; Tang, X. Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 33, 2341–2353. [Google Scholar] [CrossRef] [Scilit]
- Zhu, Q.; Mai, J.; Shao, L. A fast single image haze removal algorithm using color attenuation prior. IEEE Trans. Image Process. 2015, 24, 3522–3533. [Google Scholar] [CrossRef] [Scilit]
- Song, Y.; He, Z.; Qian, H.; Du, X. Vision transformers for single image dehazing. IEEE Trans. Image Process. 2023, 32, 1927–1941. [Google Scholar] [CrossRef] [Scilit]
- Wu, R.-Q.; Duan, Z.-P.; Guo, C.-L.; Chai, Z.; Li, C. RIDCP: Revitalizing real image dehazing via high-quality codebook priors. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2023; pp. 22282–22291. [Google Scholar]
- Szegedy, C.; Ioffe, S.; Vanhoucke, V.; Alemi, A. Inception-v4, inception-resnet and the impact of residual connections on learning. Proc. Aaai Conf. Artif. Intell. 2017, 31, 4278–4284. [Google Scholar] [CrossRef] [Scilit]
- Öztürk, Ş.; Turalı, M.Y.; Çukur, T. Hydravit: Adaptive multi-branch transformer for multi-label disease classification from chest X-ray images. Biomed. Signal Process. Control 2025, 100, 106959. [Google Scholar] [CrossRef] [Scilit]
- Çoğalmiş, K.N.; Bulut, A. Generating ad creatives using deep learning for search advertising. Turk. J. Electr. Eng. Comput. Sci. 2022, 30, 1882–1896. [Google Scholar] [CrossRef] [Scilit]
- Çalışkan, A. Finding complement of inefficient feature clusters obtained by metaheuristic optimization algorithms to detect rock mineral types. Trans. Inst. Meas. Control 2023, 45, 1815–1828. [Google Scholar] [CrossRef] [Scilit]
- Jin, X.; Xie, Y.; Wei, X.-S.; Zhao, B.-R.; Chen, Z.-M.; Tan, X. Delving deep into spatial pooling for squeeze-and-excitation networks. Pattern Recognit. 2022, 121, 108159. [Google Scholar] [CrossRef] [Scilit]
- Ma, X.; Guo, J.; Sansom, A.; McGuire, M.; Kalaani, A.; Chen, Q.; Tang, S.; Yang, Q.; Fu, S. Spatial pyramid attention for deep convolutional neural networks. IEEE Trans. Multimed. 2021, 23, 3048–3058. [Google Scholar] [CrossRef] [Scilit]
- Wang, Q.; Wu, B.; Zhu, P.; Li, P.; Zuo, W.; Hu, Q. ECA-Net: Efficient channel attention for deep convolutional neural networks. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2020; pp. 11534–11542. [Google Scholar]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2016; pp. 779–788. [Google Scholar]
- Kim, S.; Park, S.; Na, B.; Yoon, S. Spiking-YOLO: Spiking neural network for energy-efficient object detection. Proc. Aaai Conf. Artif. Intell. 2020, 34, 11270–11277. [Google Scholar] [CrossRef] [Scilit]
- Huang, Z.; Wang, J.; Fu, X.; Yu, T.; Guo, Y.; Wang, R. DC-SPP-YOLO: Dense connection and spatial pyramid pooling based YOLO for object detection. Inf. Sci. 2020, 522, 241–258. [Google Scholar] [CrossRef] [Scilit]
- Li, C.; Tang, Z.; Qiao, J.; Su, C.; Yang, F. Multi-Scale Adaptive Feature Network Drainage Pipe Image Dehazing Method Based on Multiple Attention. Electronics 2023, 13, 1406. [Google Scholar] [CrossRef] [Scilit]
- Keleş, O.; Yılmaz, M.A.; Tekalp, A.M.; Korkmaz, C.; Doğan, Z. On the computation of PSNR for a set of images or video. In 2021 Picture Coding Symposium (PCS); IEEE: New York, NY, USA, 2021; pp. 1–5. [Google Scholar]
- Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Scilit]
- Song, Y.; Zhou, Y.; Qian, H.; Du, X. Rethinking performance gains in image dehazing networks. arXiv 2022, arXiv:2209.11448. [Google Scholar] [CrossRef] [Scilit]
- Cho, S.-J.; Ji, S.-W.; Hong, J.-P.; Jung, S.-W.; Ko, S.-J. Rethinking coarse-to-fine approach in single image deblurring. In IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2021; pp. 4641–4650. [Google Scholar]
- Lu, L.; Xiong, Q.; Xu, B.; Chu, D. Mixdehazenet: Mix structure block for image dehazing network. In 2024 International Joint Conference on Neural Networks (IJCNN); IEEE: New York, NY, USA, 2024; pp. 1–10. [Google Scholar]






| Method | PSNR | SSIM |
|---|---|---|
| HPC | 35.02 | 0.905 |
| SPR | 34.80 | 0.906 |
| HPC + SPR (no Softmax) | 33.97 | 0.906 |
| HPC + SPR (Softmax) | 39.32 | 0.993 |
| Method | Setting | PSNR | SSIM |
|---|---|---|---|
| MSBDN-RDFF [8] | N/A | 33.60 | 0.905 |
| MS-PANet (Ours) | 38.27 | 0.973 | |
| 39.32 | 0.993 | ||
| 38.58 | 0.982 | ||
| 38.49 | 0.979 |
| Method | Setting | PSNR | SSIM |
|---|---|---|---|
| MSBDN-RDFF [8] | N/A | 33.60 | 0.905 |
| MS-PANet (Ours) | 38.21 | 0.972 | |
| 39.32 | 0.993 | ||
| 39.34 | 0.993 | ||
| 39.35 | 0.993 | ||
| 39.37 | 0.994 |
| Method | PSNR | SSIM | Param (M) | Latency (ms) |
|---|---|---|---|---|
| gUNet [31] | 29.33 | 0.983 | 5.0 | 5.38 |
| MIMO-UNet [32] | 28.70 | 0.972 | 6.8 | 6.36 |
| MIMO-UNet++ [32] | 29.71 | 0.977 | 16.1 | 13.57 |
| MSBDN-RDFF [8] | 33.60 | 0.905 | 46.35 | 18.25 |
| DehazeFormer [16] | 34.85 | 0.988 | 25.44 | 16.81 |
| MixDehazeNet [33] | 35.16 | 0.906 | 12.42 | 12.56 |
| MS-PANet (Ours) | 39.32 | 0.993 | 52.8 | 21.28 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Li, C.; Duan, X.; Jiang, Z.; Ding, Y.; Li, Q.; Tang, Z.; Yang, F. MS-PANet: Multi-Scale Spatial Pyramid Attention for Effective Drainage Pipeline Image Dehazing. J. Imaging 2026, 12, 189. https://doi.org/10.3390/jimaging12050189
Li C, Duan X, Jiang Z, Ding Y, Li Q, Tang Z, Yang F. MS-PANet: Multi-Scale Spatial Pyramid Attention for Effective Drainage Pipeline Image Dehazing. Journal of Imaging. 2026; 12(5):189. https://doi.org/10.3390/jimaging12050189
Chicago/Turabian StyleLi, Ce, Xinyi Duan, Zhongbo Jiang, Yijing Ding, Quanzhi Li, Zhengyan Tang, and Feng Yang. 2026. "MS-PANet: Multi-Scale Spatial Pyramid Attention for Effective Drainage Pipeline Image Dehazing" Journal of Imaging 12, no. 5: 189. https://doi.org/10.3390/jimaging12050189
APA StyleLi, C., Duan, X., Jiang, Z., Ding, Y., Li, Q., Tang, Z., & Yang, F. (2026). MS-PANet: Multi-Scale Spatial Pyramid Attention for Effective Drainage Pipeline Image Dehazing. Journal of Imaging, 12(5), 189. https://doi.org/10.3390/jimaging12050189

