Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism
Abstract
1. Introduction
2. Base Model and Proposed Model
2.1. Base Model
2.2. Proposed Model
3. Dataset Description and Performance Metrics
3.1. Dataset Description and Processing
3.2. Experimental Environment and Performance Metrics
4. Results and Analysis
4.1. Results of the Ablation Experiments
4.2. Algorithmic Analysis and Comparison
5. Conclusions
6. Discussion and Future Works
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| ML | Machine Learning |
| ANN | Artificial Neural Network |
| SVM | Support Vector Machine |
| CRT | Classification Regression Tree |
| DSC | Dynamic Snake Convolution |
| CBAM | Channel Spatial Attention Mechanism |
| DCNN | Deep Convolutional Neural Network |
| BiFPN | Bidirectional Feature Pyramid Network |
| ADSC-U-Net | Attention-Dynamic Snake Convolution U-Net |
| DSC-U-Net | Dynamic Snake Convolution U-Net |
| Att-U-Net | Attention U-Net |
References
- Shi, Y.; Xiang, Y.; Xiao, H.; Xing, L. Joint optimization of budget allocation and maintenance planning of multi-facility transportation infrastructure systems. Eur. J. Oper. Res. 2021, 288, 382–393. [Google Scholar] [CrossRef] [Scilit]
- Nguyen, S.D.; Tran, T.S.; Tran, V.P.; Lee, H.J.; Piran, M.J.; Le, V.P. Deep learning-based crack detection: A survey. Int. J. Pavement Res. Technol. 2023, 16, 943–967. [Google Scholar] [CrossRef] [Scilit]
- Oliveira, H.; Correia, P.L. Automatic road crack segmentation using entropy and image dynamic thresholding. In Proceedings of the 2009 17th European Signal Processing Conference (EUSIPCO), Glasgow, UK, 24–28 August 2009; pp. 622–626. [Google Scholar]
- Kamaliardakani, M.; Sun, L.; Ardakani, M.K. Sealed-crack detection algorithm using heuristic thresholding approach. J. Comput. Civ. Eng. 2015, 30, 04014110. [Google Scholar] [CrossRef] [Scilit]
- Sun, L.; Qian, Z. Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification. Measurement 2016, 86, 26–40. [Google Scholar] [CrossRef] [Scilit]
- Hoang, N.D. An Artificial Intelligence Method for Asphalt Pavement Pothole Detection Using Least Squares Support Vector Machine and Neural Network with Steerable Filter-Based Feature Extraction. Adv. Civ. Eng. 2018, 2018, 7419058. [Google Scholar] [CrossRef] [Scilit]
- Kyriakou, C.; Christodoulou, S.E.; Dimitriou, L. Smartphone-based pothole detection utilizing artificial neural networks. J. Infrastruct. Syst. 2019, 25, 04019019. [Google Scholar] [CrossRef] [Scilit]
- Huyan, J.; Li, W.; Tighe, S.; Xu, Z.; Zhai, J. CrackU-net: A novel deep convolutional neural network for pixelwise pavement crack detection. Struct. Control Health Monit. 2020, 27, e2551. [Google Scholar] [CrossRef] [Scilit]
- Zhao, L.; Wu, Y. Research progress of surface defect detection methods based on machine vision. Chin. J. Sci. Instrum. 2023, 43, 198–219. [Google Scholar] [CrossRef]
- Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the Medical image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, 5–9 October 2015; pp. 234–241. [Google Scholar] [CrossRef] [Scilit]
- Qi, Y.; He, Y.; Qi, X.; Zhang, Y.; Yang, G. Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 2–6 October 2023; pp. 6070–6079. [Google Scholar] [CrossRef] [Scilit]
- Woo, S.; Park, J.; Lee, J.Y.; Kweon, I.S. Cbam: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Gemany, 8–14 September 2018; pp. 3–19. [Google Scholar] [CrossRef] [Scilit]
- Cha, Y.J.; Choi, W.; Büyüköztürk, O. Deep learning-based crack damage detection using convolutional neural networks. Comput.-Aided Civ. Infrastruct. Eng. 2017, 32, 361–378. [Google Scholar] [CrossRef] [Scilit]
- Ai, D.; Jiang, G.; Lam, S.K.; He, P.; Li, C. Computer vision framework for crack detection of civil infrastructure—A review. Eng. Appl. Artif. Intell. 2023, 117, 105478. [Google Scholar] [CrossRef] [Scilit]
- Cao, W.; Liu, Q.; He, Z. Review of pavement defect detection methods. IEEE Access 2020, 8, 14531–14544. [Google Scholar] [CrossRef] [Scilit]
- Zhou, S.; Song, W. Deep learning-based roadway crack classification using laser-scanned range images: A comparative study on hyperparameter selection. Autom. Constr. 2020, 114, 103171. [Google Scholar] [CrossRef] [Scilit]
- Fan, R.; Bocus, M.J.; Zhu, Y.; Jiao, J.; Wang, L.; Ma, F.; Cheng, S.; Liu, M. Road crack detection using deep convolutional neural network and adaptive thresholding. In Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France, 9–12 June 2019; pp. 474–479. [Google Scholar] [CrossRef] [Scilit]
- Xu, H.; Su, X.; Wang, Y.; Cai, H.; Cui, K.; Chen, X. Automatic bridge crack detection using a convolutional neural network. Appl. Sci. 2019, 9, 2867. [Google Scholar] [CrossRef] [Scilit]
- Majidifard, H.; Adu-Gyamfi, Y.; Buttlar, W.G. Deep machine learning approach to develop a new asphalt pavement condition index. Constr. Build. Mater. 2020, 247, 118513. [Google Scholar] [CrossRef] [Scilit]
- Zhu, J.; Zhong, J.; Ma, T.; Huang, X.; Zhang, W.; Zhou, Y. Pavement distress detection using convolutional neural networks with images captured via UAV. Autom. Constr. 2022, 133, 103991. [Google Scholar] [CrossRef] [Scilit]
- Du, F.J.; Jiao, S.J. Improvement of lightweight convolutional neural network model based on YOLO algorithm and its research in pavement defect detection. Sensors 2022, 22, 3537. [Google Scholar] [CrossRef] [Scilit]
- Feng, X.; Xiao, L.; Li, W.; Pei, L.; Sun, Z.; Ma, Z.; Shen, H.; Ju, H. Pavement crack detection and segmentation method based on improved deep learning fusion model. Math. Probl. Eng. 2020, 2020, 8515213. [Google Scholar] [CrossRef] [Scilit]
- Liu, J.; Yang, X.; Lau, S.; Wang, X.; Luo, S.; Lee, V.C.S.; Ding, L. Automated pavement crack detection and segmentation based on two-step convolutional neural network. Comput.-Aided Civ. Infrastruct. Eng. 2020, 35, 1291–1305. [Google Scholar] [CrossRef] [Scilit]
- Huyan, J.; Ma, T.; Li, W.; Yang, H.; Xu, Z. Pixelwise asphalt concrete pavement crack detection via deep learning-based semantic segmentation method. Struct. Control Health Monit. 2022, 29, e2974. [Google Scholar] [CrossRef] [Scilit]
- Yuan, G.; Li, J.; Meng, X.; Li, Y. CurSeg: A pavement crack detector based on a deep hierarchical feature learning segmentation framework. IET Intell. Transp. Syst. 2022, 16, 782–799. [Google Scholar] [CrossRef] [Scilit]
- Li, C.; Fan, Z.; Chen, Y.; Lin, H.; Loprencipe, G.; Sheng, W.; Wang, K. CrackCLF: Automatic pavement crack detection based on closed-loop feedback. IEEE Trans. Intell. Transp. Syst. 2023, 25, 5965–5980. [Google Scholar] [CrossRef] [Scilit]
- Dai, J.; Qi, H.; Xiong, Y.; Li, Y.; Zhang, G.; Hu, H.; Wei, Y. Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 764–773. [Google Scholar] [CrossRef] [Scilit]
- Chen, Y.; Dai, X.; Liu, M.; Chen, D.; Yuan, L.; Liu, Z. Dynamic convolution: Attention over convolution kernels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 13–16 June 2020; pp. 11030–11039. [Google Scholar] [CrossRef] [Scilit]
- Zhang, L.; Yang, F.; Zhang, Y.D.; Zhu, Y.J. Road crack detection using deep convolutional neural network. In Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, 25–28 September 2016; pp. 3708–3712. [Google Scholar] [CrossRef] [Scilit]
- Shi, Y.; Cui, L.; Qi, Z.; Meng, F.; Chen, Z. Automatic road crack detection using random structured forests. IEEE Trans. Intell. Transp. Syst. 2016, 17, 3434–3445. [Google Scholar] [CrossRef] [Scilit]
- Badrinarayanan, V.; Kendall, A.; Cipolla, R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 2481–2495. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chen, L.C.; Papandreou, G.; Kokkinos, I.; Murphy, K.; Yuille, A.L. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 40, 834–848. [Google Scholar] [CrossRef] [Scilit]
- Liu, Y.; Yao, J.; Lu, X.; Xie, R.; Li, L. DeepCrack: A deep hierarchical feature learning architecture for crack segmentation. Neurocomputing 2019, 338, 139–153. [Google Scholar] [CrossRef] [Scilit]









| Network Layer | Network Module | Number of Downsampled Channels | Number of Upsampled Channels |
|---|---|---|---|
| First layer | Standard convolution | 64 | 64 |
| Second layer | CBAM + DSC | 192 | 192 |
| Third layer | CBAM + DSC | 384 | 384 |
| Forth layer | CBAM + DSC | 786 | 786 |
| Fifth layer | DSC | 1536 | 1536 |
| Model | CBAM | DSC | Precision (%) | Recall (%) | F1-Score (%) |
|---|---|---|---|---|---|
| Experiment 1 | - | - | 75.66 | 60.45 | 64.21 |
| Experiment 2 | √ | - | 75.32 | 65.84 | 68.19 |
| Experiment 3 | - | √ | 75.78 | 65.94 | 68.24 |
| Experiment 4 | √ | √ | 74.44 | 68.77 | 69.42 |
| Model | Precision (%) | Recall (%) | F1-Score (%) |
|---|---|---|---|
| U-Net | 75.66 | 60.45 | 64.21 |
| ADSC-U-Net | 74.44 | 68.77 | 69.42 |
| SegNet | 72.54 | 60.76 | 63.69 |
| DeepLab | 71.95 | 64.07 | 65.40 |
| DeepCrack | 62.80 | 9.19 | 13.55 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Niu, Y.; Fan, S.; Cheng, X.; Yao, X.; Wang, Z.; Zhou, J. Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism. Appl. Sci. 2024, 14, 8100. https://doi.org/10.3390/app14188100
Niu Y, Fan S, Cheng X, Yao X, Wang Z, Zhou J. Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism. Applied Sciences. 2024; 14(18):8100. https://doi.org/10.3390/app14188100
Chicago/Turabian StyleNiu, Yani, Songhua Fan, Xin Cheng, Xinpeng Yao, Zijian Wang, and Jingmei Zhou. 2024. "Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism" Applied Sciences 14, no. 18: 8100. https://doi.org/10.3390/app14188100
APA StyleNiu, Y., Fan, S., Cheng, X., Yao, X., Wang, Z., & Zhou, J. (2024). Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism. Applied Sciences, 14(18), 8100. https://doi.org/10.3390/app14188100

