A Multi-Scale CNN-BiLSTM Framework with An Attention Mechanism for Interpretable Structural Damage Detection
Abstract
1. Introduction
- (1)
- A structural damage detection model combining CNN, BiLSTM, and the attention mechanism is proposed in this paper. Local time-frequency features are extracted by the CNN in this model, long-term dependencies in the time series are captured by the BiLSTM, and the ability to identify key damage features is enhanced by the attention mechanism. The strengths of each component are effectively combined by this integrated approach to improve damage detection accuracy.
- (2)
- To improve the model’s feature-capturing ability and enhance its interpretability, the attention layer is introduced. The feature domains emphasized by the model during the decision-making process can be intuitively grasped by researchers through the visualization of attention weights. Thus, the understanding of the decision-making mechanism is deepened.
- (3)
- The Focal Loss function is introduced to address the problems of sample imbalance and misclassification of confusing samples in structural damage detection. Based on the Cross-Entropy Loss, different weights are assigned to samples of various categories. The defined weight and adjustment factors, with default values and adaptable settings for specific working condition types, offer a practical mechanism for fine-tuning the model. Thus, the overall classification accuracy in structural damage detection is improved.
2. Methodology
2.1. CNN Unit
2.2. BiLSTM Unit
2.3. Attention Layer Unit
2.4. Loss Function Construction
3. Experimental Validation
3.1. Experimental Setup
3.2. Model Performance Comparison
3.3. Model Interpretability Analysis
3.4. Accelerated Fragment Length Experiment
3.5. Noise Experiment
3.6. Reasonableness Verification of Weight Factor
3.7. Model Efficiency Experiment
3.8. Five-Fold Cross-Validation Experiment
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Wang, D.-H.; Liao, W.-H. Wireless transmission for health monitoring of large structures. IEEE Trans. Instrum. Meas. 2006, 55, 972–981. [Google Scholar] [CrossRef]
- Wang, Z.; Huang, S.; Wang, S.; Zhuang, S.; Wang, Q.; Zhao, W. Compressed Sensing Method for Health Monitoring of Pipelines Based on Guided Wave Inspection. IEEE Trans. Instrum. Meas. 2020, 69, 4722–4731. [Google Scholar] [CrossRef]
- Zhou, Y.; Li, M.; Shi, Y.; Di, S.; Shi, X. Damage Identification Method of Tied-Arch Bridges Based on Equivalent Thrust-Influenced Line. Struct. Control Health Monit. 2024, 2024, 6896975. [Google Scholar] [CrossRef]
- Zhou, Y.; Shi, Y.; Di, S.; Lu, L.; Sun, W. Cable-stayed bridge model updating using a novel approach for deflection influence line identification: Theoretical basis and field validation. Int. J. Struct. Stab. Dyn. 2025, 2401669. [Google Scholar] [CrossRef]
- Pan, Y.; Ma, Y.; Dong, Y.; Gu, Z.; Wang, D. A Vision-Based Monitoring Method for the Looseness of High-Strength Bolt. IEEE Trans. Instrum. Meas. 2021, 70, 5013914. [Google Scholar] [CrossRef]
- Yan, R.; Gao, R.X. Hilbert–Huang Transform-Based Vibration Signal Analysis for Machine Health Monitoring. IEEE Trans. Instrum. Meas. 2006, 55, 2320–2329. [Google Scholar] [CrossRef]
- Wang, H.; Zhang, S.; Liu, B. Hybrid Physical-Data Driven Model for Denoising of Generator State Measurements. IEEE Trans. Instrum. Meas. 2025, 74, 2509912. [Google Scholar] [CrossRef]
- Wang, H.; Ouyang, Y. Adaptive Data Recovery Model for PMU Data Based on SDAE in Transient Stability Assessment. IEEE Trans. Instrum. Meas. 2022, 71, 2519611. [Google Scholar] [CrossRef]
- Ouyang, Y.; Wang, H. Adaptive denoising combined model with SDAE for transient stability assessment. Electr. Power Syst. Res. 2023, 214, 108948. [Google Scholar] [CrossRef]
- Azad, M.M.; Kim, H.S. Noise robust damage detection of laminated composites using multichannel wavelet-enhanced deep learning model. Eng. Struct. 2025, 322, 119192. [Google Scholar] [CrossRef]
- Li, X.; Yu, W.; Villegas, S. Structural Health Monitoring of Building Structures with Online Data Mining Methods. IEEE Syst. J. 2016, 10, 1291–1300. [Google Scholar] [CrossRef]
- Wang, H.; Hu, L.; Zhang, Y. SVM based imbalanced correction method for Power Systems Transient stability evaluation. ISA Trans. 2023, 136, 245–253. [Google Scholar] [CrossRef] [PubMed]
- Dang, H.V.; Tatipamula, M.; Nguyen, H.X. Cloud-Based Digital Twinning for Structural Health Monitoring Using Deep Learning. IEEE Trans. Ind. Inform. 2022, 18, 3820–3830. [Google Scholar] [CrossRef]
- Xing, F.; Yan, Z.; Ding, X. Vibration-Based Structural Health Monitoring via Phase-Based Motion Estimation Using Deep Residual Networks. IEEE Trans. Ind. Inform. 2024, 20, 4473–4480. [Google Scholar] [CrossRef]
- Ye, Q.; Liu, C. A Multichannel Data Fusion Method Based on Multiple Deep Belief Networks for Intelligent Fault Diagnosis of Main Reducer. Symmetry 2020, 12, 483. [Google Scholar] [CrossRef]
- Cheng, L.; Lu, J.; Li, S.; Ding, R.; Xu, K.; Li, X. Fusion Method and Application of Several Source Vibration Fault Signal Spatio-Temporal Multi-Correlation. Appl. Sci. 2021, 11, 4318. [Google Scholar] [CrossRef]
- Wang, H.; Li, S.; Song, L.; Cui, L. A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals. Comput. Ind. 2019, 105, 182–190. [Google Scholar] [CrossRef]
- Qing, X.; Liao, Y.; Wang, Y.; Chen, B.; Zhang, F.; Wang, Y. Machine Learning Based Quantitative Damage Monitoring of Composite Structure. Int. J. Smart Nano Mater. 2022, 13, 167–202. [Google Scholar] [CrossRef]
- Oh, B.K.; Kim, J. Multi-Objective Optimization Method to Search for the Optimal Convolutional Neural Network Architecture for Long-Term Structural Health Monitoring. IEEE Access 2021, 9, 44738–44750. [Google Scholar] [CrossRef]
- Azad, M.M.; Kim, H.S. Hybrid deep convolutional networks for the autonomous damage diagnosis of laminated composite structures. Compos. Struct. 2024, 329, 117792. [Google Scholar] [CrossRef]
- Chen, Q.; Wang, H. Time-adaptive transient stability assessment based on gated recurrent unit. Int. J. Electr. Power Energy Syst. 2021, 133, 107156. [Google Scholar] [CrossRef]
- Ravikumar, K.; Yadav, A.; Kumar, H.; Gangadharan, K.; Narasimhadhan, A. Gearbox fault diagnosis based on Multi-Scale deep residual learning and stacked LSTM model. Measurement 2021, 186, 110099. [Google Scholar] [CrossRef]
- Sabah, R.; Lam, M.C.; Qamar, F.; Zaidan, B.B. A BiLSTM-Based Feature Fusion with CNN Model: Integrating Smartphone Sensor Data for Pedestrian Activity Recognition. IEEE Access 2024, 12, 142957–142978. [Google Scholar] [CrossRef]
- Chen, Q.; Lin, N.; Bu, S.; Wang, H.; Zhang, B. Interpretable Time-Adaptive Transient Stability Assessment Based on Dual-Stage Attention Mechanism. IEEE Trans. Power Syst. 2023, 38, 2776–2790. [Google Scholar] [CrossRef]
- Song, C.H.; Han, H.J.; Avrithis, Y. All the attention you need: Global-local, spatial-channel attention for image retrieval. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, 3–8 January 2022; pp. 439–448. [Google Scholar] [CrossRef]
- Wang, H.; Gao, F.; Chen, Q.; Bu, S.; Lei, C. Instability Pattern-Guided Model Updating Method for Data-Driven Transient Stability Assessment. IEEE Trans. Power Syst. 2024, 40, 1214–1227. [Google Scholar] [CrossRef]
- Azad, M.M.; Kim, H.S. An explainable artificial intelligence-based approach for reliable damage detection in polymer composite structures using deep learning. Polym. Compos. 2025, 46, 1536–1551. [Google Scholar] [CrossRef]
- Wang, H.; Wu, S. Transient Stability Assessment with Time-Adaptive Method Based on Spatial Distribution. Int. J. Electr. Power Energy Syst. 2022, 143, 108464. [Google Scholar] [CrossRef]
- Hu, Y.; Wang, H.; Zhang, Y.; Wen, B. Frequency prediction model combining ISFR model and LSTM network. Int. J. Electr. Power Energy Syst. 2022, 139, 108001. [Google Scholar] [CrossRef]
- Chen, Q.; Wang, H.; Lin, N. Imbalance correction method based on ratio of loss function values for transient stability assessment. CSEE J. Power Energy Syst. 2022, 1–12. [Google Scholar] [CrossRef]
- Wang, H.; Wang, Q. Adaptive cost-sensitive assignment method for power system transient stability assessment. Int. J. Electr. Power Energy Syst. 2022, 135, 107574. [Google Scholar] [CrossRef]
Parameter | Beam | Column | Diagonal Brace |
---|---|---|---|
Section size/mm | 25 × 25 × 2.5 | 25 × 25 × 2.5 | 260 × 30 × 5/250 × 30 × 5 |
Area of section/m2 | 225 × 10−6 | 225 × 10−6 | 150 × 10−6 |
Young’s modulus/E/Pa | 22,454 | 22,454 | 22,454 |
Volume density /ρ/kg·m−3 | 7850 | 7850 | 7850 |
Condition Number | Damage Unit | Damage Degree | Sinusoidal Input |
---|---|---|---|
0 | / | Lossless brace | F = 50 N, w = 50 Hz. F = 50 N, w = 100 Hz. F = 100 N, w = 50 Hz. F = 100 N, w = 100 Hz. |
1 | 4#1brace | Class 1 diagonal brace | |
2 | 4#1brace | Class 2 diagonal brace | |
3 | 3#2brace | Class 1 diagonal brace | |
4 | 3#2brace | Class 2 diagonal brace | |
5 | 2#5brace | Class 1 diagonal brace | |
6 | 2#5brace | Class 2 diagonal brace | |
7 | 4#1 brace, 2#5brace | Class 1 diagonal brace | |
8 | 4#1brace, 2#5brace | Class 2 diagonal brace | |
9 | 3#1brace, 3#3brace | Class 1 diagonal brace | |
10 | 3#1brace, 3#3brace | Class 2 diagonal brace | |
11 | 3#1brace, 3#3brace, 2#1brace | Class 1 diagonal brace | |
12 | 3#1brace, 3#3brace, 2#1brace | Class 2 diagonal brace |
Model | Accuracy/% | ||||
---|---|---|---|---|---|
F = 50 N, w = 50 Hz | F = 50 N, w = 100 Hz | F = 100 N, w = 50 Hz | F = 100 N, w = 100 Hz | Mixed Stress Condition | |
CNN-BiLSTM-At | 98.46 | 99.01 | 98.54 | 99.00 | 96.40 |
BiLSTM-At | 98.69 | 98.69 | 98.23 | 98.69 | 95.87 |
LSTM-At | 97.85 | 97.93 | 98.00 | 98.08 | 93.56 |
CNN-At | 94.42 | 93.15 | 94.85 | 95.31 | 91.86 |
LSTM | 97.46 | 97.65 | 97.46 | 98.44 | 92.77 |
CNN | 89.31 | 92.85 | 90.38 | 94.38 | 90.27 |
Model | Recall/% | ||||
---|---|---|---|---|---|
F = 50 N, w = 50 Hz | F = 50 N, w = 100 Hz | F = 100 N, w = 50 Hz | F = 100 N, w = 100 Hz | Mixed Stress Condition | |
CNN-BiLSTM-At | 98.61 | 99.12 | 98.71 | 99.01 | 96.71 |
BiLSTM-At | 98.51 | 98.82 | 98.41 | 98.73 | 96.12 |
LSTM-At | 97.51 | 97.73 | 97.80 | 97.90 | 93.81 |
CNN-At | 94.31 | 93.40 | 94.50 | 95.03 | 92.11 |
LSTM | 97.24 | 97.83 | 97.22 | 98.20 | 93.01 |
CNN | 89.52 | 92.61 | 90.17 | 94.16 | 90.15 |
Model | F1 Score/% | ||||
---|---|---|---|---|---|
F = 50 N, w = 50 Hz | F = 50 N, w = 100 Hz | F = 100 N, w = 50 Hz | F = 100 N, w = 100 Hz | Mixed Stress Condition | |
CNN-BiLSTM-At | 98.53 | 99.06 | 98.62 | 99.01 | 96.55 |
BiLSTM-At | 98.60 | 98.75 | 98.32 | 98.71 | 95.99 |
LSTM-At | 97.68 | 97.83 | 97.90 | 98.00 | 93.68 |
CNN-At | 94.37 | 93.28 | 94.68 | 95.17 | 91.98 |
LSTM | 97.35 | 97.74 | 97.34 | 98.32 | 92.89 |
CNN | 89.41 | 92.73 | 90.27 | 94.27 | 90.21 |
Performances | Accuracy/Recall/F1 score/% | ||||
---|---|---|---|---|---|
Lengths = 5 | Lengths = 10 | Lengths = 15 | Lengths = 20 | Lengths = 25 | |
Accuracy/% | 96.71 | 97.91 | 98.65 | 99.23 | 99.78 |
Recall/% | 96.67 | 97.67 | 98.77 | 99.17 | 99.61 |
F1 score/% | 96.69 | 97.79 | 98.71 | 99.20 | 99.69 |
Performances | Different Weighting Factor | |||
---|---|---|---|---|
F = 50 N, w = 50 Hz | F = 50 N, w = 100 Hz | F = 100 N, w = 50 Hz | F = 100 N, w = 100 Hz | |
Accuracy/% | 100.00 | 100.00 | 100.00 | 100.00 |
Recall/% | 100.00 | 100.00 | 100.00 | 100.00 |
F1 score/% | 100.00 | 100.00 | 100.00 | 100.00 |
Model | Accuracy/% | ||
---|---|---|---|
30 dB | 20 dB | 10 dB | |
CNN-BiLSTM-At | 96.40 | 94.01 | 91.54 |
BiLSTM-At | 95.87 | 92.69 | 89.23 |
LSTM-At | 93.56 | 91.93 | 88.11 |
CNN-At | 91.86 | 90.15 | 86.85 |
LSTM | 92.77 | 90.05 | 84.46 |
CNN | 90.27 | 88.85 | 81.18 |
Performances | Different Weighting Factor | ||||
---|---|---|---|---|---|
= 1 | = 5 | = 10 | = 11 | = 15 | |
Accuracy/% | 95.91 | 96.21 | 96.40 | 96.32 | 96.14 |
Recall/% | 95.88 | 96.31 | 96.51 | 96.41 | 96.02 |
F1 score/% | 95.89 | 96.26 | 96.46 | 96.37 | 96.08 |
Model | Model Efficiency | |
---|---|---|
Training Time/s/Epoch | Evaluation Time/ms | |
CNN-BiLSTM-At | 3.12 | 1.2 |
BiLSTM | 2.67 | 1.6 |
CNN | 2.57 | 1.5 |
Fold | Accuracy/% | Recall/% | F1 Score/% | Loss |
---|---|---|---|---|
1 | 96.40 | 96.13 | 96.26 | 0.124 |
2 | 96.34 | 96.51 | 96.42 | 0.131 |
3 | 96.41 | 96.73 | 96.57 | 0.127 |
4 | 96.37 | 96.70 | 96.53 | 0.104 |
5 | 96.46 | 96.67 | 96.56 | 0.114 |
Mean | 96.40 | 96.55 | 96.47 | 0.120 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wu, S.; Liu, J. A Multi-Scale CNN-BiLSTM Framework with An Attention Mechanism for Interpretable Structural Damage Detection. Infrastructures 2025, 10, 82. https://doi.org/10.3390/infrastructures10040082
Wu S, Liu J. A Multi-Scale CNN-BiLSTM Framework with An Attention Mechanism for Interpretable Structural Damage Detection. Infrastructures. 2025; 10(4):82. https://doi.org/10.3390/infrastructures10040082
Chicago/Turabian StyleWu, Shengping, and Jingliang Liu. 2025. "A Multi-Scale CNN-BiLSTM Framework with An Attention Mechanism for Interpretable Structural Damage Detection" Infrastructures 10, no. 4: 82. https://doi.org/10.3390/infrastructures10040082
APA StyleWu, S., & Liu, J. (2025). A Multi-Scale CNN-BiLSTM Framework with An Attention Mechanism for Interpretable Structural Damage Detection. Infrastructures, 10(4), 82. https://doi.org/10.3390/infrastructures10040082