Corrosion State Monitoring Based on Multi-Granularity Synergistic Learning of Acoustic Emission and Electrochemical Noise Signals
Abstract
1. Introduction
- (1)
- A new deep learning framework, named CorroNet, for corrosion monitoring is proposed. It achieves multi-granularity synergistic learning between AE and EN signals at the model learning level;
- (2)
- A feature alignment method for corrosion events and a probability distribution alignment loss function are designed for CorroNet to significantly improve the performance in the corrosion monitoring task.
2. Methods
2.1. The Overview of the CorroNet
- (1)
- Most importantly, to achieve multi-granularity synergistic learning, a feature alignment loss and a probability distribution consistency loss are designed. After the Transformer encoders pass and in the two branches, projection heads and (represented in orange and blue, respectively) are introduced to align the representations and of the two modalities in feature space. Additionally, supervised contrastive learning is applied to the EN data using a second projection head (green) after the EN Transformer encoder with the loss function ;
- (2)
- Secondly, since AE signals serve as anchor points to optimize the feature mapping of EN signals, a classification head is connected after the Transformer encoder . It is used to initially train the model for accurate AE classification, for more precise anchor points in the feature space, and for the subsequent optimization of EN signals’ mapping. Similarly, a classification head is connected after the EN branch’s Transformer encoder ;
- (3)
- Additionally, due to the multi-granularity feature learning, the complex multi-level feature alignment and loss constraints make precise training and pre-training even more essential. Therefore, a specific training strategy is proposed for CorroNet, dividing the training process into three stages. The details can be found in Section 2.4.
2.2. The Transformer Encoder
2.3. The AE-EN Alignment Framework
2.4. Model Training and Optimization
- (1)
- Stage 1 Parameter Optimization:
- (2)
- Stage 2 Parameter Optimization:
- (3)
- Stage 3 Parameter Optimization:
Algorithm 1: Training and Inference Procedure of CorroNet |
Input: Training sample sets consist of the paired AE-EN dataset and the unpaired EN dataset . Testing sample sets consist of the EN data. Output: The predicted corrosion stage label for the sample from the testing set. |
Initialize randomly the network weight , and . Set the number of iterations for each stage as , , and . Training: for do: # Stage 1 training process Frozen . obtain AE data and labels . Calculate by solving Equation (5). Update by solving Equations (7) and (8). end for. for do: # Stage 2 training process for obtain a batch of paired AE-EN data from do: Frozen . Calculate by solving Equations (1) and (3). Update by solving Equations (9)–(12). end for. for obtain a batch of EN data do: Frozen . Calculate by solving Equation (4). Update by solving Equations (13) and (14). end for. for do: # Stage 3 training process for obtain a batch of EN data do: Frozen . Calculate by solving Equation (6). Update by solving Equations (15) and (16). end for. Inference: Obtain a test sample Calculate the predicted label . Provide the model’s predicted result for the corresponding corrosion stage of the sample. |
2.5. Evaluation Metrics
2.6. Experimental Setup and Data Description
3. Results and Discussion
3.1. Comparison of Corrosion Monitoring Performance
3.2. Ablation Experiments
4. Conclusions
- (1)
- CorroNet pioneers the integration of multi-scale learning from both AE and EN signals, effectively capturing the intricate characteristics of corrosion evolution at different stages. By combining the complementary strengths of these two signals, CorroNet offers a comprehensive approach to corrosion monitoring;
- (2)
- To further improve the model’s performance, CorroNet incorporates an adaptive learning mechanism that dynamically adjusts to the complexities of corrosion data. This mechanism not only optimizes feature extraction but also allows for more reliable detection of early-stage corrosion, which is often difficult to identify with traditional monitoring methods;
- (3)
- A comprehensive metal corrosion monitoring task was conducted to validate CorroNet’s real-world applicability. The results highlight its superior performance in predicting various corrosion stages. Ablation studies further underscore the significance of the key model components in achieving this performance.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
AE | Acoustic emission |
EN | Electrochemical noise |
CNN | Convolutional neural network |
LSTM | Long short-term memory network |
PEM | Proton exchange membrane |
CNN-TL | Transfer learning method based on convolutional neural networks |
HDR | Hydrogen defect recognition |
SOTA | State of the art |
MLP | Multi-layer perceptron |
InfoNCE | Information noise-contrastive estimation |
KL | Kullback–Leibler divergence |
CN | Cross-entropy |
SCL | Supervised contrastive learning |
FAL | Feature alignment learning |
DAL | Distribution alignment learning |
Ave. Acc. | Average Accuracy |
Appendix A
Appendix A.1. The Transformer Encoder
Appendix A.2. Details of Data Collection
Appendix A.3. Detailed Results for Different Data Split Ratios
Ave. Acc. | Macro-F1 | C1 | C2 | C3 | ||||
---|---|---|---|---|---|---|---|---|
Acc. | F1 | Acc. | F1 | Acc. | F1 | |||
5:5 | 0.9606 | 0.9605 | 0.8971 | 0.9425 | 0.9899 | 0.9480 | 0.9949 | 0.9910 |
6:4 | 0.9679 | 0.9654 | 0.9095 | 0.9473 | 0.9899 | 0.9661 | 0.9849 | 0.9830 |
7:3 | 0.9686 | 0.9645 | 0.9273 | 0.9477 | 0.9699 | 0.9639 | 0.9849 | 0.9820 |
8:2 | 0.9701 | 0.9701 | 0.9203 | 0.9549 | 0.9928 | 0.9600 | 0.9973 | 0.9953 |
9:1 | 0.9781 | 0.9513 | 0.9028 | 0.8930 | 0.9625 | 0.9677 | 0.9949 | 0.9932 |
References
- Khalaf, A.H.; Xiao, Y.; Xu, N.; Wu, B.; Li, H.; Lin, B.; Nie, Z.; Tang, J. Emerging AI technologies for corrosion monitoring in oil and gas industry: A comprehensive review. Eng. Fail. Anal. 2024, 155, 107735. [Google Scholar] [CrossRef]
- Shao, X.; Cai, B.; Ahmed, S.; Zhou, X.; Hu, Z.; Sui, Z.; Liu, X. Towards proactive corrosion management: A predictive modeling approach in pipeline industrial applications. Process Saf. Environ. Prot. 2024, 190, 1471–1480. [Google Scholar] [CrossRef]
- Wu, X.; Han, E.-H. Acoustic emission during pitting corrosion of 304 stainless steel. Corros. Sci. 2011, 53, 1537–1546. [Google Scholar]
- Wu, K.; Byeon, J.-W. Morphological estimation of pitting corrosion on vertically positioned 304 stainless steel using acoustic-emission duration parameter. Corros. Sci. 2019, 148, 331–337. [Google Scholar] [CrossRef]
- Wu, K.; Jung, W.-S.; Byeon, J.-W. In-situ monitoring of pitting corrosion on vertically positioned 304 stainless steel by analyzing acoustic-emission energy parameter. Corros. Sci. 2016, 105, 8–16. [Google Scholar] [CrossRef]
- Cottis, R. Simulation of electrochemical noise due to metastable pitting. J. Corr. Sci. Eng. 2000, 3. Available online: https://www.jcse.org/viewPaper/ID/42/QIgtNHePZr4acRFOy9UMYZd36DXHAj (accessed on 2 November 2020).
- Homborg, A.; Tinga, T.; van Westing, E.; Zhang, X.; Ferrari, G.; de Wit, J.; Mol, J. A critical appraisal of the interpretation of electrochemical noise for corrosion studies. Corrosion 2014, 70, 971–987. [Google Scholar] [CrossRef] [PubMed]
- Denissen, P.J.; Homborg, A.M.; Garcia, S.J. Interpreting electrochemical noise and monitoring local corrosion by means of highly resolved spatiotemporal real-time optics. J. Electrochem. Soc. 2019, 166, C3275. [Google Scholar] [CrossRef]
- Homborg, A.; Olgiati, M.; Denissen, P.; Garcia, S. An integral non-intrusive electrochemical and in-situ optical technique for the study of the effectiveness of corrosion inhibition. Electrochim. Acta 2022, 403, 139619. [Google Scholar] [CrossRef]
- Xia, D.-H.; Ji, Y.; Zhang, R.; Mao, Y.; Behnamian, Y.; Hu, W.; Birbilis, N. On the localized corrosion of AA5083 in a simulated dynamic seawater/air interface—Part 1: Corrosion initiation mechanism. Corros. Sci. 2023, 213, 110985. [Google Scholar] [CrossRef]
- Recio-Hernández, J.A.; Landa, A.E.; Miguel, G.F.S.; Mejía-Sánchez, E.; Huerta, F.L.; Cruz, R.O.; Martínez, R.G. Electrochemical noise study of the passivation of AISI 1018 carbon steel as reinforcements embedded in ternary concretes during the setting process. ECS Trans. 2023, 110, 159. [Google Scholar] [CrossRef]
- Recio-Hernández, J.A.; Landa, A.E.; Miguel, G.F.S.; Mejía-Sánchez, E.; Huerta, F.L.; Cruz, R.O.; Martínez, R.G. Electrochemical noise of SCC inhibition of a supermartensitic stainless steel in sour solution. ECS Trans. 2023, 110, 29. [Google Scholar] [CrossRef]
- Homborg, A.; Mol, A.; Tinga, T. Corrosion classification through deep learning of electrochemical noise time-frequency transient information. Eng. Appl. Artif. Intell. 2024, 133, 108044. [Google Scholar] [CrossRef]
- Rubio, M.; Sanchez, D.; Gazdzicki, P.; Friedrich, K.; Urquia, A. Failure mode diagnosis in proton exchange membrane fuel cells using local electrochemical noise. J. Power Sources 2022, 541, 231582. [Google Scholar] [CrossRef]
- Guo, F.; Li, W.; Jiang, P.; Chen, F.; Liu, Y. Deep learning approach for damage classification based on acoustic emission data in composite materials. Materials 2022, 15, 4270. [Google Scholar] [CrossRef]
- Liu, P.; Xu, C.; Xie, J.; Fu, M.; Chen, Y.; Liu, Z.; Zhang, Z. A CNN-based transfer learning method for leakage detection of pipeline under multiple working conditions with AE signals. Process Saf. Environ. Prot. 2023, 170, 1161–1172. [Google Scholar] [CrossRef]
- Qiu, F.; Shen, Z.; Bai, Y.; Shan, G.; Qu, D.; Chen, W. Hydrogen defect acoustic emission recognition by deep learning neural network. Int. J. Hydrog. Energy 2024, 54, 878–893. [Google Scholar] [CrossRef]
- Zhang, Z.; Zhao, Z.; Bai, P.; Li, X.; Liu, B.; Tan, J.; Wu, X. In-situ monitoring of pitting corrosion of AZ31 magnesium alloy by combining electrochemical noise and acoustic emission techniques. J. Alloys Compd. 2021, 878, 160334. [Google Scholar] [CrossRef]
- Kawasaki, Y.; Fukui, S.; Fukuyama, T. Phenomenological process of rebar corrosion in reinforced concrete evaluated by acoustic emission and electrochemical noise. Constr. Build. Mater. 2022, 352, 128829. [Google Scholar] [CrossRef]
- Kovac, J.; Alaux, C.; Marrow, T.J.; Govekar, E.; Legat, A. Correlations of electrochemical noise, acoustic emission and complementary monitoring techniques during intergranular stress-corrosion cracking of austenitic stainless steel. Corros. Sci. 2010, 52, 2015–2025. [Google Scholar] [CrossRef]
- Calabrese, L.; Bonaccorsi, L.; Galeano, M.; Proverbio, E.; Di Pietro, D.; Cappuccini, F. Identification of damage evolution during SCC on 17-4 PH stainless steel by combining electrochemical noise and acoustic emission techniques. Corros. Sci. 2015, 98, 573–584. [Google Scholar] [CrossRef]
- Kietov, V.; Mandel, M.; Krüger, L. Combination of electrochemical noise and acoustic emission for analysis of the pitting corrosion behavior of an austenitic stainless cast steel. Adv. Eng. Mater. 2019, 21, 1800682. [Google Scholar] [CrossRef]
- Radford, A.; Kim, J.W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, Virtual, 18–24 July 2021. [Google Scholar]
- Jia, C.; Yang, Y.; Xia, Y.; Chen, Y.-T.; Parekh, Z.; Pham, H.; Le, Q.V.; Sung, Y.-H.; Li, Z.; Duerig, T. Scaling up visual and vision-language representation learning with noisy text supervision. In Proceedings of the International Conference on Machine Learning, Virtual, 18–24 July 2021. [Google Scholar]
- Yang, Y.; Pan, L.; Liu, L. Event camera data pre-training. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 1–6 October 2023. [Google Scholar]
- Van Den Oord, A.; Vinyals, O. Neural discrete representation learning. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017; Volume 30. [Google Scholar]
- Girdhar, R.; El-Nouby, A.; Liu, Z.; Singh, M.; Alwala, K.V.; Joulin, A.; Misra, I. Imagebind: One embedding space to bind them all. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023. [Google Scholar]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017; Volume 30. [Google Scholar]
- Zhou, K.; Tong, Y.; Li, X.; Wei, X.; Huang, H.; Song, K.; Chen, X. Exploring global attention mechanism on fault detection and diagnosis for complex engineering processes. Process Saf. Environ. Prot. 2023, 170, 660–669. [Google Scholar] [CrossRef]
- Huang, H.; Wang, R.; Zhou, K.; Ning, L.; Song, K. CausalViT: Domain generalization for chemical engineering process fault detection and diagnosis. Process Saf. Environ. Prot. 2023, 176, 155–165. [Google Scholar] [CrossRef]
- Zhou, K.; Wang, R.; Tong, Y.; Wei, X.; Song, K.; Chen, X. Domain generalization of chemical process fault diagnosis by maximizing domain feature distribution alignment. Process Saf. Environ. Prot. 2024, 185, 817–830. [Google Scholar] [CrossRef]
- Bi, X.; Wu, D.; Xie, D.; Ye, H.; Zhao, J. Large-scale chemical process causal discovery from big data with transformer-based deep learning. Process Saf. Environ. Prot. 2023, 173, 163–177. [Google Scholar] [CrossRef]
- van den Oord, A.; Li, Y.; Vinyals, O. Representation learning with contrastive predictive coding. arXiv 2018, arXiv:1807.03748. [Google Scholar]
- Chen, X.; Xie, S.; He, K. An empirical study of training self-supervised vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10–17 October 2021. [Google Scholar]
- Hou, Y.; Aldrich, C.; Lepkova, K.; Machuca, L.; Kinsella, B. Analysis of electrochemical noise data by use of recurrence quantification analysis and machine learning methods. Electrochim. Acta 2017, 256, 337–347. [Google Scholar] [CrossRef]
- Calabrese, L.; Galeano, M.; Proverbio, E.; Di Pietro, D.; Donato, A. Topological neural network of combined AE and EN signals for assessment of SCC damage. Nondestruct. Test. Eval. 2019, 35, 98–119. [Google Scholar] [CrossRef]
- Jiang, S.; Zavala, V.M. Convolutional neural nets in chemical engineering: Foundations, computations, and applications. AIChE J. 2021, 67, e17282. [Google Scholar] [CrossRef]
- Pham, T.D. Time-frequency time-space LSTM for robust classification of physiological signals. Sci. Rep. 2021, 11, 6936. [Google Scholar] [CrossRef] [PubMed]
Training Set | Testing Set | |||
---|---|---|---|---|
Original Count | Count After Sliding Window | Original Count | Count After Sliding Window | |
C1 | 86 | 8686 | 22 | 2222 |
C2 | 86 | 8686 | 22 | 2222 |
C3 | 86 | 8686 | 22 | 2222 |
Ave. Acc. | Macro-F1 | C1 | C2 | C3 | ||||
---|---|---|---|---|---|---|---|---|
Acc. | F1 | Acc. | F1 | Acc. | F1 | |||
CNN | 0.9310 | 0.9307 | 0.8573 | 0.9221 | 0.9356 | 0.9037 | 1.0000 | 0.9663 |
Corro-CNN | 0.9548 | 0.9547 | 0.8816 | 0.9351 | 0.9847 | 0.9362 | 0.9982 | 0.9928 |
LSTM | 0.9389 | 0.9385 | 0.8807 | 0.9275 | 0.9361 | 0.9271 | 1.0000 | 0.9609 |
Corro-LSTM | 0.9602 | 0.9601 | 0.9761 | 0.9445 | 0.9046 | 0.9466 | 1.0000 | 0.9893 |
CorroNet | 0.9701 | 0.9701 | 0.9203 | 0.9549 | 0.9928 | 0.9600 | 0.9973 | 0.9953 |
Ave. Acc. | Macro-F1 | C1 | C2 | C3 | ||||
---|---|---|---|---|---|---|---|---|
Acc. | F1 | Acc. | F1 | Acc. | F1 | |||
w/o FAL | 0.9440 | 0.9441 | 0.8794 | 0.9320 | 0.9667 | 0.9225 | 0.9860 | 0.9777 |
w/o FAL | 0.9554 | 0.9552 | 0.8722 | 0.9315 | 0.9977 | 0.9398 | 0.9964 | 0.9944 |
w/o SCL | 0.9470 | 0.9465 | 0.8479 | 0.9152 | 0.9946 | 0.9315 | 0.9986 | 0.9928 |
w/o AE pre-training | 0.9586 | 0.9584 | 0.8870 | 0.9346 | 0.9887 | 0.9429 | 1.0000 | 0.9978 |
w/o AE | 0.9373 | 0.9371 | 0.8636 | 0.9268 | 0.9482 | 0.9103 | 1.0000 | 0.9741 |
w/o Pre-train | 0.9295 | 0.9287 | 0.8177 | 0.8872 | 0.9743 | 0.9104 | 0.9964 | 0.9884 |
w/o EN | 0.8334 | 0.8311 | 0.7083 | 0.7907 | 0.9167 | 0.8627 | 0.8750 | 0.8400 |
CorroNet | 0.9701 | 0.9701 | 0.9203 | 0.9549 | 0.9928 | 0.9600 | 0.9973 | 0.9953 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, R.; Shan, G.; Qiu, F.; Zhu, L.; Wang, K.; Meng, X.; Li, R.; Song, K.; Chen, X. Corrosion State Monitoring Based on Multi-Granularity Synergistic Learning of Acoustic Emission and Electrochemical Noise Signals. Processes 2024, 12, 2935. https://doi.org/10.3390/pr12122935
Wang R, Shan G, Qiu F, Zhu L, Wang K, Meng X, Li R, Song K, Chen X. Corrosion State Monitoring Based on Multi-Granularity Synergistic Learning of Acoustic Emission and Electrochemical Noise Signals. Processes. 2024; 12(12):2935. https://doi.org/10.3390/pr12122935
Chicago/Turabian StyleWang, Rui, Guangbin Shan, Feng Qiu, Linqi Zhu, Kang Wang, Xianglong Meng, Ruiqin Li, Kai Song, and Xu Chen. 2024. "Corrosion State Monitoring Based on Multi-Granularity Synergistic Learning of Acoustic Emission and Electrochemical Noise Signals" Processes 12, no. 12: 2935. https://doi.org/10.3390/pr12122935
APA StyleWang, R., Shan, G., Qiu, F., Zhu, L., Wang, K., Meng, X., Li, R., Song, K., & Chen, X. (2024). Corrosion State Monitoring Based on Multi-Granularity Synergistic Learning of Acoustic Emission and Electrochemical Noise Signals. Processes, 12(12), 2935. https://doi.org/10.3390/pr12122935