Research on ADTH-DTW-Based Alignment Method for Multi-Round In-Line Inspection Data of Oil and Gas Pipelines
Abstract
1. Introduction
2. Theoretical Background
2.1. Real-Time Dynamic Time Warping Algorithm
2.2. Alignment Workflow for ILI Data
- (1)
- Landmark Alignment
- (2)
- Defect Alignment
3. Theoretical Frameworks
3.1. Weld Data Processing
- (1)
- Calculate the predicted point: For the current valid point , calculate the next predicted point based on the theoretical interval , using the formula .
- (2)
- Find candidate valid points: Within the fluctuation range of the predicted point , check the n data points after the current point. Assume the current traversal reaches the i-th data point. If (where , and is the total number of data points, then take as a candidate valid point.
- (3)
- Select the best valid point: If candidate valid points exist, choose the point with the smallest absolute difference from the predicted point among these candidates as the best valid point , . Add the best valid point to the result list , update the current valid point , and skip the intermediate points that deviate from the expected ones, continuing the matching from the next point.
- (4)
- Handle the case of no candidate valid points: If there are no candidate valid points, and , then treat the current point as a valid point, add it to the result list , update the current valid point , and then continue traversing the data backward, repeating the above matching process until all data points have been traversed.
3.2. Valve Alignment and Mileage Correction
- (1)
- Match Common Valves
- (2)
- Calculate Offset
- (3)
- Overall Mileage Correction
3.3. In-Line Inspection Data Alignment Process
- (1)
- Anchor Point Extraction
- (2)
- Global Rough Alignment
- (3)
- Local Fine Alignment
4. Experimental Study
4.1. Analysis of Causes for Data Drift
4.2. In-Line Inspection Data Alignment Workflow
4.3. ADTH-Based Data Preprocessing
4.4. DTW Data Alignment
5. Discussions
- (1)
- KL divergence:
- (2)
- JS divergence:
- (3)
- Linear interpolation:
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Nomenclature
| represents the offset | |
| represent the mileage values of valve chamber A in the reference run and the alignment run, respectively |
References
- Vanaei, H.R.; Eslami, A.; Egbewande, A. A review on pipeline corrosion, in-line inspection (ILI), and corrosion growth rate models. Int. J. Press. Vessel. Pip. 2017, 149, 43–54. [Google Scholar] [CrossRef] [Scilit]
- Liu, T.; Cai, X.; Zhou, W.; Wang, K.; Wang, J. Enhanced detection of pipeline leaks based on generalized likelihood ratio with ensemble learning. Processes 2025, 13, 558. [Google Scholar] [CrossRef] [Scilit]
- Xu, L.; Yu, J.; Zhu, Z.; Man, J.; Yu, P.; Li, C.; Wang, X.; Zhao, Y. Research and application for corrosion rate prediction of natural gas pipelines based on a novel hybrid machine learning approach. Coatings 2023, 13, 856. [Google Scholar] [CrossRef] [Scilit]
- Liu, H.; Cai, X.; Meng, X. Fast and accurate prediction of corrosion rate of natural gas pipeline using a hybrid machine learning approach. Appl. Sci. 2025, 15, 2023. [Google Scholar] [CrossRef] [Scilit]
- Wen, Y.X.; Jia, F.S.; Liu, P.C.; Wang, F.; Chen, J.Z.; Ma, Y.L. Research and application of probability distribution law of corrosion detection data of in-line inspection in pipeline. Oil-Gas Field Surf. Eng. 2024, 43, 70–76. [Google Scholar]
- Dann, M.R.; Dann, C. Automated matching of pipeline corrosion features from in-line inspection data. Reliab. Eng. Syst. Saf. 2017, 162, 40–50. [Google Scholar] [CrossRef] [Scilit]
- Wang, M.X. Research on Biomedical Ontology Alignment Based on Multi-Strategy. Master’s Thesis, Wuhan University of Technology, Wuhan, China, 2022. [Google Scholar]
- Wang, B.; Hang, C.C.; Liu, J.; Sun, P.; Yang, Y. Alignment and application of internal detection data and construction materials for pipelines. Oil-Gas Field Surf. Eng. 2018, 37, 87–89. [Google Scholar]
- Hu, W.; Jing, Y.H. Recommendation algorithm based on fusion of KL divergence and JS divergence similarity. J. Harbin Univ. Commer. (Nat. Sci. Ed.) 2020, 36, 48–53. [Google Scholar]
- Liu, G.R. Pipeline integrity evaluation technology based on two-round internal detection data mining. World Pet. Ind. 2023, 30, 62–68. [Google Scholar]
- Kang, C.; Zhang, P.G.; Ma, X.L.; Deng, Y.F.; Deng, B.H.; Cao, H.F.Y. Batch by batch iteration-based algorithm for internal detection data alignment. Control Instrum. Chem. Ind. 2025, 52, 449–456+469. [Google Scholar]
- Liu, H. Research on pipeline integrity evaluation technology considering alignment of internal and external inspection data. Pet. Eng. Constr. 2022, 48, 44–48. [Google Scholar]
- Yang, H.; Liu, X.L.; Li, Q.; Ling, J.Y.; Yu, H. Research and application of alignment algorithm for multiple in-line inspection data of oil and gas pipeline. Pipeline Tech. Equip. 2020, 1, 21–24+28. [Google Scholar]
- Yang, H. Comparative Analysis Method and Application of Oil and Gas Pipeline In-Line Inspection Data. Master’s Thesis, Northeast Petroleum University, Daqing, China, 2017. [Google Scholar]
- Liu, H.P.; Gu, S.Y.; Liu, Q.L.; Zhang, J.K.; Hao, Y.; Wu, X.C.; Jiang, Y.L.; Wan, P. Alignment method of internal and external pipeline inspection data based on machine learning algorithm. Oil Gas Storage Transp. 2021, 40, 1236–1241. [Google Scholar]
- Zhang, H.W.; Jin, J.; Dong, S.H.; Zhang, L.B.; Li, N. Application of semantic similarity calculation in parameter matching of detection data. Pet. Sci. Bull. 2018, 3, 446–451. [Google Scholar]
- Fumitada, I.; Taizo, U. Distance measure for speech recognition based on the smoothed group delay spectrum. In ICASSP ‘87: IEEE International Conference on Acoustics, Speech, and Signal Processing; The Institute of Electrical and Electronics Engineers, Inc.: New York, NY, USA, 1987; pp. 1257–1260. [Google Scholar]
- Tomaszewska, J.; Witoś, M.; Kwaśniewski, J. Application of dynamic time warping (DTW) in comparing MRT signals of steel ropes. Appl. Sci. 2025, 15, 7924. [Google Scholar] [CrossRef] [Scilit]
- Althobaiti, M. Unsupervised dynamic time warping clustering for robust functional network identification in fNIRS motor tasks. Sensors 2026, 26, 1848. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wang, L.; Koniusz, P. Uncertainty-DTW for time series and sequences. In European Conference on Computer Vision; Springer: Cham, Switzerland, 2022. [Google Scholar]
- Cui, K. Algorithm and application of pipeline in-line inspection data alignment. In Proceedings of the ASME Pressure Vessels and Piping Conference; ASME: New York, NY, USA, 2022. [Google Scholar]
- Niu, Y.; Li, X.; Li, J.; Liu, Y.Q.; Judith, J. Research on sentence semantic similarity based on DTW and improved Hungarian algorithm. Comput. Digit. Eng. 2021, 49, 242–247. [Google Scholar]
- Wu, X.; Xu, J.; Li, K.; Yin, J.; Xiong, J. FLDTMatch: Improving unbalanced data classification via deep semi-supervised learning with self-adaptive dynamic threshold. Mathematics 2025, 13, 392. [Google Scholar] [CrossRef] [Scilit]
- Zheng, L.; Jiang, Y.; Jiang, H.; Tang, C.; Jiao, W.; Shi, Z.; Rehman, A.U. Adaptive dynamic threshold graph neural network: A novel deep learning framework for cross-condition bearing fault diagnosis. Machines 2023, 12, 18. [Google Scholar] [CrossRef] [Scilit]













| Category | Method | Limitation |
|---|---|---|
| Based on Mathematical Models | Linear Interpolation Algorithm | Prone to the issue of interpolation exceeding limits |
| KL Divergence | Susceptible to false positives and missed detections | |
| JS Divergence | Relatively long alignment time | |
| Based on Machine Learning | XGBoost Algorithm | Relatively long computation time |
| Based on Text Similarity | Semantic Similarity | Applicable only to textual data |
| Item | First ILI Run | Second ILI Run | Third ILI Run |
|---|---|---|---|
| Valve Chamber | 4 | 3 | 3 |
| Girth Weld | 542 | 544 | 559 |
| Defect | 17 | 13 | 48 |
| Bend | 82 | 80 | 224 |
| Metric | First ILI Run | Second ILI Run | Third ILI Run |
|---|---|---|---|
| Raw Data Count | 541 | 543 | 558 |
| Proportion of Valid Intervals | 72.1% (390/541) | 71.8% (390/543) | 69.5% (388/558) |
| Average Spacing | 10.27 m ± 5.93 m | 10.24 m ± 5.93 m | 9.96 m ± 5.95 m |
| Processed Data Count | 415 | 415 | 416 |
| Proportion of Valid Intervals (Post) | 83.6% (346/415) | 83.6% (346/415) | 83.1% (345/415) |
| Average Spacing (Post) | 12.42 m ± 32.93 m | 12.43 m ± 32.94 m | 12.39 m ± 32.66 m |
| Alignment Pair | First Run–Second Run | First Run–Third Run | Second Run–Third Run |
|---|---|---|---|
| Reference round | First Run | First Run | Second Run |
| Defect Count in Reference Run | 8 | 8 | 13 |
| Alignment Run | Second Run | Third Run | Third Run |
| Duplicate Defect Count | 4 | 5 | 7 |
| New Defect Count | 4 | 43 | 41 |
| Model | ADTH-DTW | KL Divergence | JS Divergence | DTW | Linear Interpolation |
|---|---|---|---|---|---|
| Defect Count in Reference Run | 13 | 13 | 13 | 13 | 13 |
| Defect Count in Alignment Run | 48 | 48 | 48 | 48 | 48 |
| Matched Defects | 7 | 5 | 6 | 11 | 7 |
| New Defects | 41 | 73 | 72 | 67 | 71 |
| Model | ADTH-DTW | KL Divergence | JS Divergence | DTW | Linear Interpolation |
|---|---|---|---|---|---|
| Defect Count in Reference Run | 13 | 13 | 13 | 13 | 13 |
| Defect Count in Alignment Run | 48 | 48 | 48 | 48 | 48 |
| Matched Defects | 7 | 4 | 4 | 4 | 4 |
| New Defects | 41 | 44 | 44 | 44 | 44 |
| Matching Rate | 53.85% | 30.77% | 30.77% | 30.77% | 30.77% |
| Computational Efficiency | 0.09 | 0.38 | 0.36 | 0.36 | 0.37 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Li, Q.; Zhang, L.; Liang, Q.; Wei, D.; Wang, J.; Cai, X.; Tian, Z. Research on ADTH-DTW-Based Alignment Method for Multi-Round In-Line Inspection Data of Oil and Gas Pipelines. Processes 2026, 14, 1360. https://doi.org/10.3390/pr14091360
Li Q, Zhang L, Liang Q, Wei D, Wang J, Cai X, Tian Z. Research on ADTH-DTW-Based Alignment Method for Multi-Round In-Line Inspection Data of Oil and Gas Pipelines. Processes. 2026; 14(9):1360. https://doi.org/10.3390/pr14091360
Chicago/Turabian StyleLi, Qiang, Laibin Zhang, Qiang Liang, Donghong Wei, Jinjiang Wang, Xiuquan Cai, and Zhe Tian. 2026. "Research on ADTH-DTW-Based Alignment Method for Multi-Round In-Line Inspection Data of Oil and Gas Pipelines" Processes 14, no. 9: 1360. https://doi.org/10.3390/pr14091360
APA StyleLi, Q., Zhang, L., Liang, Q., Wei, D., Wang, J., Cai, X., & Tian, Z. (2026). Research on ADTH-DTW-Based Alignment Method for Multi-Round In-Line Inspection Data of Oil and Gas Pipelines. Processes, 14(9), 1360. https://doi.org/10.3390/pr14091360
