Weather-Resilient Localizing Ground-Penetrating Radar via Adaptive Spatio-Temporal Mask Alignment
Abstract
1. Introduction
- We develop an adaptive DTW algorithm that generates a map deviation-aware mask to address channel and temporal dimensional deformations in LGPR acquisition.
- We introduce a channel alignment module employing MDWT-based low-frequency signal enhancement, coupled with time-dimensional DTW local matching, to overcome challenges from both lane deviations and diverse weather conditions.
- Extensive evaluations on both the public GROUNDED dataset and self-collected data demonstrate the superior performance of the proposed method. The framework effectively eliminates positioning mismatches caused by lane deviations while significantly improving robustness under precipitation (rain/snow), surpassing state-of-the-art methods. Visualization results further validate its capability to mitigate channel misalignments and temporal feature distortions, highlighting its exceptional performance.
2. Preliminary
2.1. DTW
- Vertical movement V: progression in the reference sequence;
- Horizontal movement H: advancement in the query sequence;
- Diagonal movement D: simultaneous progression in both sequences.
2.2. MDWT
3. Methodology
3.1. Deviation-Aware Mask for GPR Sequence Calibration
3.2. Channel Alignment
3.3. Local Matching DTW Algorithm
4. Experiment and Results Analysis
4.1. Data Acquisition and Data Pre-Processing
- GROUNDED dataset: To comprehensively characterize the experimental data, we utilize a unique large-scale LGPR dataset that currently represents the sole publicly available collection employing 11-channel 400 MHz GPR measurements. The dataset systematically incorporates three distinct weather conditions (rain, snow, and clear) while simultaneously encompassing seven diverse road environments, including highways, urban centers, and suburban areas. Furthermore, the dataset specifically addresses multi-lane mapping challenges through a carefully designed acquisition plan, thereby providing a robust testbed for evaluating LGPR performance across varying operational scenarios. In this study, Route5’s run56 (sunny) is selected as the map, while run57 (sunny), run90 (rainy), and run57 (snowy) serve as the query sequences.
- Self dataset: To ensure comprehensive data coverage, we employed a multi-channel GPR system to systematically acquire ground-penetrating radar data across various road surfaces in Changsha, China. The system configuration consists of a dual-row uniform antenna array comprising 20 radar channels with a total array width of 1.5 m, operating within a broad frequency range of 100–3000 MHz. While the nominal penetration depth reaches approximately 3 m, we note that actual penetration performance varies significantly depending on subsurface soil characteristics. Furthermore, to guarantee high-resolution data collection, we integrated a distance measurement instrument (DMI) that triggers the GPR system at precisely 7-cm intervals along each survey line. Importantly, our acquisition plan specifically addresses lane deviation challenges by intentionally collecting data with 0–5 channel offsets, while simultaneously ensuring environmental variability through repeated surveys of identical road sections under both sunny and rainy weather conditions. We selected non-yawed trajectories (self) under sunny conditions as the map, while sunny and rainy sequences served as queries. Additionally, we included sunny trajectories with intentional yaw deviations (self yaw), using the non-yawed sequence as the map and trajectories with two-lane and four-lane offsets as queries.
4.2. Valuation Metric
4.3. Ablation Study
- Proposed: the complete proposed method (Figure 2), representing our full proposed framework.
- No DAM: the variant excluding DAM calibration, where original dataset data undergo CA after MDWT filtering.
- No CA:a configuration without CA, utilizing cosine distance metrics on DAM calibrated MDWT data for single-image matching.
- No MDWT: an ablated version removing the MDWT module entirely.
- Original data: baseline performance using raw, unprocessed origin data.
4.4. Comparison with the State-of-the-Art Methods
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Cornick, M.; Koechling, J.; Stanley, B.; Zhang, B. Localizing ground penetrating radar: A step toward robust autonomous ground vehicle localization. J. Field Robot. 2016, 33, 82–102. [Google Scholar] [CrossRef]
- Xu, L.; Winner, V.; Maurer, H. Gradient-constrained model parametrization in 3-D compact full waveform inversion. Geophys. J. Int. 2023, 232, 366–397. [Google Scholar] [CrossRef]
- Wang, X.; Yu, T.; Feng, D.; Li, B.; Ding, S. Spatiotemporal Optimization of GPR Full Waveform Inversion Based on Super-Resolution Technology. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5908413. [Google Scholar] [CrossRef]
- Ort, T.; Gilitschenski, I.; Rus, D. Autonomous navigation in inclement weather based on a localizing ground penetrating radar. IEEE Robot. Autom. Lett. 2020, 5, 3267–3274. [Google Scholar] [CrossRef]
- Bi, B.; Shen, L.; Zhang, P.; Huang, X.; Xin, Q.; Jin, T. TSVR-Net: An End-to-End Ground-Penetrating Radar Images Registration and Location Network. Remote Sens. 2023, 15, 3428. [Google Scholar] [CrossRef]
- Li, H.; Guo, J.; Song, D. Subsurface Feature-based Ground Robot/Vehicle Localization Using a Ground Penetrating Radar. In Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13–17 May 2024; IEEE: Piscataway, NJ, USA, 2024; pp. 1716–1722. [Google Scholar]
- Zhang, P.; Zhi, S.; Yuan, Y.; Bi, B.; Xin, Q.; Huang, X.; Shen, L. Looking Beneath More: A Sequence-based Localizing Ground Penetrating Radar Framework. In Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13–17 May 2024; pp. 8515–8521. [Google Scholar]
- Zhang, K.; Chi, Y.; Guo, J.; Bai, C. Underground Robot Localization Based on Ground-Penetrating Radar. In Proceedings of the International Conference on Autonomous Unmanned Systems, Singapore, 26–28 October 2022; Springer: Berlin/Heidelberg, Germany, 2022; pp. 3577–3588. [Google Scholar]
- Xu, J.; Lai, Q.; Wei, D.; Ji, X.; Shen, G.; Yuan, H. The Ground-Penetrating Radar Image Matching Method Based on Central Dense Structure Context Features. Remote Sens. 2024, 16, 4291. [Google Scholar] [CrossRef]
- Ort, T.; Gilitschenski, I.; Rus, D. GROUNDED: The Localizing Ground Penetrating Radar Evaluation Dataset. In Proceedings of the Robotics: Science and Systems, Virtual, 12–16 July 2021; Volume 2. [Google Scholar]
- Skartados, E.; Kargakos, A.; Tsiogas, E.; Kostavelis, I.; Giakoumis, D.; Tzovaras, D. Gpr antenna localization based on a-scans. In Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), A Coruña, Spain, 2–6 September 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–5. [Google Scholar]
- Ni, Z.; Ye, S.; Shi, C.; Pan, J.; Zheng, Z.; Fang, G. A deep learning assisted ground penetrating radar localization method. J. Electron. Inf. Technol. 2022, 44, 1265–1273. [Google Scholar]
- Zhang, P.; Shen, L.; Wen, T.; Huang, X.; Xin, Q. Vector phase symmetry for stable hyperbola detection in ground-penetrating radar images. IEEE Trans. Geosci. Remote Sens. 2021, 60, 5107912. [Google Scholar] [CrossRef]
- Arandjelovic, R.; Gronat, P.; Torii, A.; Pajdla, T.; Sivic, J. NetVLAD: CNN architecture for weakly supervised place recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 5297–5307. [Google Scholar]
- Arandjelovic, R.; Zisserman, A. All about VLAD. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013; pp. 1578–1585. [Google Scholar]
- Noh, H.; Araujo, A.; Sim, J.; Weyand, T.; Han, B. Large-scale image retrieval with attentive deep local features. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 3456–3465. [Google Scholar]
- Ma, J.; Zhang, J.; Xu, J.; Ai, R.; Gu, W.; Chen, X. OverlapTransformer: An efficient and yaw-angle-invariant transformer network for LiDAR-based place recognition. IEEE Robot. Autom. Lett. 2022, 7, 6958–6965. [Google Scholar] [CrossRef]
- Zhang, P.; Chen, X.; Chen, Y.; Bi, B.; Xu, Z.; Jin, T.; Huang, X.; Shen, L. EDENet: Echo Direction Encoding Network for Place Recognition Based on Ground Penetrating Radar. In Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada, 23–27 February 2025; Volume 39, pp. 10067–10075. [Google Scholar]
- Chen, Y.; Zhang, P.; Bi, B.; Shen, L.; Jin, T.; Huang, X. Spatial–Temporal U-Net for Localizing Ground-Penetrating Radar. IEEE Geosci. Remote Sens. Lett. 2025, 22, 3504905. [Google Scholar] [CrossRef]
- Stasewitsch, I.; Schattenberg, J.; Frerichs, L. Robust Monte Carlo Localisation Using a Ground Penetrating Radar. In Proceedings of the Iberian Robotics Conference, Sevilla, Spain, 23–25 November 2022; Springer: Berlin/Heidelberg, Germany, 2022; pp. 247–258. [Google Scholar]
- Ort, T.; Gilitschenski, I.; Rus, D. GROUNDED: A localizing ground penetrating radar evaluation dataset for learning to localize in inclement weather. Int. J. Robot. Res. 2023, 42, 901–916. [Google Scholar] [CrossRef]
- Lu, F.; Chen, B.; Zhou, X.D.; Song, D. STA-VPR: Spatio-temporal alignment for visual place recognition. IEEE Robot. Autom. Lett. 2021, 6, 4297–4304. [Google Scholar] [CrossRef]
- Yin, H.; Wang, Y.; Ding, X.; Tang, L.; Huang, S.; Xiong, R. 3d lidar-based global localization using siamese neural network. IEEE Trans. Intell. Transp. Syst. 2019, 21, 1380–1392. [Google Scholar] [CrossRef]
- Kim, G.; Kim, A. Scan context: Egocentric spatial descriptor for place recognition within 3d point cloud map. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 4802–4809. [Google Scholar]
- Deng, J.J.; Leung, C.H. Dynamic time warping for music retrieval using time series modeling of musical emotions. IEEE Trans. Affect. Comput. 2015, 6, 137–151. [Google Scholar] [CrossRef]
- Sakoe, H.; Chiba, S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 2003, 26, 43–49. [Google Scholar] [CrossRef]
- Keogh, E.J.; Pazzani, M.J. Scaling up dynamic time warping for datamining applications. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, USA, 20–23 August 2000; pp. 285–289. [Google Scholar]
- Maus, V.; Câmara, G.; Appel, M.; Pebesma, E. dtwsat: Time-weighted dynamic time warping for satellite image time series analysis in r. J. Stat. Softw. 2019, 88, 1–31. [Google Scholar] [CrossRef]
- Lu, F.; Chen, B.; Guo, Z.; Zhou, X. Visual sequence place recognition with improved dynamic time warping. In Proceedings of the 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), Portland, OR, USA, 4–6 November 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1034–1041. [Google Scholar]
- Deng, Z.P.; Jia, K.B. A video similarity matching algorithm supporting for different time scales. In Proceedings of the 2008 Eighth International Conference on Intelligent Systems Design and Applications, Kaohsiung, Taiwan, 26–28 November 2008; IEEE: Piscataway, NJ, USA, 2008; Volume 3, pp. 570–574. [Google Scholar]
- Wen, J.; Huang, T.; Cui, X.; Zhang, Y.; Shi, J.; Jiang, Y.; Li, X.; Guo, L. Enhancing Image Alignment in Time-Lapse-Ground-Penetrating Radar through Dynamic Time Warping. Remote Sens. 2024, 16, 1040. [Google Scholar] [CrossRef]
- Luo, W.; Lee, Y.H.; Sun, H.H.; Ow, L.F.; Yusof, M.L.M.; Yucel, A.C. Tree roots reconstruction framework for accurate positioning in heterogeneous soil. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2022, 15, 1912–1925. [Google Scholar] [CrossRef]
- Bi, B.; Shen, L.; Zhang, P.; Chen, Y.; Huang, X.; Jin, T. Hybrid-Driven with Low-Frequency Enhancement for LGPR Map Reconstruction. IEEE Sens. J. 2025, in press. [Google Scholar] [CrossRef]
- Salvador, S.; Chan, P. Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 2007, 11, 561–580. [Google Scholar] [CrossRef]
- Chen, A.P.; Lin, S.F.; Cheng, Y.C. Time registration of two image sequences by dynamic time warping. In Proceedings of the IEEE International Conference on Networking, Sensing and Control, Taipei, Taiwan, 21–23 March 2004; IEEE: Piscataway, NJ, USA, 2004; Volume 1, pp. 418–423. [Google Scholar]
Dataset | Frames (Map/Query) | Interval (cm) | Channel Offset | Tolerance (Frames) |
---|---|---|---|---|
GROUNDED | 1000/1000 | 5 | ≥3 | ±2 |
Self | 900/900 | 7 | 0 | ±3 |
Self (Yaw) | 660/660 | 7 | 2/4 | ±3 |
Method/Challenge | Grounded Dataset | Self Dataset | |||||
---|---|---|---|---|---|---|---|
Sunny/Sunny | Sunny/Snowy | Sunny/Rainy | Sunny/Sunny | Sunny/Rainy | Yaw0/2 | Yaw0/4 | |
Proposed | 0.988 | 0.778 | 0.924 | 0.975 | 0.986 | 0.901 | 0.845 |
No DAM | 0.508 | 0.223 | 0.338 | 0.949 | 0.344 | 0.873 | 0.838 |
No CA | 0.949 | 0.447 | 0.771 | 0.969 | 0.981 | 0.783 | 0.613 |
No MDWT | 0.982 | 0.667 | 0.877 | 0.804 | 0.767 | 0.876 | 0.823 |
Original Data | 0.496 | 0.201 | 0.207 | 0.802 | 0.285 | 0.780 | 0.577 |
Method/Challenge | Grounded Dataset | Self Dataset | |||||
---|---|---|---|---|---|---|---|
Sunny/Sunny | Sunny/Snowy | Sunny/Rainy | Sunny/Sunny | Sunny/Rainy | Yaw0/2 | Yaw0/4 | |
Proposed | 0.988 | 0.778 | 0.924 | 0.975 | 0.986 | 0.901 | 0.845 |
STU-Net | 0.621 | 0.530 | 0.573 | 0.742 | 0.586 | 0.536 | 0.265 |
LFE-MDP | 0.933 | 0.562 | 0.387 | 0.913 | 0.847 | 0.315 | 0.243 |
fast DTW | 0.950 | 0.521 | 0.797 | 0.804 | 0.647 | 0.720 | 0.435 |
Savitzky–Golay filter | 0.612 | 0.389 | 0.536 | 0.832 | 0.301 | 0.784 | 0.579 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chen, Y.; Bi, B.; Zhang, P.; Shen, L.; Chen, C.; Huang, X.; Jin, T. Weather-Resilient Localizing Ground-Penetrating Radar via Adaptive Spatio-Temporal Mask Alignment. Remote Sens. 2025, 17, 2854. https://doi.org/10.3390/rs17162854
Chen Y, Bi B, Zhang P, Shen L, Chen C, Huang X, Jin T. Weather-Resilient Localizing Ground-Penetrating Radar via Adaptive Spatio-Temporal Mask Alignment. Remote Sensing. 2025; 17(16):2854. https://doi.org/10.3390/rs17162854
Chicago/Turabian StyleChen, Yuwei, Beizhen Bi, Pengyu Zhang, Liang Shen, Chaojian Chen, Xiaotao Huang, and Tian Jin. 2025. "Weather-Resilient Localizing Ground-Penetrating Radar via Adaptive Spatio-Temporal Mask Alignment" Remote Sensing 17, no. 16: 2854. https://doi.org/10.3390/rs17162854
APA StyleChen, Y., Bi, B., Zhang, P., Shen, L., Chen, C., Huang, X., & Jin, T. (2025). Weather-Resilient Localizing Ground-Penetrating Radar via Adaptive Spatio-Temporal Mask Alignment. Remote Sensing, 17(16), 2854. https://doi.org/10.3390/rs17162854