Integrating Roadway Sign Data and Biomimetic Path Integration for High-Precision Localization in Unstructured Coal Mine Roadways
Abstract
1. Introduction
- 1.
- A long-range biomimetic localization method integrated with environmental sign features is proposed. This method leverages semantic information (e.g., mileage and location labels) extracted from underground roadway signs as stable external references, which are fused with biomimetic navigation mechanisms to mitigate cumulative errors in long-distance operations—addressing the scalability limitation of traditional biomimetic localization algorithms.
- 2.
- An enhanced head direction cell model is designed, incorporating a speed balance factor and kinematic constraints into the cell activation function. A drift correction influence factor is further introduced to dynamically balance direction perception accuracy and drift correction intensity, effectively suppressing heading drift in complex underground environments.
- 3.
- Two constraint terms are integrated into the biomimetic path integration model based on continuous attractor networks: (1) a boundary constraint term that applies inhibitory inputs at identified environmental obstacles or impassable areas to prevent the activity packet from entering illegal regions; (2) a sign-based semantic constraint term that applies Gaussian-shaped excitatory inputs near the known positions of detected semantic landmarks to correct cumulative errors.
2. Methodology
2.1. Construction of Direction Perception Model
2.2. Multi-Constraint Grid Cell Model Based on Continuous Attractor Networks
2.2.1. Integration of External Input and Two Constraint Terms
2.2.2. Extraction and Optimization of Pose Estimation
2.3. Global Error Correction Using Prior Cognitive Map
2.3.1. Text Semantic Extraction with Adaptive Feature Fusion
2.3.2. Construction of Structured Semantic Landmark Map
2.3.3. Joint Likelihood Matching and Semantic Validation
2.3.4. Biomimetic Navigation Based on Attractor Network and Final Pose Calculation
3. Experiment
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Appendix A. Direction Perception Model: Detailed Formulation
Appendix A.1. Biological Foundation and Basic Activation
Appendix A.2. Angular Velocity Regulation and Kinematic Adaptation
Appendix A.3. Trajectory Optimization and Multi-Source Fusion
Appendix A.4. Motion Accumulation and Drift Correction
| Parameter Description | Value |
|---|---|
| Angular velocity tuning parameter | |
| Drift correction factor | |
| Sensor fusion weight (IMU) | |
| Sensor fusion weight (odometry) | |
| Cost function weight (position tracking) | |
| Cost function weight (direction consistency) | |
| Cost function weight (motion smoothness) |
Appendix B. Detailed Joint Likelihood Matching and PnP Implementation
Appendix B.1. Joint Likelihood Matching Formulation
Appendix B.2. PnP Optimization Implementation
| Parameter Description | Value |
|---|---|
| Text–spatial weight | () |
| Spatial tolerance | m |
| Heading error weight | () |
| Orientation constraint weight | () |
References
- Cadena, C.; Carlone, L.; Carrillo, H.; Latif, Y.; Scaramuzza, D.; Neira, J.; Reid, I.; Leonard, J.J. Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age. IEEE Trans. Robot. 2016, 32, 1309–1332. [Google Scholar] [CrossRef]
- Zafari, F.; Gkelias, A.; Leung, K.K. A Survey of Indoor Localization Systems and Technologies. IEEE Commun. Surv. Tutor. 2019, 21, 2568–2599. [Google Scholar] [CrossRef]
- Mao, J.; Hu, X.; Zhang, L.; He, X.; Milford, M. A Bio-Inspired Goal-Directed Visual Navigation Model for Aerial Mobile Robots. J. Intell. Robot. Syst. 2020, 100, 289–310. [Google Scholar] [CrossRef]
- Honkanen, A.; Adden, A.; da Silva Freitas, J.; Heinze, S. The Insect central complex and the neural basis of Navigation Strategies. J. Exp. Biol. 2019, 222, 1–5. [Google Scholar] [CrossRef] [PubMed]
- O’Keefe, J.; Dostrovsky, J. The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 1971, 34, 171–175. [Google Scholar] [CrossRef]
- Moser, E.I.; Kropff, E.; Moser, M.B. Place cells, grid cells, and the brain’s spatial representation system. Annu. Rev. Neurosci. 2008, 31, 69–89. [Google Scholar] [CrossRef] [PubMed]
- Angelo, A.; Gerstner, W. Spatial cognition and neuro-mimetic navigation: A model of hippocampal place cell activity. Biol. Cybern. 2000, 83, 287–299. [Google Scholar] [CrossRef]
- Milford, M.J.; Wyeth, G.F. Mapping a suburb with a single camera using a biologically inspired SLAM system. IEEE Trans. Robot. 2008, 24, 1038–1053. [Google Scholar] [CrossRef]
- Milford, M.; Wyeth, G. Persistent navigation and mapping using a biologically inspired SLAM system. Int. J. Robot. Res. 2010, 29, 1131–1153. [Google Scholar] [CrossRef]
- Ball, D.; Heath, S.; Wiles, J.; Wyeth, G.; Corke, P.; Milford, M. OpenRatSLAM: An open source brain-based SLAM system. Auton. Robot. 2013, 34, 149–176. [Google Scholar] [CrossRef]
- Tejera, G. Bio-Inspired Robotics: A Spatial Cognition Model integrating Place Cells, Grid Cells and Head Direction Cell. J. Intell. Robot. Syst. 2018, 91, 85–99. [Google Scholar] [CrossRef]
- Chen, M.; Tian, D. Bionic SLAM Algorithm Based on Multi-Scale Grid Cell to Place Cell. J. -Comput.-Aided Des. Comput. Graph. 2021, 33, 712–723. [Google Scholar] [CrossRef]
- Liu, D.; Wu, J.; Du, Y.; Zhang, R.; Cong, M. SBC-SLAM: Semantic Bioinspired Collaborative SLAM for Large-Scale Environment Perception of Heterogeneous Systems. IEEE Trans. Instrum. Meas. 2024, 73, 5018110. [Google Scholar] [CrossRef]
- Milford, M.J.; Wyeth, G.F. SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights. In Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA, 14–18 May 2012; pp. 1643–1649. [Google Scholar] [CrossRef]
- Tian, Z.; Huang, W.; He, T.; He, P.; Qiao, Y. Detecting Text in Natural Image with Connectionist Text Proposal Network; Springer: Cham, Switzerland, 2016. [Google Scholar]
- Zhou, X.; Yao, C.; Wen, H.; Wang, Y.; Zhou, S.; He, W.; Liang, J. EAST: An Efficient and Accurate Scene Text Detector. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 2642–2651. [Google Scholar] [CrossRef]
- Baek, Y.; Lee, B.; Han, D.; Yun, S.; Lee, H. Character Region Awareness for Text Detection. In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019; pp. 9357–9366. [Google Scholar] [CrossRef]
- Li, X.; Wang, W.; Hou, W.; Liu, R.-Z.; Lu, T.; Yang, J. Shape Robust Text Detection with Progressive Scale Expansion Network. arXiv 2018, arXiv:1806.02559. [Google Scholar] [CrossRef]
- Liu, X.; Liang, D.; Yan, S.; Chen, D.; Qiao, Y.; Yan, J. FOTS: Fast Oriented Text Spotting with a Unified Network. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 5676–5685. [Google Scholar] [CrossRef]
- Lyu, P.; Liao, M.; Yao, C.; Wu, W.; Bai, X. Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes. In Computer Vision—ECCV 2018; Lecture Notes in Computer Science; Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y., Eds.; Springer: Cham, Switzerland, 2018; Volume 11218. [Google Scholar]
- Liao, M.; Lyu, P.; He, M.; Yao, C.; Wu, W.; Bai, X. Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 2019, 1, 532–548. [Google Scholar] [CrossRef]
- Liao, M.; Pang, G.; Huang, J.; Hassner, T.; Bai, X. Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting. In Computer Vision—ECCV 2020; Lecture Notes in Computer Science; Vedaldi, A., Bischof, H., Brox, T., Frahm, J.M., Eds.; Springer: Cham, Switzerland, 2020; Volume 12356. [Google Scholar]
- Hafting, T.; Fyhn, M.; Molde, N.S.; Moser, M.-B.; Moser, E.I. Microstructure of a spatial map in the entorhinal cortex. Nature 2005, 436, 801–806. [Google Scholar] [CrossRef]
- Samsonovich, A.V.; McNaughton, B.L. Path integration and cognitive mapping in a continuous attractor neural network model. J. Neurosci. 1997, 17, 5900–5920. [Google Scholar] [CrossRef]
- Fiete, I.R.; Burak, Y.; Moser, M.B. Representation of geometric borders in the entorhinal cortex. Science 2008, 322, 1865–1868. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Chen, X.; Li, J. Multi-sensor fusion for velocity estimation of mobile robots based on Kalman filter. IEEE Trans. Instrum. Meas. 2020, 69, 5632–5641. [Google Scholar]
- Li, H.; Zhang, Y.; Wang, Z. Motion-driven continuous electronics-15-00528 network for robot pose estimation. Robot Auton. Syst. 2019, 115, 118–128. [Google Scholar]
- Taube, J.S.; Muller, R.U.; Ranck, J.B., Jr. Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis. J. Neurosci. 1990, 10, 420–435. [Google Scholar] [CrossRef]
- Zhang, X.; Liu, M.; Zhou, B. Obstacle detection for underground mining robots based on 3D LiDAR and semantic segmentation. Autom. Constr. 2022, 139, 104268. [Google Scholar]
- Chen, W.; Yang, C.; Li, D. Semantic landmark detection for indoor robot localization using YOLOv8 and template matching. IEEE Access 2023, 11, 45678–45690. [Google Scholar]
- Xu, W.; Zhang, F. FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter. IEEE Robot. Autom. Lett. 2021, 6, 3317–3324. [Google Scholar] [CrossRef]
- Lin, J.; Zhang, F. R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 23–27 May 2022; pp. 10672–10678. [Google Scholar] [CrossRef]
- Shan, T.; Englot, B.; Meyers, D.; Wang, W.; Ratti, C.; Rus, D. LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping. In Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA, 24 October 2020–24 January 2021; pp. 5135–5142. [Google Scholar] [CrossRef]







| Category | Device Model | Technical Specifications |
|---|---|---|
| Main Controller | MiiVii AD10 |
|
| Motion Sensors | Wire-Controlled Chassis ECU |
|
| Data Sources |
| |
| Carrier Platform | Modified Test Vehicle |
|
| Localization Scheme | MinAE | MeanAE | MaxAE | Angle MeanAE () |
|---|---|---|---|---|
| IMU + Wheel Odometer Integration | 0.071 | 16.818 | 38.783 | 1.812 |
| FAST-LIO [31] | 0.044 | 23.898 | 70.237 | 3.230 |
| R3LIVE [32] | 0.045 | 4.598 | 11.504 | 0.883 |
| LIO-SAM [33] | 0.035 | 79.860 | 153.328 | 1.657 |
| Ours | 0.015 | 9.217 | 1.585 | 0.748 |
| Parameter Description | Value |
|---|---|
| Mapping coefficient for x-axis velocity | = 1.0 |
| Mapping coefficient for y-axis velocity | = 1.0 |
| Mapping coefficient for angular velocity | = 1.0 |
| Intensity coefficient for heading constraint | = 1.2 |
| Modulation bandwidth for heading constraint | = 0.15 rad |
| Excitation gain coefficient for semantic input | = 1.2 |
| Correction range parameter for semantic input | = 0.8 m |
| Heading correction weight for semantic input | = 0.7 |
| Suppression gain coefficient for boundary constraint | = 1.5 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yu, M.; Zhang, Z.; Zhang, X.; Zhang, J.; Zhou, B.; Chen, B. Integrating Roadway Sign Data and Biomimetic Path Integration for High-Precision Localization in Unstructured Coal Mine Roadways. Electronics 2026, 15, 528. https://doi.org/10.3390/electronics15030528
Yu M, Zhang Z, Zhang X, Zhang J, Zhou B, Chen B. Integrating Roadway Sign Data and Biomimetic Path Integration for High-Precision Localization in Unstructured Coal Mine Roadways. Electronics. 2026; 15(3):528. https://doi.org/10.3390/electronics15030528
Chicago/Turabian StyleYu, Miao, Zilong Zhang, Xi Zhang, Junjie Zhang, Bin Zhou, and Bo Chen. 2026. "Integrating Roadway Sign Data and Biomimetic Path Integration for High-Precision Localization in Unstructured Coal Mine Roadways" Electronics 15, no. 3: 528. https://doi.org/10.3390/electronics15030528
APA StyleYu, M., Zhang, Z., Zhang, X., Zhang, J., Zhou, B., & Chen, B. (2026). Integrating Roadway Sign Data and Biomimetic Path Integration for High-Precision Localization in Unstructured Coal Mine Roadways. Electronics, 15(3), 528. https://doi.org/10.3390/electronics15030528
