Research on a Tracking Control Method Assisted by Visual Targets in the Autonomous Navigation Task of a Split Drilling Robot
Abstract
1. Introduction
- Based on the structural characteristics of split-type robots, we propose an active leader–passive follower navigation strategy. The leader performs path planning on a 3D LiDAR point cloud map to achieve autonomous mobility and obstacle avoidance. The follower uses AprilTags as visual fiducial markers for localization and tracks the leader visually using a fuzzy PID control algorithm, thereby realizing overall autonomous navigation of the split-type robot.
- We propose a motion control method for the drilling robot based on fuzzy PID. A two-dimensional fuzzy PID architecture is adopted, and a fuzzy control lookup table is defined, enabling accurate tracking control of the follower to the leader.
- Experiments on autonomous navigation and tracking control of the split-type robot are carried out in a simulation environment, a simulated tunnel, and on a real drilling robot. The results demonstrate that the proposed method enables the follower to accurately track the autonomously navigating leader.
2. Working Conditions and System Architecture
2.1. Basic Working Conditions and Navigation Requirements of the Split-Type Drilling Robots
2.2. Architecture of the Autonomous Navigation System and Visual Tracking System
2.3. Selection of Visual Fiducial Markers
2.4. Host Computer Interface
3. Path Planning and Obstacle Avoidance Method for the Leader Robot
3.1. Path Planning Model
3.2. Offline Path Generation and Collision Detection
3.3. Real-Time Optimal Path Search
| Algorithm 1 Optimal path search algorithm. | |
| 1 | Input: all path groups, index table mapping voxels to occluding paths, point cloud perceived by the sensor, |
| 2 | Output: an executable path or a signal that no path is found. |
| 3 | Begin |
| 4 | Initialize all paths as not occluded |
| 5 | For each point perceived by the sensor do |
| 6 | Mark as occluded any path that collides with the obstacle according to the index table |
| 7 | end |
| 8 | If not all paths are occluded then |
| 9 | For each path group do |
| 10 | Compute according to Equation (5) |
| 11 | end |
| 12 | Find the group with the maximum and return the first-sampled path of that group |
| 13 | end |
| 14 | else |
| 15 | Return “no path found” |
| 16 | end |
| 17 | end |
4. Rear Robot Pose Perception Method Based on a Visual Fiducial Marker
4.1. AprilTag-Based Camera Pose Detection Method
4.1.1. Quadrilateral Detection
4.1.2. Tag Decoding
4.2. Visual Label Localization Method Based on Perspective-N-Point
5. Fuzzy PID-Based Tracking Control Method for the Follower Robot
5.1. Discrete Incremental PID Method
5.2. Design of a Fuzzy PID-Based Tracking Controller
5.2.1. Fuzzy Rule Design for
5.2.2. Fuzzy Rule Design for
5.2.3. Fuzzy Rule Design for
6. Experiments
6.1. Simulation Experiment and Analysis
6.2. Experiments in a Real Tunnel Environment
6.2.1. Experimental Process of Autonomous Walking
6.2.2. Obstacle Avoidance Experiment
6.2.3. Tracking Experiment with Large Robots
6.3. Field Application Experiment of the Split-Type Drilling Robot
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
| Marker Type | AprilTag | ArUco | ChArUco | ARToolKit | QR Code |
|---|---|---|---|---|---|
| Error Correction Capability | Strong (tag36h11/tag25h9) | Limited error tolerance | No dedicated robust error-correcting coding | Prone to feature confusion | Not designed for pose positioning |
| Positioning Accuracy | Sub-millimeter accuracy at close range, 6DOF pose | Moderate accuracy; corners vulnerable to noise | High accuracy via chessboard sub-pixel detection, relying on complete grid points | Low accuracy and unstable corner extraction | Low accuracy with only four corners and no sub-pixel optimization |
| Running Speed | Moderate (15–20 fps on embedded devices) | Fastest (30+ fps with OpenCV optimization) | Relatively slow due to dual computation | Moderate | High |
| Resistance to Light/Shadow | High robustness | Prone to detection loss under varying light | Highly dependent on image contrast | Weak resistance to light changes | Poor resistance to light variation and blurring |
| Occlusion Resistance | Tolerates partial occlusion; single tag works independently | Detection fails easily under partial occlusion | Good tolerance using remaining corners, but requires large visible area | Poor occlusion tolerance | Moderate occlusion tolerance |
| Effective Detection Range | Long range, up to 50 times the tag size | Short range; invalid when blurred at a distance | Moderate range; grid points blur at long distances | Only effective at close range | Only effective at close range |
| Rotation Robustness | High adaptability to planar and spatial rotation | Poor performance at large angles and long distances | Average performance; large-angle distortion affects corner extraction | Poor performance | Average performance |
| Ecosystem & Application | Natively supported by ROS | Built into OpenCV; lightweight and easy to implement | Supported by OpenCV; mainly for camera calibration | Classic early AR solution, now gradually phased out | Universal information carrier, widely used on mobile devices |
| Disadvantages | Slightly slower than ArUco | Low accuracy and robustness; unstable in poor lighting scenarios | Large size for deployment, no independent ID | High false detection rate and poor overall robustness; | Not suitable for high-precision robot tracking |
References
- Zhao, J.; Han, Z.; Liu, G. Development of a serpentine omnitread robot for searching in explosive gas atmospheres. Ind. Robot Int. J. 2011, 38, 469–475. [Google Scholar] [CrossRef] [Scilit]
- Zheng, Z.; Zhang, W.; Fu, X.; Hazken, S.; Hu, X.; Chen, H.; Luo, J.; Ding, N. Ccrobot-iv: An obstacle-free split-type quad-ducted propeller-driven bridge stay cable-climbing robot. IEEE Robot. Autom. Lett. 2021, 7, 11751–11758. [Google Scholar] [CrossRef] [Scilit]
- Han, M.; Zhou, J.; Chen, X.; Li, L. Analysis of in-pipe inspection robot structure design. In Proceedings of the 2016 2nd Workshop on Advanced Research and Technology in Industry Applications (WARTIA-16); Atlantis Press: Paris, France, 2016; pp. 987–991. [Google Scholar]
- Zhang, S.; Lin, W.; Chen, W.; Chen, C. The application of a novel split-type robotic system, Carina Platform, for esophageal surgery. J. Clin. Oncol. 2025, 43, e16145. [Google Scholar] [CrossRef] [Scilit]
- Zhou, B.; Xu, H.; Shen, S. Racer: Rapid collaborative exploration with a decentralized multi-uav system. IEEE Trans. Robot. 2023, 39, 1816–1835. [Google Scholar] [CrossRef] [Scilit]
- Yan, J.; Lin, X.; Ren, Z.; Zhao, S.; Yu, J.; Cao, C.; Yin, P.; Zhang, J.; Scherer, S. MUI-TARE: Cooperative multi-agent exploration with unknown initial position. IEEE Robot. Autom. Lett. 2023, 8, 4299–4306. [Google Scholar] [CrossRef]
- Wang, Z.; Zhou, X.; Xu, C.; Gao, F. Geometrically constrained trajectory optimization for multicopters. IEEE Trans. Robot. 2022, 38, 3259–3278. [Google Scholar] [CrossRef] [Scilit]
- Zhang, J.; Hu, C.; Chadha, R.G.; Singh, S. Falco: Fast likelihood-based collision avoidance with extension to human-guided navigation. J. Field Robot. 2020, 37, 1300–1313. [Google Scholar] [CrossRef] [Scilit]
- Tordesillas, J.; How, J.P. MADER: Trajectory planner in multiagent and dynamic environments. IEEE Trans. Robot. 2021, 38, 463–476. [Google Scholar] [CrossRef] [Scilit]
- Zhou, X.; Wen, X.; Wang, Z.; Gao, Y.; Li, H.; Wang, Q.; Yang, T.; Lu, H.; Cao, Y.; Xu, C. Swarm of micro flying robots in the wild. Sci. Robot. 2022, 7, eabm5954. [Google Scholar] [CrossRef] [Scilit]
- Olson, E. AprilTag: A robust and flexible visual fiducial system. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation; IEEE: Piscataway, NJ, USA, 2011; pp. 3400–3407. [Google Scholar]
- Wang, J.; Olson, E. AprilTag 2: Efficient and robust fiducial detection. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE: Piscataway, NJ, USA, 2016; pp. 4193–4198. [Google Scholar]
- Yu, C.; Cai, J.; Chen, Q. Multi-resolution visual fiducial and assistant navigation system for unmanned aerial vehicle landing. Aerosp. Sci. Technol. 2017, 67, 249–256. [Google Scholar] [CrossRef] [Scilit]
- Romero-Ramirez, F.J.; Muñoz-Salinas, R.; Medina-Carnicer, R. Speeded up detection of squared fiducial markers. Image Vis. Comput. 2018, 76, 38–47. [Google Scholar] [CrossRef] [Scilit]
- Calvet, L.; Gurdjos, P.; Griwodz, C.; Gasparini, S. Detection and accurate localization of circular fiducials under highly challenging conditions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2016; pp. 562–570. [Google Scholar]
- Brunner, C.; Peynot, T. Perception quality evaluation with visual and infrared cameras in challenging environmental conditions. In Proceedings of the Experimental Robotics: The 12th International Symposium on Experimental Robotics; Springer: Berlin/Heidelberg, Germany, 2014; pp. 711–725. [Google Scholar]
- Yuanwei, C.; Zaman, M.H.M.; Ibrahim, M.F. A review on six degrees of freedom (6D) pose estimation for robotic applications. IEEE Access 2024, 12, 161002–161017. [Google Scholar] [CrossRef] [Scilit]
- Wang, J.; Wu, P.; Zhang, X.; Xu, R.; Wang, T. Six-Degree-of-Freedom Pose Estimation Method for Multi-Source Feature Points Based on Fully Convolutional Neural Network. J. Intell. Robot. Syst. 2024, 110, 131. [Google Scholar] [CrossRef] [Scilit]
- Castellanos-Cárdenas, D.; Posada, N.L.; Orozco-Duque, A.; Sepúlveda-Cano, L.M.; Castrillón, F.; Camacho, O.E.; Vásquez, R.E. A review on data-driven model-free sliding mode control. Algorithms 2024, 17, 543. [Google Scholar] [CrossRef] [Scilit]
- Howard, T.; Pivtoraiko, M.; Knepper, R.A.; Kelly, A. Model-predictive motion planning: Several key developments for autonomous mobile robots. IEEE Robot. Autom. Mag. 2014, 21, 64–73. [Google Scholar] [CrossRef] [Scilit]
- Ismael, O.Y.; Almaged, M.; Abdulla, A.I. Nonlinear model predictive control-based collision avoidance for mobile robot. J. Robot. Control (JRC) 2024, 5, 142–151. [Google Scholar] [CrossRef] [Scilit]
- Meng, D.; Chu, H.; Tian, M.; Gao, B.; Chen, H. Real-time high-precision nonlinear tracking control of autonomous vehicles using fast iterative model predictive control. IEEE Trans. Intell. Veh. 2024, 9, 3644–3657. [Google Scholar] [CrossRef] [Scilit]
- Li, L.; Miao, Y.; Qureshi, A.H.; Yip, M.C. MPC-MPNet: Model-predictive motion planning networks for fast, near-optimal planning under kinodynamic constraints. IEEE Robot. Autom. Lett. 2021, 6, 4496–4503. [Google Scholar] [CrossRef] [Scilit]
- Askari, I.; Vaziri, A.; Tu, X.; Zeng, S.; Fang, H. Model predictive inferential control of neural state-space models for autonomous vehicle motion planning. IEEE Trans. Robot. 2025, 41, 3202–3222. [Google Scholar] [CrossRef] [Scilit]
- Wahyuni, S.; Fuad, M.; Hilda, A.D.D.; Umam, F.; Latif, M. Enhancing Mobile Robot Stability and Roaming Capability Using Fuzzy-PID Control Method. In Proceedings of the 2023 IEEE 9th Information Technology International Seminar (ITIS); IEEE: Piscataway, NJ, USA, 2023; pp. 1–6. [Google Scholar]
- Tolossa, T.D.; Gunasekaran, M.; Halder, K.; Verma, H.K.; Parswal, S.S.; Jorwal, N.; Joseph, F.O.M.; Hote, Y.V. Trajectory tracking control of a mobile robot using fuzzy logic controller with optimal parameters. Robotica 2024, 42, 2801–2824. [Google Scholar] [CrossRef] [Scilit]
- Hailu, G.L.; Yatayew, T.T. Intelligent trajectory tracking in autonomous plantation robots using PSO-tuned nonlinear fuzzy PID, fuzzy PID, and conventional PID controllers. Sci. Rep. 2025, 15, 45357. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Pérez-Juárez, J.G.; García-Martínez, J.R.; Medina Santiago, A.; Cruz-Miguel, E.E.; Olmedo-García, L.F.; Barra-Vázquez, O.A.; Rojas-Hernández, M.A. Kinematic fuzzy logic-based controller for trajectory tracking of wheeled mobile robots in virtual environments. Symmetry 2025, 17, 301. [Google Scholar] [CrossRef] [Scilit]
- Benaicha, I.; Nechadi, E.; Boutalbi, O.; Essounbouli, N. An Improved Fuzzy Logic Controller for Mobile Robots Navigation in Unknown Environments. J. Field Robot. 2026, 43, 257–278. [Google Scholar] [CrossRef] [Scilit]
- He, H.; Liu, Q.; Shentu, S.; Gong, Z. Trajectory tacking controller design for wheeled robots in multi-robot cooperative transport. J. Mech. Eng. 2024, 60, 145–155. [Google Scholar] [CrossRef] [Scilit]
- Cosenza, C.; Malfi, P.; Melluso, F.; Nicolella, A.; Niola, V.; Savino, S.; Spirto, M.; Tordela, C. A Virtual Sensor for Wheel Angular Speed Estimation: Application on a Differential Drive Wheeled Robot. J. Intell. Robot. Syst. 2025, 111, 117. [Google Scholar] [CrossRef] [Scilit]
- You, S.; Li, M.; Wu, B.; Wang, J.; Tang, C. Digital Twin of Coal Mine Rescue Robot—Research on Intelligence and Visualization. Sensors 2026, 26, 2840. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, Y.; Li, M.; Zhu, H.; Hu, E.; Tang, C.; Li, P.; You, S. Development and applications of rescue robots for explosion accidents in coal mines. J. Field Robot. 2020, 37, 466–489. [Google Scholar] [CrossRef] [Scilit]
































| Property | ZDY4000LK Drilling Robot | ZY30LK Drill Pipe Transport Robot |
|---|---|---|
| Dimensions (L × W × H) | 5500 mm × 1250 mm × 2280 mm | 5050 mm × 1150 mm × 1850 mm |
| Mass | 8300 kg | 6500 kg (unloaded) |
| Chassis type | Tracked | Tracked |
| Travel speed | 0.9 km/h | 0.9 km/h |
| Drive mode | Hydraulic | Hydraulic |
| Motion mode | Differential drive | Differential drive |
| Gradeability | 15° | 15° |
| Supply voltage | 1140 V | 1140 V |
| Parameter | Matrix |
|---|---|
| Intrinsic matrix | |
| Distortion coefficient matrix | [−0.117210 0.110626 −0.001189 −0.002173 0] |
| Rectification matrix | |
| Projection matrix |
| ec | NB | NM | NS | ZO | PS | PM | PB | |
|---|---|---|---|---|---|---|---|---|
| e | ||||||||
| NB | PB | PB | PM | PM | PS | ZO | ZO | |
| NM | PB | PB | PM | PS | PS | ZO | NS | |
| NS | PM | PM | PM | PS | ZO | NS | NS | |
| ZO | PM | PM | PS | ZO | NS | NM | NM | |
| PS | PS | PS | ZO | NS | NS | NM | NM | |
| PM | PS | ZO | NS | NM | NM | NM | NB | |
| PB | ZO | ZO | NM | NM | NM | NB | NB | |
| ec | NB | NM | NS | ZO | PS | PM | PB | |
|---|---|---|---|---|---|---|---|---|
| e | ||||||||
| NB | NB | NB | NM | NM | NS | ZO | ZO | |
| NM | NB | NB | NM | NS | NS | ZO | ZO | |
| NS | NB | NM | NS | NS | ZO | PS | PS | |
| ZO | NM | NM | NS | ZO | PS | PM | PM | |
| PS | NM | NS | ZO | PS | PS | PM | PB | |
| PM | ZO | ZO | PS | PS | PM | PB | PB | |
| PB | ZO | ZO | PS | PM | PM | PB | PB | |
| ec | NB | NM | NS | ZO | PS | PM | PB | |
|---|---|---|---|---|---|---|---|---|
| e | ||||||||
| NB | PS | NS | NB | NB | NB | NM | PS | |
| NM | PS | NS | NB | NM | NM | NS | ZO | |
| NS | ZO | NS | NM | NM | NS | NS | ZO | |
| ZO | ZO | NS | NS | NS | NS | NS | ZO | |
| PS | ZO | ZO | ZO | ZO | ZO | ZO | ZO | |
| PM | PB | NS | PS | PS | PS | PS | PB | |
| PB | PB | PM | PM | PM | PS | PS | PB | |
| Parameter | Front Robot Planning Speed | Rear Robot Tracking Speed | Navigation Interval | Arrival Threshold | Desired Tracking Distance | Confidence Threshold |
|---|---|---|---|---|---|---|
| Value | 0.2 m/s | 0.25 m/s | 8 s | Φ 0.2 m | 0.3 m | 0.6 |
| No. | True Value/m | Actual Value/m | Error/m | Std Dev/m |
|---|---|---|---|---|
| 1 | (2, 0, 0) | (1.84, −0.01, 0) | 0.160 | - |
| 2 | (4, 0, 0) | (3.85, 0, 0) | 0.150 | - |
| 3 | (8, 0, 0) | (7.89, −0.12, 0) | 0.163 | - |
| 4 | (10, 0, 0) | (9.84, 0.02, 0) | 0.161 | - |
| 5 | (12, 0, 0) | (11.87, −0.03, 0) | 0.133 | - |
| 6 | (15, 0, 0) | (14.85, 0.04, 0) | 0.155 | - |
| 7 | (18, −2, 0) | (17.88, −1.89, 0) | 0.163 | - |
| 8 | (18, −6, 0) | (17.93, −5.85, 0) | 0.166 | - |
| Average error | 0.156 | 0.0107 |
| No. | True Value/m | Actual Value/m | Error/m | Std Dev/m |
|---|---|---|---|---|
| 1 | (2, 0) | (1.86, −0.082) | 0.162 | - |
| 2 | (4, 0) | (3.862, −0.113) | 0.178 | - |
| 3 | (6, 0) | (6.139, −0.052) | 0.148 | - |
| 4 | (8.5, 1) | (8.407, 0.873) | 0.157 | - |
| 5 | (8.5, 2) | (8.485, 1.841) | 0.160 | - |
| 6 | (8.5, 4) | (8.437, 3.826) | 0.185 | - |
| 7 | (8.5, 6) | (8.426, 5.862) | 0.157 | - |
| 8 | (8.5, 7) | (8.415, 6.847) | 0.175 | - |
| Average error | 0.165 | 0.0126 |
| No. | True Value/m | Actual Value/m | Error/m | Std Dev/m |
|---|---|---|---|---|
| 1 | (2, 0) | (1.845, −0.047) | 0.162 | - |
| 2 | (4, 0) | (3.823, −0.051) | 0.184 | - |
| 3 | (6, 0) | (6.097, 0.136) | 0.167 | - |
| 4 | (8.5, 1) | (8.39, 0.895) | 0.152 | - |
| 5 | (8.5, 2) | (8.368, 1.862) | 0.191 | - |
| 6 | (8.5, 4) | (8.37, 3.895) | 0.167 | - |
| 7 | (8.5, 6) | (8.405, 5.84) | 0.186 | - |
| 8 | (8.5, 8) | (8.408, 7.83) | 0.193 | - |
| Average error | 0.175 | 0.0152 |
| Parameter | Front Robot Planning Speed | Rear Robot Tracking Speed | Arrival Threshold | Desired Tracking Distance | Confidence Threshold |
|---|---|---|---|---|---|
| Value | 0.15 m/s | 0.25 m/s | Φ 0.1 m | 1.2 m | 0.6 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
You, S.; Tang, C.; Li, M.; Duan, Y. Research on a Tracking Control Method Assisted by Visual Targets in the Autonomous Navigation Task of a Split Drilling Robot. Appl. Sci. 2026, 16, 5929. https://doi.org/10.3390/app16125929
You S, Tang C, Li M, Duan Y. Research on a Tracking Control Method Assisted by Visual Targets in the Autonomous Navigation Task of a Split Drilling Robot. Applied Sciences. 2026; 16(12):5929. https://doi.org/10.3390/app16125929
Chicago/Turabian StyleYou, Shaoze, Chaoquan Tang, Menggang Li, and Yufeng Duan. 2026. "Research on a Tracking Control Method Assisted by Visual Targets in the Autonomous Navigation Task of a Split Drilling Robot" Applied Sciences 16, no. 12: 5929. https://doi.org/10.3390/app16125929
APA StyleYou, S., Tang, C., Li, M., & Duan, Y. (2026). Research on a Tracking Control Method Assisted by Visual Targets in the Autonomous Navigation Task of a Split Drilling Robot. Applied Sciences, 16(12), 5929. https://doi.org/10.3390/app16125929

