Successive Reference-Pose Tracking for Delay-Robust Vehicle Teleoperation: A Real-World Experimental Evaluation
Abstract
1. Introduction
1.1. Related Work
1.2. Previous Work and the SRPT Approach
1.3. Contribution of Paper
1.4. Outline of Paper
2. Methodology
2.1. Experimental Platform
- Control Station: The remote operator was provided with a standard automotive interface, including a force-feedback steering wheel and pedals. A monitor displayed a first-person video feed from the vehicle, providing the operator with their primary visual feedback, as shown in Figure 1a.
- Remote Vehicle: A test vehicle was equipped for drive-by-wire operation, allowing for electronic control of steering and speed, as shown in Figure 1b.
- Communication Link: A 5G mobile communication network is utilised for bidirectional data transmission. This link carried video data from the vehicle to the station (downlink) and control commands from the station to the vehicle (uplink), introducing real-world network latency into the system.
2.2. Test Track and Manoeuvres
- ■
- Cornering: An almost constant-radius corner to assess steady-state tracking performance.
- ■
- Double Lane Change: A rapid lane-change manoeuvre to evaluate transient response and stability under high-frequency steering inputs.
- ■
- Slalom: A series of alternating turns designed to induce oscillatory behavior in delay-affected systems. The length of this section and the number of turns are restricted due to the limited length of the road. However, significant oscillation induced by delay is observed during the test with the No-Controller mode.
2.3. Driving and Vehicle Teleoperation Modes
- Manual-In-Vehicle: The operator drove the vehicle from inside the vehicle. This mode served as the performance baseline, representing control with zero latency.
- Tele-No Controller: Steering commands from the operator were transmitted directly to the vehicle and executed after incurring network delay. This represents the baseline teleoperation challenge.
- Tele-Smith Predictor: The predictive control mode [13,17] was implemented as a benchmark for delay compensation techniques. A model-based predictor was used to provide the operator with feedback that compensated for the round-trip network delay.The Smith Predictor uses the same 7-state slip-based single-track model as the NMPC—states (sideslip, yaw rate, heading, front and rear axle forces, CG position). Both the predictor and the NMPC share the vehicle parameters in Table 1, ensuring a symmetric and fair comparison. The predictor operates in two stages. In the propagation stage, the model state is integrated using the current vehicle speed v and joystick angle ; the result is stored in a circular buffer indexed by the current timestamp. In the display stage, at each video frame received, the predictor predicts the state for time , as per Equation (3) of Prakash et al. [18].
- Tele-SRPT: In the new architecture [18], the operator’s steering inputs were used to generate a sequence of future reference poses at the control station. These poses were transmitted to (rover) vehicle, where the onboard NMPC calculated the optimal steering and speed commands to track them, subject to the vehicle’s dynamic constraints.Control station: Converting operator steering input into reference poses involves generating a look-ahead pose for the vehicle relative to the received pose, while accounting for the joystick steering angle, executed at the video frame rate (≈30 Hz).Delay-compensated lookahead distance is set towhere v is the latest measured vehicle speed and is deliberately set equal to the NMPC prediction horizon (). This choice gives SRPT a fundamental delay-compensation property: the vehicle advances metres during the network transit, so when the pose arrives, it is exactly metres ahead—the desired terminal state of the NMPC planning horizon—regardless of the instantaneous value of (provided the speed is approximately constant during round-trip network delay). At the nominal round-trip delay of ms, this property holds with a safety margin, meaning network delay can increase nearly fourfold before the pose falls outside the planning horizon. In the event of extreme delay spikes, the onboard NMPC naturally moderates vehicle speed to bring the distant pose back within its kinematic reach, providing a graceful degradation of performance rather than instability. This mechanism directly explains the adaptive speed moderation behaviour as will be discussed in Section 3.2.Rover: While the comprehensive mathematical framework of the slip-based vehicle model is detailed in our previous simulation study [18], the core parameters configured for this physical deployment are vital for experimental reproducibility. The onboard NMPC manages a state vector of variables——and a control vector of inputs—. The optimization problem is solved using the real-time ACADOS solver over a prediction horizon of s, discretised into shooting nodes with a sampling interval of ms. The stage cost matrix is parameterised as to penalise steering rate, acceleration, and tracking velocity deviations, deliberately giving the NMPC the flexibility to moderate speed to maintain lateral stability, while the terminal Mayer cost matrix is set to to enforce alignment of reference pose with vehicle path. Physical actuator boundaries are strictly handled via hard constraints matching the drive-by-wire system limits: steering angle is capped at , front-wheel steering rate is limited to (corresponding to the steering-wheel rate constraint). Vehicle acceleration is bounded between a comfort limit of and a maximum braking limit of .
2.4. Network Delay and Data Transmission
- Uplink Delay (): This is the delay for control data (reference poses for SRPT; steering commands for other modes) to travel from the control station to the vehicle. It primarily includes network transmission latency.
- Downlink Delay (): This is the delay for the vehicle’s sensor data (primarily the video feed) to reach the control station. It is a composite of camera exposure and readout time, video encoding latency, network transmission delay, and the final decoding and display latency at the operator’s interface. The downlink delay is typically larger and has a greater impact on the operator’s situational awareness.
Clock Synchronisation and Delay Measurement
2.5. Experimental Protocol
2.6. Data Analysis and Metrics
- Mean Cross-Track Error (m): The average deviation of the vehicle’s front from the track’s centreline.
- Max Cross-Track Error (m): The max deviation of the vehicle’s front from the track’s centreline.
- Completion Time (s): Manoeuvre completion time.
3. Results and Discussion
3.1. Path Tracking Performance in the Demanding Slalom
3.2. Analysis of Steer and Speed Demands During Slalom
3.3. Comprehensive Performance Metrics Across All Three Manoeuvres
3.4. Extended Validation at Slightly Higher Speed
3.5. Limitations of the Current Study
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AD | Automated Driving |
| DOF | Degree of Freedom |
| FOV | Field Of View |
| IMU | Inertial Measurement Unit |
| NMPC | Non-linear Model-Predictive Control |
| ROS2 | Robot Operating System 2 |
| SRT | Secure Reliable Transport |
| SRPT | Successive Reference-Pose Tracking |
| Maximum Cross-Track Error | |
| Mean Cross-Track Error | |
| T | Completion time |
| Uplink Delay | |
| Downlink Delay | |
| Mean |
References
- Majstorović, D.; Hoffmann, S.; Pfab, F.; Schimpe, A.; Wolf, M.M.; Diermeyer, F. Survey on Teleoperation Concepts for Automated Vehicles. In Proceedings of the 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC); IEEE: New York, NY, USA, 2022; pp. 1290–1296. [Google Scholar]
- Mutzenich, C.; Durant, S.; Helman, S.; Dalton, P. Updating our understanding of situation awareness in relation to remote operators of autonomous vehicles. Cogn. Res. Princ. Implic. 2021, 6, 9. [Google Scholar] [CrossRef] [PubMed]
- Hoffmann, S.; Diermeyer, F. Systems-theoretic Safety Assessment of Teleoperated Road Vehicles. In Proceedings of the 7th International Conference on Vehicle Technology and Intelligent Transport Systems-Volume 1: VEHITS. INSTICC; SciTePress: Setúbal, Portugal, 2021; pp. 446–456. [Google Scholar]
- Saparia, S.; Schimpe, A.; Ferranti, L. Active Safety System for Semi-Autonomous Teleoperated Vehicles. In Proceedings of the 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops); IEEE: New York, NY, USA, 2021; pp. 141–147. [Google Scholar]
- Qiao, B.; Li, H.; Wu, X. Intelligent-Assist Algorithm for Remote Shared-Control Driving Based on Game Theory. J. Shanghai Jiaotong Univ. (Sci.) 2021, 26, 615–625. [Google Scholar]
- Schitz, D.; Graf, G.; Rieth, D.; Aschemann, H. Model-Predictive Cruise Control for Direct Teleoperated Driving Tasks. In Proceedings of the 2021 European Control Conference (ECC); IEEE: New York, NY, USA, 2021; pp. 1808–1813. [Google Scholar]
- Chucholowski, F.; Büchner, S.; Reicheneder, J.; Lienkamp, M. Prediction methods for teleoperated road vehicles. In Proceedings of the Conference on Future Automotive Technology-Focus Electromobility, Garching bei München, Germany; Springer Vieweg: Wiesbaden, Germany, 2013. [Google Scholar]
- Hosseini, A.; Richthammer, F.; Lienkamp, M. Predictive Haptic Feedback for Safe Lateral Control of Teleoperated Road Vehicles in Urban Areas. In Proceedings of the 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring); IEEE: New York, NY, USA, 2016; pp. 1–7. [Google Scholar]
- Brudnak, M.J. Predictive displays for high latency teleoperation. In Proceedings of the 2016 Ground Vehicle Systems Engineering and Technology Symposium; National Defense Industrial Association: Arlington, VA, USA, 2016. [Google Scholar]
- Chen, T. Methods for Improving the Control of Teleoperated Vehicles. Ph.D. Thesis, Technical University of Munich, Munich, Germany, 2015. [Google Scholar]
- Zheng, Y.; Brudnak, M.J.; Jayakumar, P.; Stein, J.L.; Ersal, T. A Delay Compensation Framework for Predicting Heading in Teleoperated Ground Vehicles. IEEE/ASME Trans. Mechatron. 2019, 24, 2365–2376. [Google Scholar] [CrossRef]
- Zheng, Y.; Brudnak, M.J.; Jayakumar, P.; Stein, J.L.; Ersal, T. Evaluation of a Predictor-Based Framework in High-Speed Teleoperated Military UGVs. IEEE Trans. Hum.-Mach. Syst. 2020, 50, 561–572. [Google Scholar]
- Smith, J.M. Closer Control of Loops with Dead Time. Chem. Eng. Prog. 1957, 53, 217–219. [Google Scholar]
- Hoffmann, S.; Majstorović, D.; Diermeyer, F. Safe Corridor: A Trajectory-Based Safety Concept for Teleoperated Road Vehicles. In Proceedings of the 2022 International Conference on Connected Vehicle and Expo (ICCVE); IEEE: New York, NY, USA, 2022; pp. 1–6. [Google Scholar]
- Schitz, D.; Graf, G.; Rieth, D.; Aschemann, H. Interactive Corridor-Based Path Planning for Teleoperated Driving. In Proceedings of the 2021 7th International Conference on Mechatronics and Robotics Engineering (ICMRE); IEEE: New York, NY, USA, 2021. [Google Scholar]
- Ji, X.A.; Avedisov, S.S.; Khan, M.I.; Vörös, I.; Altintas, O.; Orosz, G. On the effects of latency in teleoperated driving: Stability and performance analysis. Veh. Syst. Dyn. 2025, 1–23. [Google Scholar] [CrossRef]
- Prakash, J.; Vignati, M.; Sabbioni, E. Performance of Successive Reference Pose Tracking vs. Smith Predictor Approach for Direct Vehicle Teleoperation under Variable Network Delays. IEEE Trans. Veh. Technol. 2024, 73, 4636–4645. [Google Scholar]
- Prakash, J.; Vignati, M.; Sabbioni, E.; Cheli, F. Vehicle Teleoperation: Human in the Loop Performance Comparison of Smith Predictor with Novel Successive Reference-Pose Tracking Approach. Sensors 2022, 22, 9119. [Google Scholar] [CrossRef] [PubMed]











| Parameter | Symbol | Value | Unit |
|---|---|---|---|
| Total mass | m | 740.0 | kg |
| Front axle mass | 314.0 | kg | |
| Rear axle mass | 426.0 | kg | |
| Wheelbase | L | 1.770 | m |
| CG to front axle | 0.792 | m | |
| CG to rear axle | 0.973 | m | |
| Yaw moment of inertia | J | 635.4 | kg m2 |
| Front cornering stiff. | 27,673 | N/rad | |
| Rear cornering stiff. | 38,738 | N/rad | |
| Tyre relaxation length | 0.30 | m | |
| Steering ratio | 18 | – |
| Dimension | Tele-No Ctrl | Tele-Smith | Tele-SRPT |
|---|---|---|---|
| Latency robustness | None | Moderate | High |
| Model accuracy dependence | None | Critical | Low |
| Path-tracking accuracy | Poor | Moderate | Best |
| Actuator constraint awareness | No | No | Yes |
| Proactive speed modulation | No | No | Yes |
| Onboard compute requirement | None | None | NMPC |
| HMI modification required | None | Display overlay | Display overlay |
| Stable at 13 km/h (this study) | Unsafe * | Unsafe * | Yes |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Prakash, J.; Belloni, M.; Vignati, M.; Sabbioni, E. Successive Reference-Pose Tracking for Delay-Robust Vehicle Teleoperation: A Real-World Experimental Evaluation. Electronics 2026, 15, 2743. https://doi.org/10.3390/electronics15122743
Prakash J, Belloni M, Vignati M, Sabbioni E. Successive Reference-Pose Tracking for Delay-Robust Vehicle Teleoperation: A Real-World Experimental Evaluation. Electronics. 2026; 15(12):2743. https://doi.org/10.3390/electronics15122743
Chicago/Turabian StylePrakash, Jai, Mattia Belloni, Michele Vignati, and Edoardo Sabbioni. 2026. "Successive Reference-Pose Tracking for Delay-Robust Vehicle Teleoperation: A Real-World Experimental Evaluation" Electronics 15, no. 12: 2743. https://doi.org/10.3390/electronics15122743
APA StylePrakash, J., Belloni, M., Vignati, M., & Sabbioni, E. (2026). Successive Reference-Pose Tracking for Delay-Robust Vehicle Teleoperation: A Real-World Experimental Evaluation. Electronics, 15(12), 2743. https://doi.org/10.3390/electronics15122743

