1. Introduction
Teleoperation systems are designed to extend the capabilities of human operators to remote locations, allowing for the safe execution of physical tasks while avoiding human exposure or transport to unsafe and/or distant environments. The human operator interacts with the workspace using a haptic device, known as the leader, which issues motion commands to the follower robot while simultaneously receiving multimodal feedback, including real-time force feedback. The operator is an integral part of the closed-loop bilateral control scheme, where stability and transparency are critical concerns [
1]. These properties are typically in conflict—improving transparency often degrades stability, and vice versa. Both are strongly influenced by time delays, control architecture, and parameter tuning [
2]. Teleoperation systems have a wide range of applications across various fields, including rescue and surveillance, mining, exploration, and industrial services, among others [
3]. Many teleoperation-based applications can be effectively addressed using unmanned ground vehicles (UGVs) such as skid-steering mobile robots (SSMRs). This system provides low-cost maintenance, good handling, and mechanical simplicity by eliminating the need for a steering mechanism. Instead, heading control relies on differential velocities, at the expense of lateral wheel skidding [
4].
One of the main challenges in robot teleoperation arises from the detrimental effects of time-varying delays [
5,
6]. A widely adopted approach for designing control schemes in these delayed systems, applied to manipulators, unmanned vehicles, mobile manipulators, and even humanoid robots, is based on dissipating sufficient kinetic energy, depending on the time delay, to ensure bounded coordination errors at the cost of making the system slower [
7,
8,
9,
10,
11]. Furthermore, SSMRs have a kinematic mismatch with the leader, and the dynamic and underactuated nature of SSMRs, coupled with terrain interactions, introduces additional modeling uncertainties that complicate the direct application of classic teleoperation techniques. Enhancing performance requires addressing the interactions between the robot and the terrain, particularly in slippery conditions, while also accounting for the inherent uncertainties in the dynamic behavior of the robot, as discussed in [
12].
One effective approach to mitigate the effects of time-varying delays, ground–robot interactions, and uncertain dynamics is the use of adaptive robust neural compensation methods, which are widely recognized for their ability to compensate for nonlinearities and external disturbances. These methods typically combine Adaptive Control [
13,
14,
15], Robust Control [
16], and neural networks [
17]. Unlike conventional control methods, this approach enables online adaptation of controller parameters, and numerous studies have confirmed the advantages of neural networks in real-time approximation and dynamic adaptation, improving control accuracy and flexibility in various teleoperation contexts and enabling effective compensation of uncertainties that typically hinder system responsiveness and stability [
18,
19,
20]. However, the optimal control structure for compensating the time-varying delays in bilateral teleoperation of skid-steering mobile robots remains an open question. Furthermore, the current state of the art does not yet provide a generalized solution for how neural networks should be integrated with traditional teleoperation schemes to control the coordination errors, taking advantage of the strengths of both strategies in the face of time delays.
Table 1 presents a general comparison between the method proposed in this paper and other recent approaches within the same teleoperation framework.
In [
21,
22], neural networks and genetic algorithms are used to predict human commands and slippage forces, whereas, in [
23], predictors are not used, but dynamics and ground–robot interactions are compensated at the remote site. Comparison items include stability test coverage, convergence characteristics, considered delays, leader and follower models, and the role of neural networks. Notably, the standardization of the specific role and function of neural networks in teleoperated control schemes remains an open challenge as it is still unclear what the network should effectively accomplish in these systems.
In this work, a neural network control approach is proposed for a delayed bilateral teleoperation system, aiming to perform time-varying delay compensation in a shared manner between damping-controlled injection and two neural networks. Additionally, the latter is employed to compensate for the unknown dynamics of both the leader and the follower, as well as uncertainties and ground–robot interactions. The main contributions of this paper are listed below:
A neural network control scheme is designed to address unknown system dynamics and ground–robot interactions. The compensation of negative effects caused by time-varying delays is distributed between two neural networks and controlled injection of damping.
A rigorous analysis of the bilateral closed-loop teleoperation system is provided, focusing on the control parameter conditions necessary to ensure the convergence of coordination errors despite the presence of time delays and ground–robot dynamic interactions.
The proposed theory is validated through numerical simulations. In these tests, a two-degrees-of-freedom manipulator robot is used to represent the leader, while the follower replicates the dynamics of a skid-steering mobile robot, including ground–robot interactions. The results demonstrate the effectiveness of the control scheme in managing time delays under various operating conditions.
The content of this document is organized as follows:
Section 2 presents the mathematical background.
Section 3 addresses the design of the leader–follower controller and the stability analysis of the delayed system.
Section 4 presents the results of numerical simulations considering different terrains and delays. Finally,
Section 5 concludes the document.
Table 1.
Comparison of the proposed method against previously reported NN-based strategies for delayed bilateral teleoperation of mobile robots.
Table 1.
Comparison of the proposed method against previously reported NN-based strategies for delayed bilateral teleoperation of mobile robots.
Reference | Stability | Delay | Model | Neural Networks |
---|
Slawiñski et al. (2024) [23] | Lyapunov–Krasovskii Criterion, coordination error bounded, convergence to zero in the absence of external forces | Variable | Dynamic UGV including ground–robot interaction | One NN LSTM system to compensate unknown dynamics and ground–robot interaction |
Ahmad et al. (2024) [21] | Llewellyn’s Criterion of bounded input/bounded output | Constant | Modified kinematic model for the rover subjected to longitudinal slippage | Two genetic algorithms applied as model-free predictors for estimation of slippage and commands |
Abubakar et al. (2024) [22] | N/A | Constant | Modified kinematic model for the UGV on soft terrains | Two NN LSTM systems applied as predictors for estimation of slippage and commands |
Proposed | Lyapunov–Krasovskii Criterion, coordination errors bounded, convergence to zero in the absence of external forces | Variable | Dynamic UGV including ground–robot interaction | Two NN FLNN systems to compensate unknown dynamics and ground–robot interaction as well as partially mitigate the effects of the time-varying delay |
5. Conclusions
This work presented a neural network-based control strategy for the bilateral teleoperation of a skid-steering mobile robot. The approach leverages neural networks to jointly compensate for communication time delays and system dynamics, including leader, follower, and ground–robot interaction, through controlled damping injection. The proposed method improves robustness and adaptability in the presence of communication delays and model mismatches between the leader and follower systems.
The analytical results provided give design guidelines for selecting the damping coefficient as a function of communication delay within the neural control framework. The simulation results demonstrated that this delay-sensitive tuning leads to lower coordination errors compared to fixed-gain approaches, in accordance with the expected outcomes. The difference in the tracking error using the parameters laid out by the Lyapunov analysis with respect to the empirical fixed adjustment increases as the time delay increases. In the tracking error, the RMS value of the angular velocity is 80% lower if the proposed setting (Setting B) is applied in the worst tested scenario, .
It is important to note that, in this practical implementation, real-time buffering is not required since the input vectors are composed of signals that are already available at the local and remote sites at the corresponding time steps. Therefore, no additional memory management or time-alignment mechanisms are needed during execution. However, data loss or large delays can occur. For brief communication dropouts, a local estimator such as a Kalman filter can be employed to temporarily reconstruct the missing information. However, if the communication loss exceeds a predefined safety threshold, the robot is programmed to stop its motion and alert the human operator to avoid executing further commands under uncertain conditions. The current simulation-based results are a valuable preliminary step that provides an insight into the control strategy’s behavior and supports its potential for future experimental evaluation, which should include testing in unstructured environments with both static and dynamic obstacles to further assess the system’s real-world applicability.