Next Article in Journal
Creating Tail Dependence by Rough Stochastic Correlation Satisfying a Fractional SDE; An Application in Finance
Previous Article in Journal
Analyzing Systemic Risk Spillover Networks Through a Time-Frequency Approach
Previous Article in Special Issue
Exponential Trajectory Tracking Control of Nonholonomic Wheeled Mobile Robots
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Neural Networks in the Delayed Teleoperation of a Skid-Steering Robot

by
Kleber Patiño
1,†,
Emanuel Slawiñski
1,*,†,
Marco Moran-Armenta
2,†,
Vicente Mut
1,†,
Francisco G. Rossomando
1,† and
Javier Moreno-Valenzuela
2,†
1
Instituto de Automática, Universidad Nacional de San Juan, San Juan J5400ARY, Argentina
2
Centro de Investigación y Desarollo de Tecnología Digital, Instituto Politécnico Nacional, Tijuana 22435, Mexico
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Mathematics 2025, 13(13), 2071; https://doi.org/10.3390/math13132071
Submission received: 19 May 2025 / Revised: 10 June 2025 / Accepted: 19 June 2025 / Published: 23 June 2025
(This article belongs to the Special Issue Advanced Control Theory in Robot System)

Abstract

Bilateral teleoperation of skid-steering mobile robots with time-varying delays presents significant challenges in ensuring accurate leader–follower coupling. This article presents a novel controller for a bilateral teleoperation system composed of a robot manipulator and a skid-steering mobile robot. The proposed controller leverages neural networks to compensate for ground–robot interactions, uncertain dynamics, and communication delays. The control strategy integrates a shared scheme between damping injection and two neural networks, enhancing the robustness and adaptability of the delayed system. A rigorous theoretical analysis of the closed-loop teleoperation system is provided, establishing conditions of control parameters to ensure stability and convergence of the coordination errors. The proposed method is validated through numerical testing, demonstrating strong agreement between theoretical outcomes and simulation results.

1. Introduction

Teleoperation systems are designed to extend the capabilities of human operators to remote locations, allowing for the safe execution of physical tasks while avoiding human exposure or transport to unsafe and/or distant environments. The human operator interacts with the workspace using a haptic device, known as the leader, which issues motion commands to the follower robot while simultaneously receiving multimodal feedback, including real-time force feedback. The operator is an integral part of the closed-loop bilateral control scheme, where stability and transparency are critical concerns [1]. These properties are typically in conflict—improving transparency often degrades stability, and vice versa. Both are strongly influenced by time delays, control architecture, and parameter tuning [2]. Teleoperation systems have a wide range of applications across various fields, including rescue and surveillance, mining, exploration, and industrial services, among others [3]. Many teleoperation-based applications can be effectively addressed using unmanned ground vehicles (UGVs) such as skid-steering mobile robots (SSMRs). This system provides low-cost maintenance, good handling, and mechanical simplicity by eliminating the need for a steering mechanism. Instead, heading control relies on differential velocities, at the expense of lateral wheel skidding [4].
One of the main challenges in robot teleoperation arises from the detrimental effects of time-varying delays [5,6]. A widely adopted approach for designing control schemes in these delayed systems, applied to manipulators, unmanned vehicles, mobile manipulators, and even humanoid robots, is based on dissipating sufficient kinetic energy, depending on the time delay, to ensure bounded coordination errors at the cost of making the system slower [7,8,9,10,11]. Furthermore, SSMRs have a kinematic mismatch with the leader, and the dynamic and underactuated nature of SSMRs, coupled with terrain interactions, introduces additional modeling uncertainties that complicate the direct application of classic teleoperation techniques. Enhancing performance requires addressing the interactions between the robot and the terrain, particularly in slippery conditions, while also accounting for the inherent uncertainties in the dynamic behavior of the robot, as discussed in [12].
One effective approach to mitigate the effects of time-varying delays, ground–robot interactions, and uncertain dynamics is the use of adaptive robust neural compensation methods, which are widely recognized for their ability to compensate for nonlinearities and external disturbances. These methods typically combine Adaptive Control [13,14,15], Robust Control [16], and neural networks [17]. Unlike conventional control methods, this approach enables online adaptation of controller parameters, and numerous studies have confirmed the advantages of neural networks in real-time approximation and dynamic adaptation, improving control accuracy and flexibility in various teleoperation contexts and enabling effective compensation of uncertainties that typically hinder system responsiveness and stability [18,19,20]. However, the optimal control structure for compensating the time-varying delays in bilateral teleoperation of skid-steering mobile robots remains an open question. Furthermore, the current state of the art does not yet provide a generalized solution for how neural networks should be integrated with traditional teleoperation schemes to control the coordination errors, taking advantage of the strengths of both strategies in the face of time delays. Table 1 presents a general comparison between the method proposed in this paper and other recent approaches within the same teleoperation framework.
In [21,22], neural networks and genetic algorithms are used to predict human commands and slippage forces, whereas, in [23], predictors are not used, but dynamics and ground–robot interactions are compensated at the remote site. Comparison items include stability test coverage, convergence characteristics, considered delays, leader and follower models, and the role of neural networks. Notably, the standardization of the specific role and function of neural networks in teleoperated control schemes remains an open challenge as it is still unclear what the network should effectively accomplish in these systems.
In this work, a neural network control approach is proposed for a delayed bilateral teleoperation system, aiming to perform time-varying delay compensation in a shared manner between damping-controlled injection and two neural networks. Additionally, the latter is employed to compensate for the unknown dynamics of both the leader and the follower, as well as uncertainties and ground–robot interactions. The main contributions of this paper are listed below:
  • A neural network control scheme is designed to address unknown system dynamics and ground–robot interactions. The compensation of negative effects caused by time-varying delays is distributed between two neural networks and controlled injection of damping.
  • A rigorous analysis of the bilateral closed-loop teleoperation system is provided, focusing on the control parameter conditions necessary to ensure the convergence of coordination errors despite the presence of time delays and ground–robot dynamic interactions.
  • The proposed theory is validated through numerical simulations. In these tests, a two-degrees-of-freedom manipulator robot is used to represent the leader, while the follower replicates the dynamics of a skid-steering mobile robot, including ground–robot interactions. The results demonstrate the effectiveness of the control scheme in managing time delays under various operating conditions.
The content of this document is organized as follows: Section 2 presents the mathematical background. Section 3 addresses the design of the leader–follower controller and the stability analysis of the delayed system. Section 4 presents the results of numerical simulations considering different terrains and delays. Finally, Section 5 concludes the document.
Table 1. Comparison of the proposed method against previously reported NN-based strategies for delayed bilateral teleoperation of mobile robots.
Table 1. Comparison of the proposed method against previously reported NN-based strategies for delayed bilateral teleoperation of mobile robots.
ReferenceStabilityDelayModelNeural Networks
Slawiñski et al. (2024) [23]Lyapunov–Krasovskii Criterion, coordination error e s bounded, convergence to zero in the absence of external forcesVariableDynamic UGV including ground–robot interactionOne NN LSTM system to compensate unknown dynamics and ground–robot interaction
Ahmad et al. (2024) [21]Llewellyn’s Criterion of bounded input/bounded outputConstantModified kinematic model for the rover subjected to longitudinal slippageTwo genetic algorithms applied as model-free predictors for estimation of slippage and commands
Abubakar et al. (2024) [22]N/AConstantModified kinematic model for the UGV on soft terrainsTwo NN LSTM systems applied as predictors for estimation of slippage and commands
ProposedLyapunov–Krasovskii Criterion, coordination errors e m , e s bounded, convergence to zero in the absence of external forcesVariableDynamic UGV including ground–robot interactionTwo NN FLNN systems to compensate unknown dynamics and ground–robot interaction as well as partially mitigate the effects of the time-varying delay

2. Mathematical Background

In this section, the subscript i = m , s is used to denote the leader and follower sides of the system, while j = s , m represents the opposite side.

2.1. Dynamic Model of the Teleoperation System

The simplified dynamic model of a bilateral teleoperation system of a skid-steering mobile robot is given by a leader and a mobile follower, which are represented in [23]. The leader dynamics are represented by the following equation:
M m ( q m ) q ¨ m + C m ( q m , q ˙ m ) q ˙ m + g m ( q m ) = τ m + τ h ,
where q m , q ˙ m , and q ¨ m R n are vectors of the joint position, velocity, and acceleration of the leader, respectively. M m ( q m ) R n × n is the inertia matrix, C m ( q m , q ˙ m ) R n × n denotes the Coriolis and centripetal matrix, g m ( q m ) R n represents the gravitational vector, τ m R n is the control input vector, and τ h R n is the operating torque of the human operator.
Remark 1.
From now on, we suppose that n = 2 . Due to using the leader, it is possible to command the speed and angular velocity of the subactuated follower.
Furthermore, the dynamic model of the robot manipulator (1) has the following properties:
Property 1.
The inertia matrix M m ( q m ) is symmetric and positive-definite, and there exist positive constants such that
λ m i n { M m ( x ) } x 2 x T M m ( x ) x λ m a x { M m ( x ) } x 2 ,
for all x R n .
Property 2.
The matrix C m ( q m , q ˙ m ) is related to the inertia matrix M m ( q m ) by the expression
x T 1 2 M ˙ m ( q m ) C m ( q m , q ˙ m ) x = 0 , q m , q ˙ m , x R n ,
and holds C m ( q m , q ˙ m ) < γ q ˙ m [24].
On the other hand, the kinematic model of the robot, shown in Figure 1, is defined by the following equation:
q ˙ = A ( q ) v s + B ( q ) v y ,
where v s = [ v w ] denotes the linear and angular velocities of the mobile robot, q = [ x y ϕ ] represents its pose, v y corresponds to the lateral velocity, and the matrices A ( q ) and B ( q ) are defined as
A ( q ) = cos ( ϕ ) 0 sin ( ϕ ) 0 0 1 , B ( q ) = sin ( ϕ ) cos ( ϕ ) 0 ,
respectively, where ϕ is the orientation of the mobile robot with respect to the world reference frame W, which denotes a fixed coordinate system. See Figure 1 for further details.
The dynamic model is described in detail in [12] and is given by the following equation:
M s v ˙ s + N ( v s , v y , θ ) = u s + f e ,
N = P v y + F ( v s , v y ) + g s ( θ ) ,
where M s R n × n is defined as m 0 0 J , given by the mass m and inertia J of the follower system, v s = [ v ω ] T represents the speed v and the yaw angular velocity ω of the skid-steering mobile robot, u s R n × 1 is the input signal control to the follower system, including force and torque, applied to the robot body and can be inferred from the torque applied to each motor, P = [ m ω 0 ] T , F R n , and F y represent the longitudinal, angular, and lateral friction forces/torques and unmodeled dynamics, g s ( θ ) is defined as the gravity magnitude on sloped terrain with inclination θ in relation to the horizontal ground plane, and f e R n is the external environmental forces representing the interaction forces between the mobile robot and the objects in its surroundings. It is important to remark that v y represents the lateral velocity due to sideslip, modeled as follows:
m ( v ˙ y + v ω ) = F y + f e y .
where f e y R is the lateral component of the external environmental force.

2.2. Neural Network Description

In this section, a basic neural network known as a functional link neural network (FLNN) is introduced. Consider f i ( x i ) R n as a smooth function and let x i be restricted to a compact set S of R n . Then, f i ( x i ) can be approximated by a neural network as follows:
f i ( x i ) = W i T σ ( V i T x ¯ i ) + ϵ i ,
where W i R L N × n is the ideal output weights matrix, σ R L N is the activation function consisting of the hyperbolic tangent function, V i R b × L N is the input weights matrix, x ¯ i R b is the input signals vector, and ϵ i R n is the approximation error. Additionally, b is the number of input signals and L N is the number of neurons in the hidden layer.
Assumption 1.
The ideal output weights of the neural network, denoted as W i , are bounded such that W i W i M , where W i M is a known positive constant.
Assumption 2.
The approximation error of the neural network is bounded by a known positive constant ε i M such that ϵ i ( x i ) ε i M for all x i D , where D represents the input domain.

2.3. Mathematical Preliminaries

The time-varying delays included by the communication channel in the transmitted signals h ( t ) from the leader to the follower and vice versa are represented by d k , resulting in h ( t d k ( t ) ) .
Assumption 3.
The time-varying delay d k is assumed to be continuously differentiable and uniformly bounded, satisfying 0 d k T k and | d ˙ k | μ < 1 , where T k and μ are known positive constants. This ensures that the delay remains bounded and there is no data loss. In addition, k = 1 , 2 is used for the time delay from the follower to the leader and vice versa, respectively.
Lemma 1.
Barbalat’s lemma [25]. If the differentiable function L ( t ) has a finite limit as t , and if L ˙ ( t ) is uniformly continuous (or equivalently, if L ¨ ( t ) is bounded), then
lim t L ˙ ( t ) = 0 .

3. Main Result

3.1. Control Design

In practical applications, the convergence of closed-loop trajectories for delayed bilateral teleoperation systems is a key aspect. To address this, let us define e m and e s R n as the coordination error of the teleoperation system,
e m = z s ( t d 1 ) k g q m ( t ) ,
e s = k g q m ( t d 2 ) z s ( t ) ,
and r i R n as a vector, such that
r m = Λ m e m α m q ˙ m ,
r s = Λ s e s α s z ˙ s ,
where Λ m and Λ s R n × n represent a diagonal positive matrix, α i denotes a damping coefficient, and k g is a scaling gain to map a leader position to a follower velocity reference. To apply acceleration-based damping, z s holds the following relations based on a linear observer:
z ˙ s = 1 γ ( v s z s ) ,
z ¨ s = 1 γ ( v s ˙ z ˙ s ) ,
where γ is a positive gain parameter. Then, a neural network control is proposed as follows:
τ m = K m r m + W ^ m T σ ( V m T x ¯ m ) + δ m sign ( r m ) + β m q ˙ m r m Λ m 1 q ˙ m ,
u s = K s r s + W ^ s T σ ( V s T x ¯ s ) + δ s sign ( r s ) Λ s 1 z ˙ s ,
where β m is a positive gain parameter, K i and δ i R n × n are diagonal positive-definite matrices, W ^ i T R n × L N is the estimate input weights of the neural network, and sign ( . ) R n is the signum function. Figure 2 shows a block diagram of the teleoperation system, including (14) and (15), where we highlight the proposed asymmetric combination (between the leader and the follower) of damping injection, neural networks, and linear and nonlinear actions.

3.2. Closed-Loop System

In order to obtain the closed-loop dynamic bilateral teleoperation system, the time derivatives of (10) and (11) are taken:
r ˙ m = Λ m e ˙ m α m q ¨ m ,
r ˙ s = Λ s e ˙ s α s z ¨ s .
Now, including the dynamics (1) and (4) into (16) and (17) considering (8) and (9), we have
r ˙ m = Λ m e ˙ m α m M m 1 ( q m ) τ m + τ h C m ( q m , q ˙ m ) q ˙ m g m ( q m ) ) ,
r ˙ s = Λ s e ˙ s α s 1 γ v ˙ z s ˙ = Λ s e ˙ s α s 1 γ M s 1 u N + f e z s ˙ .
Using the approximation property of neural networks (7), some terms of (18) and (19) can be estimated by neural networks, respectively, as
W m T σ ( V m T x ¯ m ) + ϵ m = 1 α m M m ( q m ) Λ m e ˙ m + C m ( q m , q ˙ m ) q ˙ m + g m ( q m ) ,
W s T σ ( V s T x ¯ s ) + ϵ s = γ α s M s ( q s ) Λ s e ˙ s + N + M s z s ˙ ,
with the input vectors
x ¯ m = 1 z ˙ s T ( t d 1 ) q ˙ m T q m T r m T T ,
x ¯ s = 1 q ˙ m T ( t d 2 ) z ˙ s T z s T r s T v y T θ T ,
and suppose a time-varying delay in the input signals under Assumption 3. Here, the output weight error of neural networks (20) and (21), denoted as W ˜ i , is defined as the difference between the optimal output weight vector W i and the estimated output weight vector W ^ i of the neural network. Specifically, it is expressed as follows:
W ˜ i = W i W ^ i .
Considering (20), (21), and (22) in (18) and (19), the closed-loop bilateral teleoperation system is obtained as follows:
1 α m M m ( q m ) r ˙ m = W ˜ m T σ ( V m T x ¯ m ) K m r m δ m sign ( r m ) + Λ m 1 q ˙ m β m q ˙ m r m + ϵ m τ h ,
γ α s M s r ˙ s = W ˜ s T σ ( V s T x ¯ s ) K s r s δ s sign ( r s ) + Λ s 1 z ˙ s + ϵ s f e .
Next, the system stability will be analyzed in relation to the dynamics of r i .

3.3. Stability Analysis

For the following analysis of the closed-loop system (23) and (24), the torques applied by both the operator and the external environmental forces are considered bounded. The goal is to analyze the leader–follower coupling of the delayed bilateral teleoperation system.
Next, we consider the following positive-definite Lyapunov–Krasovskii functions as follows:
L 1 = k g 2 α m r m T M m ( q m ) r m + γ 2 α s r s T M s r s + 1 2 T r W ˜ m T Γ m 1 W ˜ m + 1 2 T r W ˜ s T Γ s 1 W ˜ s ,
L 2 = 1 2 ( z s k g q m ) T ( z s k g q m ) + k g T 2 0 t + θ t q ˙ m T ( ξ ) q ˙ m ( ξ ) d ξ d θ + k g T 1 0 t + θ t z ˙ s T ( ξ ) z ˙ s ( ξ ) d ξ d θ ,
where Γ m , Γ s R L N × L N , and M s are diagonal positive-definite matrices and M m holds by Property 1. Differentiating (25) with respect to time, we obtain
L ˙ 1 = k g α m r m T M m ( q m ) r ˙ m + k g 2 α m r m T M ˙ m ( q m ) r m + γ α s r s T M s r ˙ s + T r W ˜ m T Γ m 1 W ˜ ˙ m + T r W ˜ s T Γ s 1 W ˜ ˙ s ,
and, by substituting the closed-loop teleoperation system (23) and (24) into (27), we have
L ˙ 1 = k g r m T W ˜ m T σ ( V m T x ¯ m ) K m r m δ m sign ( r m ) + ϵ m + Λ m 1 q ˙ m β m q m ˙ r m τ h + r s T W ˜ s T σ ( V s T x ¯ s ) K s r s δ s sign ( r s ) + ϵ s + Λ s 1 z ˙ s f e + k g 2 α m r m T M ˙ m ( q m ) r m T r W ˜ m T Γ m 1 W ^ ˙ m T r W ˜ s T Γ s 1 W ^ ˙ s .
The following adaptation laws of the output weights, denoted by W ^ m and W ^ s , of the neural networks are proposed:
W ^ ˙ m = k g Γ m σ ( V m T x ¯ m ) r m T k g Γ m η m r m W ^ m ,
W ^ ˙ s = Γ s σ ( V s T x ¯ s ) r s T Γ s η s r s W ^ s ,
where η m and η s are positive constants. Next, including (29) and (30) into Equation (28) while also considering Property 2, we obtain the following:
L ˙ 1 k g r m T K m r m k g r m T δ m sign ( r m ) + T r k g W ˜ m T η m r m W ^ m + k g r m T ϵ m + r m T Λ m 1 k g q ˙ m + ( β m + γ α m ) k g q ˙ m r m T r m r s T K s r s r s T δ s sign ( r s ) + T r W ˜ s T η s r s W ^ s + r s T ϵ s + r s T Λ s 1 z ˙ s k g r m T τ h r s T f e .
Rewritten terms, considering (10) and (11) and fulfilling β m > γ α m , mean that (31) holds:
L ˙ 1 k g r m T K p m r m k g r m T δ m sign ( r m ) + T r k g W ˜ m T η m r m W ^ m + k g r m T ϵ m r s T K s r s k g α m q ˙ m T Λ m 1 q ˙ m α s z ˙ s T Λ s 1 z ˙ s r s T δ s sign ( r s ) + T r W ˜ s T η s r s W ^ s + r s T ϵ s ( z s k g q m ) T ( z ˙ s k g q ˙ m ) k g q ˙ m T t d 1 t z ˙ s ( ξ ) d ξ k g z ˙ s T t d 2 t q ˙ m ( ξ ) d ξ k g r m T τ h r s T f e .
Then, differentiating (26) with respect to time and considering Assumption 3, we obtain the following:
L ˙ 2 ( z s k g q m ) T ( z ˙ s k g q ˙ m ) + k g T 2 q ˙ m T q ˙ m + k g T 1 z ˙ s T z ˙ s k g t d 2 t q ˙ m T ( ξ ) q ˙ m ( ξ ) d ξ k g t d 1 t z ˙ s T ( ξ ) z ˙ s ( ξ ) d ξ .
From (32) and (33), and by using the inequalities
q ˙ m T t d 1 t z ˙ s ( ξ ) d ξ t d 1 t z ˙ s T ( ξ ) z ˙ s ( ξ ) d ξ T 1 4 q ˙ m T q ˙ m , z ˙ s T t d 2 t q ˙ m ( ξ ) d ξ t d 2 t q ˙ m T ( ξ ) q ˙ m ( ξ ) d ξ T 2 4 z ˙ s T z ˙ s ,
we have
L ˙ = L ˙ 1 + L ˙ 2 k g r m T K m r m k g r m T δ m sign ( r m ) + T r k g W ˜ m T η m r m W ^ m + k g r m T ϵ m r s T K s r s r s T δ s sign ( r s ) + T r W ˜ s T η s r s W ^ s + r s T ϵ s k g α m q ˙ m T Λ m 1 q ˙ m α s z ˙ s T Λ s 1 z ˙ s + k g T 2 q ˙ m T q ˙ m + k g T 1 z ˙ s T z ˙ s + k g T 1 4 q ˙ m T q ˙ m + k g T 2 4 z ˙ s T z ˙ s k g r m T τ h r s T f e .
Furthermore, by adding and subtracting η m k g r m W m M 2 and η s r s W m S 2 in (34) and then grouping terms using known mathematics relations, it can be rewritten as follows:
L ˙ k g λ m i n { K m } r m 2 η m k g r m W ˜ m W m M 2 2 λ m i n { K s } r s 2 η s r s W ˜ s W s M 2 2 r m 1 k g λ m i n { δ m } η m W m M 2 4 ε m M τ ¯ h r s 1 λ m i n { δ s } η m W s M 2 4 ε s M f ¯ e α m Λ m a x { Λ m } T 2 T 1 4 k g q ˙ m 2 α s Λ m a x { Λ s } k g T 1 k g T 2 4 z ˙ s 2 .
Here, f ¯ e and τ ¯ h are the bound values of the environment and human forces, respectively. Note that, with sufficiently large values for α m and α s , along with sufficiently large values for δ m and δ s such that λ m i n { δ m } > η m W m M 2 4 + ε m M + τ ¯ h , and similarly λ m i n { δ s } > η s W s M 2 4 + ε s M + f ¯ e , it is satisfied that L ˙ 0 , indicating that L ˙ is semi-definite negative. In practice, the necessary values of δ m and δ s are quite a lot lower than the sufficient values of (35) since the neural networks used partially compensate for environmental and human forces. On the other hand, η m , η s are positive, very small values because the main function of the second terms of (29) and (30) is to avoid some drift if the input vector to the neural network is not persistently exciting. Furthermore, if Lemma 1 is applied, it is possible to infer that L ˙ ( t ) 0 as t , by examining (1), (4), (16), and (17), checking that the accelerations of the leader and follower are bounded. Therefore, lim t r m ( t ) = 0 , lim t r s ( t ) = 0 , lim t q ˙ m ( t ) = 0 , and lim t z ˙ s ( t ) = 0 . Moreover, based on Definitions (10) and (11), the following also holds:
lim t e m ( t ) = 0 , lim t e s ( t ) = 0 .
Based on the results obtained on boundedness and convergence, and revisiting Equation (6), it follows straightforwardly that the lateral velocity v y is bounded. However, the presence of external torques from both the operator and the environment changes the convergence behavior. In practice, if such external torques are present and are not compensated, as long as they remain bounded, the errors will also remain bounded within a certain set. This is further validated by the simulation results presented in the next section.

4. Simulation Results

4.1. System Description

Leader robot description:
For the simulation, a two-degrees-of-freedom robot manipulator, shown in Figure 3, is used as the leader robot. The elements of the dynamic model for the leader (1) systems can be expressed as follows:
M ( q ) = θ 1 + θ 2 sin ( q 2 ) θ 3 cos ( q 2 ) θ 3 cos ( q 2 ) θ 4 ,
C ( q , q ˙ ) = 1 2 θ 2 q ˙ 2 sin ( 2 q 2 ) c 12 1 2 θ 2 q ˙ 1 sin ( 2 q 2 ) 0 ,
g ( q ) = 0 θ 5 sin ( q 2 ) ,
where c 12 = θ 3 q ˙ 2 sin ( q 2 ) + 1 2 θ 2 q ˙ 1 sin ( 2 q 2 ) .
Table 2 shows the estimated parameters obtained in [26] for Equations (36)–(38).
Follower robot description:
The mobile robot used in this work is a mobile skid-steering platform. Table 3 shows the estimated physical parameters of the mobile robot.

4.2. Numerical Simulation

This section presents the numerical results of the simulations developed for a bilateral teleoperation system to test the validity of the theoretical analysis derived, where the leader and the follower are represented by a robot with two degrees of freedom and a skid-steering mobile robot, respectively.
Figure 4 presents the block diagram of the proposed bilateral teleoperation system. The variables τ h , τ m , u s , and f e and the delays d 1 and d 2 represent the core elements of the control and communication flow between the leader and follower. Feedback consistency is ensured by the estimator, even in the presence of time-varying delays.
We perform three tests called A, B, and C. In each test, the following considerations are taken into account: The total simulation time is 100 [s]. To evaluate the dynamic behavior of the mobile robot against different surfaces, the Coulomb friction coefficient u c and the viscous friction coefficient u v are parameterized, as shown in Table 4, to compute F (5) and f e y (6), as in [12]. These parameters model the robot–ground interaction that affects the lateral sliding velocity v y . Furthermore, the initial values for simulations A and B are arbitrarily set as q m ( 0 ) = 0 π 2 T , z s ( 0 ) = 0 π 2 T , q ˙ m ( 0 ) = [ 0 0 ] T , and z s ˙ ( 0 ) = [ 0 0 ] T . In addition, the initial values of W ^ m ( 0 ) = 0 L N × n and W ^ s ( 0 ) = 0 L N × n are selected for the adaptation of the neural network and V m is a matrix given by constant values randomly selected in the range [ 1 , 1 ] , the same as V s . We consider the actions of external disturbances and the human operator as follows:
τ h ( t ) = [ 4       π / 4 ] T [ Nm ] , for t > 6 & t < 10 [ 4       π / 8 ] T [ Nm ] , for t > 30 & t < 34 [ 1       π / 6 ] T [ Nm ] , for t > 60 & t < 64 [ 0       0 ] T [ Nm ] , for otherwise ,
f e ( t ) = [ 0.1       0.2 ] T [ Nm ] , for t > 10 & t < 12 [ 0.1       0.1 ] T [ Nm ] , for t > 40 & t < 42 [ 0.2       0.1 ] T [ Nm ] , for t > 80 & t < 82 [ 0       0 ] T [ Nm ] , for otherwise ,
The gain selection for the teleoperation system is empirically calibrated for the nondelayed case and is shown in Table 5. In addition, the delays s 0 , s 1 , and s 2 described in Table 6 are applied in the A and B tests.

4.2.1. Test A

In this test, fixed damping values ( α m , α s ) are empirically calibrated to obtain a trade-off between an adequate transient response and a moderate error for the nondelayed system. Figure 5 presents the simulation results over the first 100 [s], showing the time evolution of the leader position and follower velocity under the proposed controller for each time delay scenario considered. As is well-known in the state of the art, performance degrades as the time delay increases.
Also in Figure 5, the values of r m and r s defined in (10) and (11) are shown, as well as the control actions and velocities of the leader and follower. The neural network control helps to dynamically compensate the ground–robot interaction, but using the neural network with insufficient damping produces a poor response as the time delay increases.

4.2.2. Test B

Note that, for this scenario, the same general setting as used in the previous simulation is considered. However, instead of fixed damping, theoretical damping coefficients are applied based on the conditions achieved in (35).
Figure 6 presents the results of the numerical simulation, where it is possible to appreciate a convergent response of the coordination errors, as well as r m and r s , to zero when the forces of the human operator and/or external disturbances are kept constant. Comparing Figure 5 and Figure 6 through visual inspection, we can observe that the fluctuations in the velocities, the control actions of the leader and follower, and r m and r s are qualitatively smaller than in test A, including a bigger difference as the time delay is greater, but at the cost of increasing the task completion time (lower average velocity). On the other hand, the evolution of the matrices of the neural networks is shown in Figure 7, visualizing the online adaptation capability to partially compensate the time-varying delay and ground–robot interaction.

4.2.3. Test C

Figure 8 shows the Root Mean Square (RMS) values obtained from multiple simulations of the bilateral teleoperation system considering the different communication delay conditions shown in Table 7. Three RMS metrics are shown: the joint velocity of the leader manipulator q ˙ m , the filtered acceleration of the mobile robot z s ˙ , and the velocity tracking error e defined by e ( t ) = k g q m ( t ) z s ( t ) . The last value reflects in a direct mode as the time delay degrades the bilateral coordination of the teleoperation system. The simulations are performed using the delay levels given in Table 6 and under two damping configurations: test A (fixed damping) and test B (theoretical damping based on Lyapunov analysis). In addition, several arbitrary initial conditions are considered for both the initial position of the leader and the initial velocity of the follower.
Figure 8A shows the RMS of q ˙ m , illustrating the effect of the time delay on the system’s behavior. In the no-delay scenario ( s 0 ), both control strategies perform similarly. However, as the delay increases, the configuration using Lyapunov-based theoretical damping (Setting B) leads to a significant reduction in the leader’s velocity compared to the empirically tuned strategy (Setting A). This improvement is attributed to the incorporation of a delay-dependent damping term, computed within the proposed neural network control framework. Additionally, Figure 8B shows the RMS of z ˙ , which corresponds to the filtered acceleration of the mobile robot. A similar trend is observed, with Setting B consistently yielding lower RMS values across different latency conditions.
Additionally, Figure 8C displays the RMS of the velocity tracking error e . Setting B achieves lower coordination errors than Setting A for all evaluated delay values. Although the improvement on the error of linear velocity is small, the reduction in the tracking error of angular velocity is significative, and it increases as the communication delay becomes larger, reaching 80% in the worst case evaluated. This outcome is particularly relevant for the delayed teleoperation of skid-steering mobile robots, although it comes at the cost of a longer task completion time.

5. Conclusions

This work presented a neural network-based control strategy for the bilateral teleoperation of a skid-steering mobile robot. The approach leverages neural networks to jointly compensate for communication time delays and system dynamics, including leader, follower, and ground–robot interaction, through controlled damping injection. The proposed method improves robustness and adaptability in the presence of communication delays and model mismatches between the leader and follower systems.
The analytical results provided give design guidelines for selecting the damping coefficient as a function of communication delay within the neural control framework. The simulation results demonstrated that this delay-sensitive tuning leads to lower coordination errors compared to fixed-gain approaches, in accordance with the expected outcomes. The difference in the tracking error using the parameters laid out by the Lyapunov analysis with respect to the empirical fixed adjustment increases as the time delay increases. In the tracking error, the RMS value of the angular velocity is 80% lower if the proposed setting (Setting B) is applied in the worst tested scenario, s 6 .
It is important to note that, in this practical implementation, real-time buffering is not required since the input vectors are composed of signals that are already available at the local and remote sites at the corresponding time steps. Therefore, no additional memory management or time-alignment mechanisms are needed during execution. However, data loss or large delays can occur. For brief communication dropouts, a local estimator such as a Kalman filter can be employed to temporarily reconstruct the missing information. However, if the communication loss exceeds a predefined safety threshold, the robot is programmed to stop its motion and alert the human operator to avoid executing further commands under uncertain conditions. The current simulation-based results are a valuable preliminary step that provides an insight into the control strategy’s behavior and supports its potential for future experimental evaluation, which should include testing in unstructured environments with both static and dynamic obstacles to further assess the system’s real-world applicability.

Author Contributions

Conceptualization, E.S. and V.M.; methodology, E.S.; software, K.P.; formal analysis, E.S. and K.P.; validation, K.P. and F.G.R.; writing—review and editing, K.P., E.S., M.M.-A. and J.M.-V.; supervision, E.S. and V.M.; project administration, E.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by CONICET-UNSJ grant numbers PIP20 Nº 867 and CICITCA 2023.

Data Availability Statement

The original contributions presented in the study are included in the article; further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Slawinski, E.; Mut, V.A.; Fiorini, P.; Salinas, L.R. Quantitative Absolute Transparency for Bilateral Teleoperation of Mobile Robots. IEEE Trans. Syst. Man Cybern.-Part A Syst. Hum. 2012, 42, 430–442. [Google Scholar] [CrossRef]
  2. Nahri, S.N.F.; Du, S.; Van Wyk, B. A Review on Haptic Bilateral Teleoperation Systems. J. Intell. Robot. Syst. 2022, 104, 13. [Google Scholar] [CrossRef]
  3. Martins Oliveira, A.; Bezerra Queiroz de Araujo, I. A Brief Overview of Teleoperation and Its Applications. In Proceedings of the 2023 15th IEEE International Conference on Industry Applications (INDUSCON), Sao Bernardo do Campo, Brazil, 22–24 November 2023; pp. 601–602. [Google Scholar] [CrossRef]
  4. Rameez, K.; Fahad, M.; Abid, R.; Naveed, M. Comprehensive study of skid-steer wheeled mobile robots: Development and challenges. Ind. Robot 2021, 48, 142–152. [Google Scholar] [CrossRef]
  5. Moniruzzaman, M.; Rassau, A.; Chai, D.; Islam, S.M.S. Teleoperation methods and enhancement techniques for mobile robots: A comprehensive survey. Robot. Auton. Syst. 2022, 150, 103973. [Google Scholar] [CrossRef]
  6. Tian, J.; Zhou, Y.; Yin, L.; AlQahtani, S.A.; Tang, M.; Lu, S.; Wang, R.; Zheng, W. Control Structures and Algorithms for Force Feedback Bilateral Teleoperation Systems: A Comprehensive Review. Comput. Model. Eng. Sci. 2025, 142, 973–1019. [Google Scholar] [CrossRef]
  7. NuÑo, E.; Ortega, R.; Barabanov, N.; BasaÑez, L. A Globally Stable PD Controller for Bilateral Teleoperators. IEEE Trans. Robot. 2008, 24, 753–758. [Google Scholar] [CrossRef]
  8. Lee, D.; Xu, D. Feedback r-passivity of Lagrangian systems for mobile robot teleoperation. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 2118–2123. [Google Scholar] [CrossRef]
  9. Slawiñski, E.; Mut, V.; Santiago, D. PD-like controller for delayed bilateral teleoperation of wheeled robots. Int. J. Control 2016, 89, 1622–1631. [Google Scholar] [CrossRef]
  10. Moya, V.; Slawiñski, E.; Mut, V.; Chávez, D.; Wagner, B. Stable Bilateral Teleoperation Control Method for Biped Robots with Time-Varying Delays. J. Robot. 2023, 2023, 3197743. [Google Scholar] [CrossRef]
  11. Chicaiza, F.A.; Slawiñski, E.; Mut, V. Delayed Bilateral Teleoperation of Mobile Manipulators With Hybrid Mapping: Rate/Nonlinear-Position Modes. IEEE Open J. Ind. Electron. Soc. 2024, 5, 663–681. [Google Scholar] [CrossRef]
  12. Liao, J.; Chen, Z.; Yao, B. Performance-Oriented Coordinated Adaptive Robust Control for Four-Wheel Independently Driven Skid Steer Mobile Robot. IEEE Access 2017, 5, 19048–19057. [Google Scholar] [CrossRef]
  13. Chen, Z.; Huang, F.; Sun, W.; Gu, J.; Yao, B. RBF-Neural-Network-Based Adaptive Robust Control for Nonlinear Bilateral Teleoperation Manipulators With Uncertainty and Time Delay. IEEE/ASME Trans. Mechatron. 2020, 25, 906–918. [Google Scholar] [CrossRef]
  14. Rani, S.; Kumar, A.; Kumar, N.; Singh, H.P. Adaptive robust motion/force control of constrained mobile manipulators using RBF neural network. Int. J. Dyn. Control 2024, 12, 3379–3391. [Google Scholar] [CrossRef]
  15. Li, Z.; Su, C.Y. Neural-adaptive control of single-master-multiple-slaves teleoperation for coordinated multiple mobile manipulators with time-varying communication delays and input uncertainties. IEEE Trans. Neural Netw. Learn. Syst. 2013, 24, 1400–1413. [Google Scholar] [CrossRef] [PubMed]
  16. Lin, R.; Namerikawa, T. Robust control of master-slave robot system considering environmental uncertainties. In Proceedings of the 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Monterey, CA, USA, 24–28 July 2005; pp. 1299–1304. [Google Scholar] [CrossRef]
  17. Lewis, F.L.; Campos, J.; Selmic, R. Neuro-Fuzzy Control of Industrial Systems with Actuator Nonlinearities; SIAM: Philadelphia, PA, USA, 2002. [Google Scholar]
  18. Forouzantabar, A.; Talebi, H.; Sedigh, A. Adaptive neural network control of bilateral teleoperation with constant time delay. Nonlinear Dyn. 2012, 67, 1123–1134. [Google Scholar] [CrossRef]
  19. Li, Z.; Xia, Y.; Wang, D.; Zhai, D.H.; Su, C.Y.; Zhao, X. Neural Network-Based Control of Networked Trilateral Teleoperation with Geometrically Unknown Constraints. IEEE Trans. Cybern. 2016, 46, 1051–1064. [Google Scholar] [CrossRef] [PubMed]
  20. Su, H.; Qi, W.; Yang, C.; Sandoval, J.; Ferrigno, G.; Momi, E.D. Deep Neural Network Approach in Robot Tool Dynamics Identification for Bilateral Teleoperation. IEEE Robot. Autom. Lett. 2020, 5, 2943–2949. [Google Scholar] [CrossRef]
  21. Abubakar, A.; Zweiri, Y.; Alhammadi, R.; Mohiuddin, M.B.; Yakubu, M.; Seneviratne, L. Predictor-Based Control for Delay Compensation in Bilateral Teleoperation of Wheeled Rovers on Soft Terrains. IEEE Access 2024, 12, 111593–111610. [Google Scholar] [CrossRef]
  22. Abubakar, A.; Zweiri, Y.; Haddad, A.; Yakubu, M.; Alhammadi, R.; Seneviratne, L. Physics-Informed LSTM-Based Delay Compensation Framework for Teleoperated UGVs. arXiv 2024, arXiv:2402.16587. [Google Scholar] [CrossRef]
  23. Slawiñski, E.; Rossomando, F.; Chicaiza, F.A.; Moreno-Valenzuela, J.; Mut, V. LSTM network in bilateral teleoperation of a skid-steering robot. Neurocomputing 2024, 602, 128248. [Google Scholar] [CrossRef]
  24. Mulero-MartÍnez, J.I. Uniform Bounds of the Coriolis/Centripetal Matrix of Serial Robot Manipulators. IEEE Trans. Robot. 2007, 23, 1083–1089. [Google Scholar] [CrossRef]
  25. Barkana, I. Can stability analysis be really simplified? (From Lyapunov to the new theorem of stability-Revisiting Lyapunov, Barbalat, LaSalle and all that). Math. Eng. Sci. Aerosp. (MESA) 2017, 8, 171–199. [Google Scholar]
  26. Moreno-Valenzuela, J.; Miranda-Colorado, R.; Aguilar-Avelar, C. A MATLAB-based identification procedure applied to a two-degrees-of-freedom robot manipulator for engineering students. Int. J. Electr. Eng. Educ. 2017, 54, 319–340. [Google Scholar] [CrossRef]
Figure 1. Coordinate systems of the mobile robot. (a) Lateral view; (b) Top view in the X-Y plane.
Figure 1. Coordinate systems of the mobile robot. (a) Lateral view; (b) Top view in the X-Y plane.
Mathematics 13 02071 g001
Figure 2. Block diagram of the control scheme for the teleoperation system.
Figure 2. Block diagram of the control scheme for the teleoperation system.
Mathematics 13 02071 g002
Figure 3. Representation of a two-degrees-of-freedom robot manipulator.
Figure 3. Representation of a two-degrees-of-freedom robot manipulator.
Mathematics 13 02071 g003
Figure 4. Block diagram of the delayed bilateral teleoperation system.
Figure 4. Block diagram of the delayed bilateral teleoperation system.
Mathematics 13 02071 g004
Figure 5. Time evolution of the teleoperation system under time delays for A test.
Figure 5. Time evolution of the teleoperation system under time delays for A test.
Mathematics 13 02071 g005
Figure 6. Time evolution of the teleoperation system under time delays for B test.
Figure 6. Time evolution of the teleoperation system under time delays for B test.
Mathematics 13 02071 g006
Figure 7. Time evolution of the neural network weight parameters for the teleoperation system under communication delays (test B).
Figure 7. Time evolution of the neural network weight parameters for the teleoperation system under communication delays (test B).
Mathematics 13 02071 g007
Figure 8. Comparative analysis of RMS metrics under time-varying delay using A and B parameter settings. Subfigure (A) shows the RMS of the joint velocity q ˙ m , while subfigure (B) presents the RMS of the mobile platform acceleration z ˙ . Subfigure (C) represents the RMS of the overall velocity error e v . Finally, subfigure (D) represents the RMS of the overall angular velocity error e w .
Figure 8. Comparative analysis of RMS metrics under time-varying delay using A and B parameter settings. Subfigure (A) shows the RMS of the joint velocity q ˙ m , while subfigure (B) presents the RMS of the mobile platform acceleration z ˙ . Subfigure (C) represents the RMS of the overall velocity error e v . Finally, subfigure (D) represents the RMS of the overall angular velocity error e w .
Mathematics 13 02071 g008
Table 2. Estimated parameters of two-degrees-of-freedom robot manipulator.
Table 2. Estimated parameters of two-degrees-of-freedom robot manipulator.
SymbolDefinitionEstimationUnit
θ 1 m 1 L 1 2 + J 1 + m 2 L 2 2 0.02587Kg m2
θ 2 m 2 l 2 2 0.00107Kg m2
θ 3 L 1 l 2 m 2 0.00151Kg m2
θ 4 m 2 l 2 2 + J 2 0.00111Kg m2
θ 5 l 2 m 2 g 0.09007N m
θ 6 f v 1 0.00090N ms
θ 7 f v 2 0.00033N ms
θ 8 f c 1 0.00773N m
θ 9 f c 2 0.00543N m
Table 3. Parameters of mobile robot.
Table 3. Parameters of mobile robot.
SymbolDefinitionValueUnit
mMass31Kg
JInertia0.6621Kg m2
rWheel radius0.11m
cRobot width0.31m
gGravity9.8N/ms2
Table 4. Parameters of terrain friction in simulations.
Table 4. Parameters of terrain friction in simulations.
t = (0–50) [s]t = (50–100) [s]
m u c 0.70.4
m u v 0.60.3
Table 5. Selection of control parameters.
Table 5. Selection of control parameters.
LeaderFollower
Gain Value Gain Value
K p m diag{1.8,1.8} K p s diag{30,30}
Λ m diag{1,1} Λ s diag{1,1}
α m 0.25(A)/Delay-based(B) α s 0.125(A)/Delay-based(B)
δ m diag{0.002,0.002} δ s diag{0.001,0.001}
Γ m 0.1 I L N × L N Γ s 5 I L N × L N
η m 5.5 η s 0.5
L N 10
Table 6. Delay value for the A and B tests.
Table 6. Delay value for the A and B tests.
s 0 s 1 s 2
d 1 00.10.8
d 2 00.80.4
Table 7. Delay value for test C.
Table 7. Delay value for test C.
s 0 s 1 s 2 s 3 s 4 s 5 s 6
d 1 00.250.50.750.7511.15
d 2 00.20.030.5111
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Patiño, K.; Slawiñski, E.; Moran-Armenta, M.; Mut, V.; Rossomando, F.G.; Moreno-Valenzuela, J. Neural Networks in the Delayed Teleoperation of a Skid-Steering Robot. Mathematics 2025, 13, 2071. https://doi.org/10.3390/math13132071

AMA Style

Patiño K, Slawiñski E, Moran-Armenta M, Mut V, Rossomando FG, Moreno-Valenzuela J. Neural Networks in the Delayed Teleoperation of a Skid-Steering Robot. Mathematics. 2025; 13(13):2071. https://doi.org/10.3390/math13132071

Chicago/Turabian Style

Patiño, Kleber, Emanuel Slawiñski, Marco Moran-Armenta, Vicente Mut, Francisco G. Rossomando, and Javier Moreno-Valenzuela. 2025. "Neural Networks in the Delayed Teleoperation of a Skid-Steering Robot" Mathematics 13, no. 13: 2071. https://doi.org/10.3390/math13132071

APA Style

Patiño, K., Slawiñski, E., Moran-Armenta, M., Mut, V., Rossomando, F. G., & Moreno-Valenzuela, J. (2025). Neural Networks in the Delayed Teleoperation of a Skid-Steering Robot. Mathematics, 13(13), 2071. https://doi.org/10.3390/math13132071

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop