1. Introduction
The structure of teleoperation systems typically consists of several key components: human operator, master manipulator, slave manipulator, and communication channel. The interactions between these components form the basis of teleoperation systems, enabling human operators to control systems and interact with remote environments effectively [
1,
2]. In a teleoperation system, the human operator controls the master manipulator, usually through prescribed trajectories or specific tasks. The slave robot then follows the movements of the master manipulator in a free space, replicating the actions performed by the operator in the remote environment. Integrating haptic feedback into teleoperation systems enhances the operator’s situational awareness and dexterity, enabling more intuitive and precise control of the master manipulator while interacting with the remote environment. This contributes to improved task performance and overall efficiency in various teleoperation applications. The applications of teleoperation systems are versatile, such as in unmanned aerial vehicles [
3,
4,
5], virtual reality [
6,
7], medical training [
8,
9,
10], and telesurgery [
11,
12,
13,
14,
15,
16].
In recent years, significant advancements have been made in the development of teleoperation systems, with several methods and techniques being addressed to improve their performance, robustness, and versatility. In [
17], an event-triggered mechanism combined with a PD-like controller was presented for bilateral teleoperation systems to address communication channel congestion. In [
18], an adaptive proportional damping controller utilizing an RBF neural network and adaptive control strategy was proposed to enhance stability and performance in a telerobotic system. On the other hand, time-domain-passivity control is a widely used approach to preserve the stability of teleoperation systems. In general, it is expected to maintain the passivity of the system to ensure a safe and stable operation [
19,
20]. Bavili et al. [
21] investigated the problem of asymptotic stability and position tracking in nonlinear teleoperation systems when interacting with non-passive operators and environments. In [
22], a passivity controller was presented to compensate for the non-passivity induced by longitudinal slipping and lateral sliding of wheeled robots. In [
23], a passivity-based delay predictor was proposed to improve the transparency of a four-channel bilateral teleoperation system. Passivity-based control was utilized to ensure energy stability, and shared variable impedance control can facilitate smooth collaboration in teleoperation [
24]. Additionally, a passivity-based nonlinear controller was introduced for bilateral teleoperation system under variable time delay and load disturbance [
25]. In [
26], a neural network-based four-channel-time-domain-passivity approach was proposed for a teleoperation system with time-varying delays.
Obtaining precise dynamic models for both master and slave manipulators in a teleoperation system can be challenging due to various factors such as nonlinearities, uncertainties, and complex mechanical structures. Adaptive tuning methods have been proposed to overcome this problem. Yang et al. [
27] addressed the problem of adaptive tracking control for a teleoperation system with uncertainties in both kinematics and dynamics. In [
28], an adaptive fuzzy neural network-backstepping-control scheme was developed for bilateral teleoperation systems to handle time delays and uncertainties. In [
29], a fixed-time adaptive neural network-synchronization control was presented for teleoperation systems, handling position-error constraints and time-varying delays. In [
30], a type-2 fuzzy neural network was proposed to deal with time-varying delays and uncertainties. In [
31], a type-2 fuzzy-based observer was introduced to estimate external force/torque information and simultaneously filter out system disturbances. In [
32], an adaptive bilateral control strategy was introduced for underwater manipulator teleoperation, with adaptive RBF network compensation for slave-manipulator uncertainties. In [
33], a radial basis function-neural network-based-sliding-mode-control design was developed for nonlinear bilateral teleoperation system with transmission delays and uncertainties. In addition, a sliding-mode controller combined with a nonlinear-disturbance observer was proposed, such that the asymptotical stability can be preserved [
34]. Due to the superiority of its robustness, the sliding-mode control has become an effective scheme for network control systems that are subject to time delays, packet losses, uncertainties, disturbances, and/or faults [
35].
The presence of communication time delays and model uncertainties can significantly impact the transparency and stability of teleoperation systems [
36,
37]. For constant delays, a terminal sliding-mode controller was discussed for time-delayed nonlinear teleoperation systems [
38]. In [
39], an observer-based force control scheme was proposed to guarantee the position and force tracking in nonlinear teleoperation systems, subject to a constant communication time delay. Moreover, a bilateral neural network adaptive controller was designed for a class of teleoperation systems with constant time delays, external disturbances, and internal friction [
40]. In practice, it is more attractive to investigate the tracking stability of teleoperation systems subject to time-varying delays. In [
41], a general framework was presented to analyze and optimize the transparency of multilateral systems under time-varying delays. In [
42], an adaptive control framework was developed to simultaneously handle both unknown kinematics/dynamics and time-varying delays. In [
43], a finite-time control method was presented for bilateral teleoperators to ensure the coordination of master and slave manipulators in the presence of time-varying delays, external disturbances, and dynamic uncertainties. Zakerimanesh et al. [
44] presented a control framework for bilateral teleoperation systems experiencing bounded time-varying delays in their communication channels.
When analyzing time-delay issues, delay-dependent approaches are generally less conservative than delay-independent approaches. However, the derivation of delay-dependent stability conditions can be more complex than that for delay-independent approaches, particularly because delays are explicitly considered in the design of stabilizing controllers. In general, when dealing with time-delay systems, ensuring closed-loop stability is crucial for the overall performance and reliability of the system. To achieve this, various conditions related to controller parameters are often desired, especially those that explicitly consider the time delays. Lyapunov–Krasovskii functions and linear matrix inequalities (LMIs) are commonly employed tools for investigating the stability of time-delay systems [
45,
46,
47,
48,
49,
50,
51].
The synthesis problem in time-delayed teleoperation systems involves designing stabilizing controllers to ensure closed-loop stability while minimizing conservatism and preserving transparency in teleoperation. This entails finding less conservative stabilizing controllers that can effectively handle time delays, especially those that vary over time. Delay-dependent approaches are preferred due to their ability to explicitly consider time delays, which leads to more accurate estimation of stability conditions and efficient controller designs. By addressing practical considerations such as time-varying delays, teleoperation systems can achieve robust performance and seamless interaction between the operator and the remote environment. In the works of [
52], both symmetric and asymmetric time-varying delays in communication were addressed. Symmetry of the communication delays means that the delays of the forward and backward channels are equal. Symmetric delays could exist in a constrained environment such as a local wire-connected network with a strictly defined protocol. On the other hand, asymmetric communication delays would be more practical in internet or wireless networks. In existing works of asymmetric time-varying delays, the bounds of time-varying delays are usually given in advance, then a delay-dependent controller can be obtained to ensure closed-loop stability. In this paper, it is desired to find the allowable boundary of time-varying communication delays. For the purpose of concise computations, a symmetric teleoperation system is addressed. How to relax this assumption of symmetry would be another interesting topic.
Transparency is a critical issue in teleoperations. Ensuring precise force feedback across versatile environments is a primary task. Our proposed control strategies are designed to maintain high transparency by accurately replicating forces encountered in the remote environment, thus enhancing the user’s sense of presence and control. In this work, a novel adaptive-sliding-mode control scheme is proposed for bilateral teleoperation systems encountering model uncertainties and time-varying delays. The main contributions are as follows:
The proposed method allows for the determination of admissible bounds of time-varying delays by solving linear matrix inequalities (LMIs), thus providing valuable insights into temporal constraints.
The derived adaptive laws enable the estimation of bounds for unknown uncertainties, thereby enhancing the robustness of the controller against model uncertainties.
Utilizing delay-dependent Lyapunov–Krasovskii functional analysis ensures the closed-loop stability of the teleoperation system, offering theoretical assurances even in the presence of delays and uncertainties.
The control scheme addresses both free-motion and force-perception aspects of a general non-passive teleoperation system, thereby expanding its applicability across various scenarios.
Conducting master–slave experiments validates the feasibility and effectiveness of the proposed control scheme in real-world settings, demonstrating its practical applicability and performance.
3. Experimental Results
In this paper, the master and slave devices are a pair of two-degrees-of-freedom-revolute-prismatic robots. The configuration illustration and 3D framework of the teleoperation devices are shown in
Figure 2.
The system parameters of the master and slave robots are listed in
Table 1.
The dynamic models of (1) and (2) are obtained as
,
,
,
. In addition,
is the length of the joint 2 between the point o and the center of mass of the second link, and
is the angle of the joint 1.
The parameters of the adaptive-sliding-mode controller are set as
,
, and
,
. The disturbance parts are assumed as
and
is a uniformly distributed random number. From Theorem 1, the allowable delay bound can be obtained as
s by solving LMI (12). In experiments, the time delay is chosen as
s. The initial states of the master and slave robots are set as
, and the initial velocities and acceleration are zero. Three types of controllers are adopted for comparison, including the proportional plus damping controller (P + dC) [
17,
18,
45], sliding-mode controller (SC), and the proposed adaptive-sliding-mode controller (ASC). The following indices are considered for performance comparisons: the integral absolute error (IAE), the integral time absolute error (ITAE), the integral square error (ISE), and the integral time square error (ITSE) [
57].
In the following, the cases of both free motion and force perception are performed. The experimental setup of a bilateral teleoperation system is shown in
Figure 3. The position responses of the master and slave robots are measured by encoders. The control algorithms and signal interfacing are implemented by Raspberry Pi and a PIC18F4331 microprocessor. The sampling time is selected as 20 ms. In these experiments, the time delay is realized by software programming. Furthermore, all of the controller parameters of the teleoperation system are the same as the settings in simulations. The allowable delay bound is determined to be 0.5 s. The behavior of a delay can be accurately captured if the delay is multiple times the length of the sampling time.
3.1. Case 1: Free Motion (Experiment)
During the free-motion operation, the human operator moves the master robot towards
rad and
m, and the operator leaves the device standing still alone for
s. It is desired to see whether the slave robot can track the motion trajectory of the master device stably. As shown in
Figure 4 and
Figure 5, the steady-state position errors are significantly reduced using the ASC method. Quantitative analyses of different methods are shown in
Table 2. The proposed ASC method increases the performance improvement from 70.70% to 90.00%. The video snapshots captured from the ASC are depicted in
Figure 6, where the recording time of each snapshot is indicated on the bottom right.
3.2. Case 2: Force Perception (Experiment)
In this case, an obstacle is placed on the slave side of the system at a position of roughly
m and
rad, respectively. As it is following the scheduled movement of the master, the slave robot will contact the pre-placed obstacle. Like in the in the simulation discussions, the force feedback will be conducted in turn for each joint. The experimental results corresponding to different methods are presented in
Figure 7,
Figure 8,
Figure 9 and
Figure 10, where the slave robot contacts the obstacle around
s. From
Figure 7 and
Figure 8, it can be observed that there exist quite clear biases between the joint positions of master and slave robots with the P + dC method. On the other hand, the proposed ASC controller can provide significant improvements in position tracking and force perception. As the force perception in
Figure 9 and
Figure 10, the proposed ASC control method has superiority in stably and accurately tracking for
s. Quantitative analyses of the experimental results are summarized in
Table 3 and
Table 4. They indicate that the proposed ASC method increases position performance from 58.48% to 82.55% and improves force performance from 83.48% to 99.77%. The video snapshots of ASC are depicted in
Figure 11, where the recording time of each snapshot is indicated on the bottom right.
Remark 5. To enhance the reader’s understanding of the experimental process and results, experimental videos have been uploaded to YouTube (accessed on 11 June 2024).