Abstract
Master–slave teleoperation systems with haptic feedback enable human operators to interact with objects or perform tasks in remote environments. This paper presents a sliding-mode control scheme tailored for bilateral teleoperation systems operating in the presence of unknown uncertainties and time-varying delays. To address unknown but bounded uncertainties, adaptive laws are derived alongside controller design. Additionally, a linear matrix inequality is solved to determine the allowable bound of delays. Stability of the closed-loop system is ensured through Lyapunov–Krasovskii functional analysis. Two-degree-of-freedom mechanisms are self-built as haptic devices. Free-motion and force-perception scenarios are examined, with experimental results validating and comparing performances. The proposed adaptive-sliding-control method increases the position performance from 58.48% to 82.55% and the force performance from 83.48% to 99.77%. The proposed control scheme demonstrates enhanced position tracking and force perception in bilateral teleoperation systems.
1. Introduction
The structure of teleoperation systems typically consists of several key components: human operator, master manipulator, slave manipulator, and communication channel. The interactions between these components form the basis of teleoperation systems, enabling human operators to control systems and interact with remote environments effectively [1,2]. In a teleoperation system, the human operator controls the master manipulator, usually through prescribed trajectories or specific tasks. The slave robot then follows the movements of the master manipulator in a free space, replicating the actions performed by the operator in the remote environment. Integrating haptic feedback into teleoperation systems enhances the operator’s situational awareness and dexterity, enabling more intuitive and precise control of the master manipulator while interacting with the remote environment. This contributes to improved task performance and overall efficiency in various teleoperation applications. The applications of teleoperation systems are versatile, such as in unmanned aerial vehicles [3,4,5], virtual reality [6,7], medical training [8,9,10], and telesurgery [11,12,13,14,15,16].
In recent years, significant advancements have been made in the development of teleoperation systems, with several methods and techniques being addressed to improve their performance, robustness, and versatility. In [17], an event-triggered mechanism combined with a PD-like controller was presented for bilateral teleoperation systems to address communication channel congestion. In [18], an adaptive proportional damping controller utilizing an RBF neural network and adaptive control strategy was proposed to enhance stability and performance in a telerobotic system. On the other hand, time-domain-passivity control is a widely used approach to preserve the stability of teleoperation systems. In general, it is expected to maintain the passivity of the system to ensure a safe and stable operation [19,20]. Bavili et al. [21] investigated the problem of asymptotic stability and position tracking in nonlinear teleoperation systems when interacting with non-passive operators and environments. In [22], a passivity controller was presented to compensate for the non-passivity induced by longitudinal slipping and lateral sliding of wheeled robots. In [23], a passivity-based delay predictor was proposed to improve the transparency of a four-channel bilateral teleoperation system. Passivity-based control was utilized to ensure energy stability, and shared variable impedance control can facilitate smooth collaboration in teleoperation [24]. Additionally, a passivity-based nonlinear controller was introduced for bilateral teleoperation system under variable time delay and load disturbance [25]. In [26], a neural network-based four-channel-time-domain-passivity approach was proposed for a teleoperation system with time-varying delays.
Obtaining precise dynamic models for both master and slave manipulators in a teleoperation system can be challenging due to various factors such as nonlinearities, uncertainties, and complex mechanical structures. Adaptive tuning methods have been proposed to overcome this problem. Yang et al. [27] addressed the problem of adaptive tracking control for a teleoperation system with uncertainties in both kinematics and dynamics. In [28], an adaptive fuzzy neural network-backstepping-control scheme was developed for bilateral teleoperation systems to handle time delays and uncertainties. In [29], a fixed-time adaptive neural network-synchronization control was presented for teleoperation systems, handling position-error constraints and time-varying delays. In [30], a type-2 fuzzy neural network was proposed to deal with time-varying delays and uncertainties. In [31], a type-2 fuzzy-based observer was introduced to estimate external force/torque information and simultaneously filter out system disturbances. In [32], an adaptive bilateral control strategy was introduced for underwater manipulator teleoperation, with adaptive RBF network compensation for slave-manipulator uncertainties. In [33], a radial basis function-neural network-based-sliding-mode-control design was developed for nonlinear bilateral teleoperation system with transmission delays and uncertainties. In addition, a sliding-mode controller combined with a nonlinear-disturbance observer was proposed, such that the asymptotical stability can be preserved [34]. Due to the superiority of its robustness, the sliding-mode control has become an effective scheme for network control systems that are subject to time delays, packet losses, uncertainties, disturbances, and/or faults [35].
The presence of communication time delays and model uncertainties can significantly impact the transparency and stability of teleoperation systems [36,37]. For constant delays, a terminal sliding-mode controller was discussed for time-delayed nonlinear teleoperation systems [38]. In [39], an observer-based force control scheme was proposed to guarantee the position and force tracking in nonlinear teleoperation systems, subject to a constant communication time delay. Moreover, a bilateral neural network adaptive controller was designed for a class of teleoperation systems with constant time delays, external disturbances, and internal friction [40]. In practice, it is more attractive to investigate the tracking stability of teleoperation systems subject to time-varying delays. In [41], a general framework was presented to analyze and optimize the transparency of multilateral systems under time-varying delays. In [42], an adaptive control framework was developed to simultaneously handle both unknown kinematics/dynamics and time-varying delays. In [43], a finite-time control method was presented for bilateral teleoperators to ensure the coordination of master and slave manipulators in the presence of time-varying delays, external disturbances, and dynamic uncertainties. Zakerimanesh et al. [44] presented a control framework for bilateral teleoperation systems experiencing bounded time-varying delays in their communication channels.
When analyzing time-delay issues, delay-dependent approaches are generally less conservative than delay-independent approaches. However, the derivation of delay-dependent stability conditions can be more complex than that for delay-independent approaches, particularly because delays are explicitly considered in the design of stabilizing controllers. In general, when dealing with time-delay systems, ensuring closed-loop stability is crucial for the overall performance and reliability of the system. To achieve this, various conditions related to controller parameters are often desired, especially those that explicitly consider the time delays. Lyapunov–Krasovskii functions and linear matrix inequalities (LMIs) are commonly employed tools for investigating the stability of time-delay systems [45,46,47,48,49,50,51].
The synthesis problem in time-delayed teleoperation systems involves designing stabilizing controllers to ensure closed-loop stability while minimizing conservatism and preserving transparency in teleoperation. This entails finding less conservative stabilizing controllers that can effectively handle time delays, especially those that vary over time. Delay-dependent approaches are preferred due to their ability to explicitly consider time delays, which leads to more accurate estimation of stability conditions and efficient controller designs. By addressing practical considerations such as time-varying delays, teleoperation systems can achieve robust performance and seamless interaction between the operator and the remote environment. In the works of [52], both symmetric and asymmetric time-varying delays in communication were addressed. Symmetry of the communication delays means that the delays of the forward and backward channels are equal. Symmetric delays could exist in a constrained environment such as a local wire-connected network with a strictly defined protocol. On the other hand, asymmetric communication delays would be more practical in internet or wireless networks. In existing works of asymmetric time-varying delays, the bounds of time-varying delays are usually given in advance, then a delay-dependent controller can be obtained to ensure closed-loop stability. In this paper, it is desired to find the allowable boundary of time-varying communication delays. For the purpose of concise computations, a symmetric teleoperation system is addressed. How to relax this assumption of symmetry would be another interesting topic.
Transparency is a critical issue in teleoperations. Ensuring precise force feedback across versatile environments is a primary task. Our proposed control strategies are designed to maintain high transparency by accurately replicating forces encountered in the remote environment, thus enhancing the user’s sense of presence and control. In this work, a novel adaptive-sliding-mode control scheme is proposed for bilateral teleoperation systems encountering model uncertainties and time-varying delays. The main contributions are as follows:
- The proposed method allows for the determination of admissible bounds of time-varying delays by solving linear matrix inequalities (LMIs), thus providing valuable insights into temporal constraints.
- The derived adaptive laws enable the estimation of bounds for unknown uncertainties, thereby enhancing the robustness of the controller against model uncertainties.
- Utilizing delay-dependent Lyapunov–Krasovskii functional analysis ensures the closed-loop stability of the teleoperation system, offering theoretical assurances even in the presence of delays and uncertainties.
- The control scheme addresses both free-motion and force-perception aspects of a general non-passive teleoperation system, thereby expanding its applicability across various scenarios.
- Conducting master–slave experiments validates the feasibility and effectiveness of the proposed control scheme in real-world settings, demonstrating its practical applicability and performance.
2. Materials and Methods
2.1. Preliminaries
The dynamic model for an nth degree master–slave robotic system can be described using the following equations:
where the subscripts m and s represent the master and slave, respectively, and are the vectors joint positions, and are the inertia matrices, and are the Coriolis matrices, and are the gravitational vectors, and are vectors of input torques, and are the human operation force and the environmental force, and and are the unknown uncertainties of the master and slave robots, respectively. In this paper, the human operator’s force and the environmental force are non-passive [53,54]:
where and are constant vectors of , and and are the damping and spring-constant matrices for human force, respectively. In addition, and represent the damping and spring-constant matrices for the environmental force, respectively.
Property 1.
The inertia matrix is symmetric and positive definite. Let be the maximum eigenvalue of . Then, where is the identity matrix, .
Property 2.
The matrix is skewed symmetric, .
Property 3.
There exists a positive constant such that , where represents the norm, .
Assumption 1.
Let be bounded by , where is an unknown constant, , .
Lemma 1.
[55] Given a positive-definite matrix R, the following inequality holds
where and are two matrices with proper dimensions.
Lemma 2.
[56] Let be a matrix with proper dimensions, . Then the following equation holds:
2.2. Adaptive-Sliding-Mode-Controller Design
In the context of the time-delayed teleoperation system described by Equations (1) and (2), a sliding-mode controller will be designed to achieve asymptotically stable sliding motion.
Assumption 2.
The forward and backward communication delays are symmetric, and the time-varying delay satisfies the conditions that
where and are positive constants.
Remark 1.
If , then the delay will grow faster than the increase in time. As the manipulator devices are required to track some delayed trajectories, the control loop becomes open. Under this circumstance, the controller design and related stability analysis opens a new theoretical problem, which cannot be solved at current stage and needs to be investigated separately [42].
In the following equations, the notations and are used to stand for and , respectively, for simplicity. The sliding surfaces for the master and slave robots are defined, respectively, as
where and , and , . Then, the sliding mode of (8), , can be equivalently described as
Let the error functions of the master and slave sides, respectively, be defined as
From (9) and (10), it can be determined that
where , , and .
Theorem 1.
The error functions of (10) are asymptotically convergent if the following inequality holds:
where , , and are symmetric positive-definite matrices of , , , and is a zero matrix of dimension .
Proof.
A Lyapunov–Krasovskii function is chosen as
The time derivative of from (11) is derived as
It is noted that . Then, from Lemma 1 and Assumption 2, it leads to the following inequality
where
From Lemma 2, is negative if (12) holds. This implies that the error dynamics of (11) is asymptotically stable. This completes the proof. □
The sliding-mode-based controllers for the torques acting on the delayed teleoperation system are designed as
where and are the equivalent control actions and and are the switching controllers. From (1) and (2), considering the uncertainty-free case, the equivalent controllers and can be determined as
It is noted that the uncertain terms and of (1) and (2) are unknown but bounded. To estimate and , the adaptive laws are designated as follows:
where and , , , and .
In this paper, the switching controllers are formulated as
in which , , , and is a standard sign function. In addition, and .
Remark 2.
The required input torques on the master and slave sides are shown in (17) and (18). The input torques include both equivalent and switching control actions. For example, the input torque can be obtained from and in Equations (17), (19) and (23). In (23), an adaptive law for the unknown bounded uncertainties is designed as (21). Similarly, the input torque can be implemented with Equations (18), (20), (22), and (24). The scheme diagram of the proposed teleoperation system is shown in Figure 1.
Figure 1.
Adaptive-sliding-mode scheme for teleoperation system.
Remark 3.
There could be a potential issue of chattering associated with the use of the sign function in the controller (23) and (24). To address this common chattering problem, a smoothing technique can be employed by replacing the sign function with a continuous approximation, such as a saturation function or a boundary-layer approach.
Theorem 2.
Consider the bilateral teleoperation systems (1) and (2). In free motion, , and the state trajectories of teleoperation systems (1) and (2) will be driven onto the sliding surfaces (8) with the controllers (17) and (18) and the adaptive laws (21), (22).
Proof.
Let a Lyapunov function be chosen as
where , and are the estimation errors. The derivative of (8) is obtained as
The derivative of along (26) is
From Assumption 1, this gives the following:
Substituting (17), (18), and (21) into (28), it yields
From (25) to (29), it is evident that the negative definiteness of can be preserved, which means that , , , and are bounded. Therefore, the systems (1) and (2) are stable. Hence, the states of the teleoperation system (1) and (2) will reach the sliding surface (8). The proof is completed. □
2.3. Stability Analysis
Substituting (3), (4), (17), and (18) into (1) and (2), the closed-loop teleoperation systems can be represented as
where and .
Remark 4.
According to Assumption 1 and Theorem 2, the uncertainty terms and are bounded and the estimated terms and are bounded. Thus, both the and are bounded.
Theorem 3.
With non-passive human and environment forces (3) and (4), the closed-loop teleoperation system (30) is asymptotic stable if the following LMI holds:
where is a symmetric positive-definite matrix, and
in which αm and αs are positive constants and 0n is a zero matrix of .
Proof.
Consider a Lyapunov–Krasovskii function candidate as follows:
From Property 2, the time derivative of along (30) can be reformulated as
From Lemma 1, the following inequalities can be obtained:
and
where represents the L2 norm of the signals.
From Properties 1 and 3, substituting (35) and (36) into (34) yields
where . Furthermore, it leads to the following condition,
where is the maximum eigenvalue of the matrix , . Noting that is bounded, , is a constant. Hence, is negative, if . The controller parameters and can be chosen such that will be arbitrarily small. Therefore, the closed-loop system (30) is asymptotically stable. □
3. Experimental Results
In this paper, the master and slave devices are a pair of two-degrees-of-freedom-revolute-prismatic robots. The configuration illustration and 3D framework of the teleoperation devices are shown in Figure 2.
Figure 2.
Configuration diagram of the master- and slave-manipulator robots.
The system parameters of the master and slave robots are listed in Table 1.
Table 1.
System parameters of teleoperation systems.
The dynamic models of (1) and (2) are obtained as
, , , . In addition, is the length of the joint 2 between the point o and the center of mass of the second link, and is the angle of the joint 1.
The parameters of the adaptive-sliding-mode controller are set as , , and , . The disturbance parts are assumed as and is a uniformly distributed random number. From Theorem 1, the allowable delay bound can be obtained as s by solving LMI (12). In experiments, the time delay is chosen as s. The initial states of the master and slave robots are set as , and the initial velocities and acceleration are zero. Three types of controllers are adopted for comparison, including the proportional plus damping controller (P + dC) [17,18,45], sliding-mode controller (SC), and the proposed adaptive-sliding-mode controller (ASC). The following indices are considered for performance comparisons: the integral absolute error (IAE), the integral time absolute error (ITAE), the integral square error (ISE), and the integral time square error (ITSE) [57].
In the following, the cases of both free motion and force perception are performed. The experimental setup of a bilateral teleoperation system is shown in Figure 3. The position responses of the master and slave robots are measured by encoders. The control algorithms and signal interfacing are implemented by Raspberry Pi and a PIC18F4331 microprocessor. The sampling time is selected as 20 ms. In these experiments, the time delay is realized by software programming. Furthermore, all of the controller parameters of the teleoperation system are the same as the settings in simulations. The allowable delay bound is determined to be 0.5 s. The behavior of a delay can be accurately captured if the delay is multiple times the length of the sampling time.
Figure 3.
Experimental setup for teleoperation system.
3.1. Case 1: Free Motion (Experiment)
During the free-motion operation, the human operator moves the master robot towards rad and m, and the operator leaves the device standing still alone for s. It is desired to see whether the slave robot can track the motion trajectory of the master device stably. As shown in Figure 4 and Figure 5, the steady-state position errors are significantly reduced using the ASC method. Quantitative analyses of different methods are shown in Table 2. The proposed ASC method increases the performance improvement from 70.70% to 90.00%. The video snapshots captured from the ASC are depicted in Figure 6, where the recording time of each snapshot is indicated on the bottom right.
Figure 4.
Position responses of joint 1 with different control methods for Case 1: (a) P + dC, (b) SC, and (c) ASC.
Figure 5.
Position responses of joint 2 with different control methods for Case 1: (a) P + dC, (b) SC, and (c) ASC.
Table 2.
Experimental comparisons of position errors in Case 1.
Figure 6.
The snapshots of the experimental results for Case 1 (ASC): (a) joint 1, and (b) joint 2.
3.2. Case 2: Force Perception (Experiment)
In this case, an obstacle is placed on the slave side of the system at a position of roughly m and rad, respectively. As it is following the scheduled movement of the master, the slave robot will contact the pre-placed obstacle. Like in the in the simulation discussions, the force feedback will be conducted in turn for each joint. The experimental results corresponding to different methods are presented in Figure 7, Figure 8, Figure 9 and Figure 10, where the slave robot contacts the obstacle around s. From Figure 7 and Figure 8, it can be observed that there exist quite clear biases between the joint positions of master and slave robots with the P + dC method. On the other hand, the proposed ASC controller can provide significant improvements in position tracking and force perception. As the force perception in Figure 9 and Figure 10, the proposed ASC control method has superiority in stably and accurately tracking for s. Quantitative analyses of the experimental results are summarized in Table 3 and Table 4. They indicate that the proposed ASC method increases position performance from 58.48% to 82.55% and improves force performance from 83.48% to 99.77%. The video snapshots of ASC are depicted in Figure 11, where the recording time of each snapshot is indicated on the bottom right.
Figure 7.
Position responses of joint 1 with different control methods for Case 2: (a) P + dC, (b) SC, and (c) ASC.
Figure 8.
Position responses of joint 2 with different control methods for Case 2: (a) P + dC, (b) SC, and (c) ASC.
Figure 9.
Force responses of joint 1 with different control methods for Case 2: (a) P + dC, (b) SC, and (c) ASC.
Figure 10.
Force responses of joint 2 with different control methods for Case 2: (a) P + dC, (b) SC, and (c) ASC.
Table 3.
Experimental comparisons of position responses in Case 2.
Table 4.
Experimental comparisons of force errors in Case 2.
Figure 11.
Snapshots of the experimental results for Case 2 (ASC): (a) joint 1, and (b) joint 2.
Remark 5.
To enhance the reader’s understanding of the experimental process and results, experimental videos have been uploaded to YouTube (accessed on 11 June 2024).
4. Discussion
A non-passive environment in the context of teleoperation systems refers to an environment where the forces exerted on the slave’s side are not purely passive. This means that the slave’s side does not simply follow the master’s movements passively but may exert forces or exhibit behaviors that are independent or reactive to the master’s commands. Building an experimental setup to replicate a non-passive environment presents several challenges due to its inherent complexity and unpredictability. To address these challenges, we conduct a simulation scenario in this study. Key performance indicators in a non-passive teleoperation environment include the closeness of position responses between the master and slave sides and the consistency of force tracking. Smaller errors in position and force tracking generally indicate better system performance.
4.1. Case 3: Free Motion (Simulation)
Additionally, a more general free-motion case is considered, where the joint 1 of the master moves approximately up to 1 rad and then gradually returns to its original position. During the same period, joint 2 smoothly pulls out. The simulation responses are shown in Figure 12, Figure 13, Figure 14, Figure 15, Figure 16 and Figure 17, and the comparisons of position errors with different control methods are summarized in Table 5. Furthermore, the related control signals regarding to P + dC, SC, and ASC are shown in Figure 13, Figure 15 and Figure 17, respectively. It can be observed that the proposed ASC method can provide better trajectory-tracking capability.
Figure 12.
Position responses with P + dC method (Case 3): (a) joint 1, and (b) joint 2.
Figure 13.
Control signals with P + dC method (Case 3): (a) master, and (b) slave.
Figure 14.
Position responses with SC method (Case 3): (a) joint 1, and (b) joint 2.
Figure 15.
Control signals with SC method (Case 3): (a) master, and (b) slave.
Figure 16.
Position responses with ASC method (Case 3): (a) joint 1, and (b) joint 2.
Figure 17.
Control signals with ASC method (Case 3): (a) master, and (b) slave.
Table 5.
Simulation comparisons of position errors in Case 3.
4.2. Case 4: Non-Passive Human and Environment (Simulation)
Consider the case that the human operator and environment forces are all non-passive, such as
where , , , and .
The simulation results of this case are depicted in Figure 18, Figure 19, Figure 20, Figure 21, Figure 22, Figure 23, Figure 24, Figure 25 and Figure 26, including the position responses, force responses, and control signals of the master and slave robots. The observation revolves around the responses after the addition of the environment force, i.e., from 5 to 30 s. From Figure 24, compared to Figure 18 and Figure 21, the position errors of the master and slave robots are significantly improved using the proposed ASC method. As regards the force responses shown in Figure 19, Figure 22 and Figure 25, all three methods can support a certain degree of inconsistency in the human and environment forces. Similarly, the average position and force errors of 20 repetitions are summarized, from 5 to 30 s, in Table 6 and Table 7. It can be observed that the proposed ASC scheme has better performance in both position following and force perception.
Figure 18.
Position responses with P + dC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 19.
Force responses with P + dC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 20.
Control signals with P + dC method (Case 4): (a) master, and (b) slave.
Figure 21.
Position responses with SC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 22.
Force responses with SC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 23.
Control signals with SC method (Case 4): (a) master, and (b) slave.
Figure 24.
Position responses with ASC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 25.
Force responses with ASC method (Case 4): (a) joint 1, and (b) joint 2.
Figure 26.
Control signals with ASC method (Case 4): (a) master, and (b) slave.
Table 6.
Simulation comparisons of position errors in Case 4.
Table 7.
Simulation comparisons of force errors in Case 4.
5. Conclusions
This paper introduces an adaptive-sliding-mode controller that has been designed for a bilateral teleoperation system that is characterized by time-varying communication delays and unknown but bounded uncertainties. The master and slave devices utilized in the system are self-made by the authors, with certain components manufactured using CNC milling and lathe machines. The controller design involves deriving a delay-dependent condition for stability and determining the admissible bound of time delays through linear matrix inequalities. The closed-loop stability of the teleoperation system is ensured via Lyapunov–Krasovskii stability analysis, aligning the stability analysis with the designed controllers and adaptive laws. Both passive and non-passive scenarios involving the human operator and the environment are considered in the design process. A real experimental setup is employed to validate the proposed control scheme, covering free-motion and force-perception tasks. Results indicate that the proposed adaptive-sliding-control method increases position performance from 58.48% to 82.55% and force performance from 83.48% to 99.77%. In conclusion, the proposed control algorithm shows promising potential for application in generalized haptic devices with expanded degrees of freedom. Additionally, our control strategies have successfully addressed a wide range of scenarios and environments, including free motion, force perception, and also both passive and non-passive situations. Furthermore, our experimental results underscore its viability for real-world applications.
Author Contributions
Conceptualization, Y.-H.C. and C.-Y.Y.; methodology, Y.-H.C., C.-Y.Y. and H.-W.L.; software, C.-Y.Y.; validation, Y.-H.C. and C.-Y.Y.; formal analysis, Y.-H.C., C.-Y.Y. and H.-W.L.; investigation, Y.-H.C. and C.-Y.Y.; data curation, C.-Y.Y.; writing—original draft preparation, Y.-H.C. and C.-Y.Y.; writing—review and editing, Y.-H.C. and H.-W.L.; visualization, Y.-H.C. and C.-Y.Y.; supervision, Y.-H.C. and H.-W.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Moniruzzaman, M.; Rassau, A.; Chai, D.; Islam, S. Teleoperation methods and enhancement techniques for mobile robots: A comprehensive survey. Robot. Auton. Syst. 2022, 150, 103973. [Google Scholar] [CrossRef]
- Shahbazi, M.; Atashzar, S.F.; Patel, R.V. A systematic review of multilateral teleoperation systems. IEEE Trans. Haptics 2018, 11, 338–356. [Google Scholar] [CrossRef] [PubMed]
- Courtois, H.; Aouf, N.; Ahiska, K.; Cecotti, M. OAST: Obstacle avoidance system for teleoperation of UAVs. IEEE Trans. Hunan-Mach. Syst. 2022, 52, 157–168. [Google Scholar] [CrossRef]
- Zhang, D.; Yang, G.; Khurshid, R.P. Haptic teleoperation of UAVs through control barrier functions. IEEE Trans. Haptics 2020, 13, 109–115. [Google Scholar] [CrossRef] [PubMed]
- Lee, M.; Lee, D. A Distributed two-layer framework for teleoperated platooning of fixed-wing UAVs via decomposition and backstepping. IEEE Robot. Autom. Lett. 2021, 6, 3655–3662. [Google Scholar] [CrossRef]
- Fu, J.; Rota, A.; Shufei Li, A.; Zhao, J.; Liu, Q.; Iovene, E.; Ferrigno, G.; Momi, E. Recent advancements in augmented reality for robotic applications: A survey. Actuators 2023, 12, 323. [Google Scholar] [CrossRef]
- Zhang, Q.; Liu, Q.; Duan, J.; Qin, J. Research on teleoperated virtual reality human–robot five-dimensional collaboration system. Biomimetics 2023, 8, 605. [Google Scholar] [CrossRef]
- Song, C.; Yang, G.; Park, S.; Jang, N.; Jeon, S.; Oh, S.-R.; Hwang, D. On the design of Integrated tele-monitoring operation system for therapeutic devices in isolation intensive care unit. IEEE Robot. Autom. Lett. 2022, 7, 8705–8712. [Google Scholar] [CrossRef]
- Aggravi, M.; Estima, D.A.L.; Krupa, A.; Misra, S.; Pacchierotti, C. Haptic teleoperation of flexible needles combining 3D ultrasound guidance and needle tip force feedback. IEEE Robot. Autom. Lett. 2021, 6, 4859–4866. [Google Scholar] [CrossRef]
- Feng, F.; Zhou, Y.; Hong, W.; Li, K.; Xie, L. Development and experiments of a continuum robotic system for transoral laryngeal surgery. Int. J. Comput. Assist. Radiol. Surg. 2022, 17, 479–505. [Google Scholar] [CrossRef]
- Wakasa, Y.; Hakamada, K.; Morohashi, H.; Kanno, T.; Tadano, K.; Kawashima, K.; Ebihara, Y.; Oki, E.; Hirano, S.; Mori, M. Ensuring communication redundancy and establishing a telementoring system for robotic telesurgery using multiple communication line. J. Robot. Surg. 2024, 18, 9. [Google Scholar] [CrossRef]
- Zhaoa, B.; Nelson, C.A. A sensorless force-feedback system for robot assisted laparoscopic surgery. Comput. Assist. Surg. 2019, 24, 36–43. [Google Scholar] [CrossRef] [PubMed]
- Schleer, P.; Körner, D.; Vossel, M.; Drobinsky, S.; Radermacher, K. Conceptual design of force reflection control for teleoperated bone surgery. Curr. Dir. Biomed. Eng. 2020, 6, 20200014. [Google Scholar] [CrossRef]
- Muñoz, V.F.; Garcia-Morales, I.; Fraile-Marinero, J.C.; Perez-Turiel, J.; Muñoz-Garcia, A.; Bauzano, E.; Rivas-Blanco, I.; Sabater-Navarro, J.M.; de la Fuente, E. Collaborative robotic assistant platform for endonasal surgery: Preliminary in-vitro trials. Sensors 2021, 21, 2320. [Google Scholar] [CrossRef]
- Quek, Z.F.; Provancher, W.R.; Okamura, A.M. Evaluation of skin deformation tactile feedback for teleoperated surgical tasks. IEEE Trans. Haptics 2019, 12, 102–113. [Google Scholar] [CrossRef] [PubMed]
- Patel, R.V.; Atashzar, S.F.; Tavakoli, M. Haptic feedback and force-based teleoperation in surgical robotics. Proc. IEEE 2022, 110, 1012–1027. [Google Scholar] [CrossRef]
- Gong, Y.; Ji, Y. A Novel Passivity Criterion for bilateral teleoperation under event triggered PD-like control with constant time delays. Int. J. Control Autom. Syst. 2022, 20, 2353–2363. [Google Scholar] [CrossRef]
- Bao, J.; Fu, L.; Zhang, H.; Zhang, A.; Guo, W.; Chen, T. An adaptive proportional plus damping control for teleoperation systems with asymmetric time-varying communication delays. Mathematics 2022, 10, 4675. [Google Scholar] [CrossRef]
- Ahmad, U.; Pan, Y.-J. A Time Domain Passivity approach for asymmetric multilateral teleoperation system. IEEE Access 2018, 6, 519–531. [Google Scholar] [CrossRef]
- Ryu, J.-H.; Ha-Van, Q.; Jafari, A. Multilateral teleoperation over communication time delay using the time-domain passivity approach. IEEE Trans. Control Syst. Technol. 2020, 28, 2705–2712. [Google Scholar] [CrossRef]
- Bavili, R.E.; Akbari, A.; Esfanjani, R.M. Passivity-based control of nonlinear teleoperation systems with non-passive interaction forces. Intell. Serv. Robot. 2020, 13, 419–437. [Google Scholar] [CrossRef]
- Li, W.; Liu, Y.; Ding, L.; Wang, J.; Gao, H.; Deng, Z. Teleoperation of wheeled mobile robots subject to longitudinal slipping and lateral sliding by time-domain passivity controller. Mechatronics 2022, 81, 102705. [Google Scholar] [CrossRef]
- Gong, X.; Wang, L.; Mou, Y.; Wang, H.; Wei, X.; Zheng, W.; Yin, L. Improved four-channel PBTDPA control strategy using force feedback bilateral teleoperation system. Int. J. Control Autom. Syst. 2022, 20, 1002–1017. [Google Scholar] [CrossRef]
- Li, R.; Cheng, M.; Ding, R. Passivity-based bilateral shared variable impedance control for teleoperation compliant assembly. Mechatronics 2023, 95, 10305. [Google Scholar] [CrossRef]
- Uyulan, C. Robust passivity-based nonlinear controller design for bilateral teleoperation system under variable time delay and variable load disturbance. Nonlinear Eng. 2024, 13, 20220358. [Google Scholar] [CrossRef]
- Sun, D.; Naghdy, F.; Du, H. Neural Network-based Passivity Control of Teleoperation System under Time-Varying Delays. IEEE Trans. Cybern. 2017, 47, 1666–1680. [Google Scholar] [CrossRef] [PubMed]
- Yang, L.; Chen, Y.; Liu, Z.; Chen, K.; Zhang, Z. Adaptive Fuzzy Control for Teleoperation System with Uncertain Kinematics and Dynamics. Int. J. Control Autom. Syst. 2019, 17, 1158–1166. [Google Scholar] [CrossRef]
- Li, H.; Chou, W. Adaptive FNN backstepping control for nonlinear bilateral teleoperation with asymmetric time delays and uncertainties. Int. J. Control Autom. Syst. 2023, 21, 3091–3104. [Google Scholar] [CrossRef]
- Su, S.; Ji, Y. Fixed-time adaptive neural network synchronization control for teleoperation system with position error constraints and time-varying delay. Nonlinear Dyn. 2023, 111, 13053–13072. [Google Scholar] [CrossRef]
- Kebria, P.M.; Khosravi, A.; Nahavandi, S.; Wu, D.; Bello, F. Adaptive type-2 fuzzy neural-network control for teleoperation systems with delay and uncertainties. IEEE Trans. Fuzzy Syst. 2020, 28, 2543–2554. [Google Scholar] [CrossRef]
- Sun, D.; Liao, Q.; Stoyanov, T.; Kiselev, A.; Loutfi, A. Bilateral telerobotic system using type-2 fuzzy neural network based moving horizon estimation force observer for enhancement of environmental force compliance and human perception. Automatica 2019, 106, 358–373. [Google Scholar] [CrossRef]
- Zhang, J.; Xia, M.; Li, S.; Liu, Z.; Yang, J. The adaptive bilateral control of underwater manipulator teleoperation system with uncertain parameters and external disturbance. Electronics 2024, 13, 1122. [Google Scholar] [CrossRef]
- Huang, F.; Zhang, W.; Chen, Z.; Tang, J.; Song, W.; Zhu, S. RBFNN-based adaptive sliding mode control design for nonlinear bilateral teleoperation system under time-varying delays. IEEE Access 2019, 7, 11905–11912. [Google Scholar] [CrossRef]
- Hao, S.; Hu, L.; Liu, P.X. Sliding mode control for a surgical teleoperation system via a disturbance observer. IEEE Access 2019, 7, 43383. [Google Scholar] [CrossRef]
- Hu, J.; Zhang, H.; Liu, H.; Yu, X. A survey on sliding mode control for networked control systems. Int. J. Syst. Sci. 2021, 52, 1129–1147. [Google Scholar] [CrossRef]
- Guajardo-Benavides, E.; Arteaga, M. On the finite time force estimation for bilateral teleoperation of robot manipulators with time varying delays. Control Eng. Pract. 2023, 138, 105622. [Google Scholar] [CrossRef]
- Zhang, H.; Song, A.; Li, H.; Chen, D.; Fan, L. Adaptive finite-time control scheme for teleoperation with time-varying delay and uncertainties. IEEE Trans. Syst. Man Cybern. Syst. 2022, 52, 1552–1566. [Google Scholar] [CrossRef]
- Guo, S.; Liu, Z.; Li, L.; Ma, Z.; Huang, P. Fixed-time personalized variable gain tracking control for teleoperation systems with time varying delays. J. Frankl. Inst. 2023, 360, 13015–13032. [Google Scholar] [CrossRef]
- Dehghan, S.A.M.; Koofigar, H.R.; Sadeghian, H.; Ekramian, M. Observer-based adaptive force–position control for nonlinear bilateral teleoperation with time delay. Control Eng. Pract. 2021, 107, 104679. [Google Scholar] [CrossRef]
- Wang, Y.; Tian, J.; Liu, Y.; Yang, B.; Liu, S.; Yin, L.; Zheng, W. Adaptive neural network control of time delay teleoperation system based on model approximation. Sensors 2021, 21, 7443. [Google Scholar] [CrossRef]
- Tumerdem, U.; Yilmaz, N. A unifying framework for transparency optimized controller design in multilateral teleoperation with time delays. Control Eng. Pract. 2021, 117, 104931. [Google Scholar] [CrossRef]
- Zhai, D.-H.; Xia, Y. A novel switching-based control framework for improved task performance in teleoperation system with asymmetric timevarying delays. IEEE Trans. Cybern. 2018, 48, 625–638. [Google Scholar] [CrossRef] [PubMed]
- Nguyen, T.-V.; Liu, Y.-C. Advanced finite-time control for bilateral teleoperators with delays and uncertainties. IEEE Access 2021, 9, 141951. [Google Scholar] [CrossRef]
- Zakerimanesh, A.; Hashemzadeh, F.; Torabi, A.; Tavakoli, M. Controlled synchronization of nonlinear teleoperation in task-space with timevarying delays. Int. J. Control Autom. Syst. 2019, 17, 1875–1883. [Google Scholar] [CrossRef]
- Hua, C.-C.; Liu, X.P. Delay-dependent stability criteria of teleoperation systems with asymmetric time-varying delays. IEEE Trans. Robot. 2010, 26, 925–932. [Google Scholar] [CrossRef]
- Deepak, V.; Arun, N.K.; Shihabudheen, K.V. Observer based stabilization of linear time delay systems using new augmented LKF. IFAC J. Syst. Control 2023, 26, 100231. [Google Scholar] [CrossRef]
- Halder, K.; Gillam, L.; Dixit, S.; Mouzakitis, A.; Fallah, S. Stability analysis with LMI based distributed H∞ controller for vehicle platooning under random multiple packet drops. IEEE Trans. Intell. Transp. Syst. 2022, 23, 23517–23532. [Google Scholar] [CrossRef]
- Yang, Y.; Constantinescu, D.; Shi, Y. Input-to-state stable bilateral teleoperation by dynamic interconnection and damping injection: Theory and experiments. IEEE Trans. Ind. Electron. 2020, 67, 790–799. [Google Scholar] [CrossRef]
- Baranitha, R.; Rakkiyappan, R.; Li, X. T–S fuzzy model-based singlemaster multislave teleoperation systems with decentralized communication structure and varying time delays. IEEE Trans. Fuzzy Syst. 2020, 28, 3406–3417. [Google Scholar] [CrossRef]
- Bavili, R.E.; Akbari, A.; Esfanjani, R.M. Controller design for nonlinear bilateral teleoperation systems via total energy shaping. Mech. Syst. Signal Process. 2021, 150, 107239. [Google Scholar] [CrossRef]
- Estrada, E.; Yu, W.; Li, X. Stable bilateral teleoperation with phase transition and haptic feedback. J. Frankl. Inst. 2021, 358, 1940–1956. [Google Scholar] [CrossRef]
- Islam, S.; Liu, X.P.; Saddik, A. Nonlinear adaptive control for teleoperation systems with symmetrical and unsymmetrical time-varying delay. Int. J. Syst. Sci. 2015, 46, 2928–2938. [Google Scholar] [CrossRef]
- Islam, S.; Liu, P.X.; Saddik, A.E. Nonlinear control for teleoperation systems with time varying delay. Nonlinear Dyn. 2014, 76, 931–954. [Google Scholar] [CrossRef]
- Islam, A.; Liu, P.X.; Saddik, A.E.; Yang, Y.B. Bilateral control of teleoperation systems with time delay. IEEE/ASME Trans. Mechatronics 2015, 20, 1–12. [Google Scholar] [CrossRef]
- Hu, J.; Wang, Z.; Gao, H.; Stergioulas, L.K. Robust sliding mode control for discrete stochastic systems with mixed time delays randomly occurring uncertainties, and randomly occurring nonlinearities. IEEE Trans. Ind. Electron. 2012, 59, 3008–3015. [Google Scholar] [CrossRef]
- Sun, Y.G.; Wang, L.; Xie, G. Average consensus in networks of dynamic agents with switching topologies and multiple time-varying delays. Syst. Control Lett. 2008, 57, 175–183. [Google Scholar] [CrossRef]
- Chang, Y.-H.; Chan, W.-S. Adaptive dynamic surface control for uncertain nonlinear systems with interval type-2 fuzzy neural networks. IEEE Trans. Cybern. 2014, 44, 293–304. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

























