1. Introduction
Generally, a teleoperation system consists of at least one master manipulator controlled by the operator and a slave manipulator that remotely mimics the maneuvers of the master robot. When there is a teleoperation system with a master robot and a slave robot, a bilateral information flow is established between the two sites, thus forming a bilateral teleoperation system [
1]. With the upgrading of communication networks and the progress of technical means, the bilateral teleoperation system is being extended to a multilateral teleoperation system. Compared with bilateral teleoperation, which can only be performed by a single person remotely, multilateral teleoperation has attracted increasing attention in recent years because of its advantage of multi-person cooperation to better accomplish more complex tasks. Similar to bilateral teleoperation, multilateral teleoperation also requires force perceived from the slave site to be fed back to the master site so that there can be actual kinesthetic coupling between the operator and the environment, which is better than traditional ocular or audio information [
2,
3]. In practice, the multi-master and multi-slave multilateral teleoperation system is more complex than the traditional single-master and single-slave bilateral teleoperation system, and it is more prone to problems such as multi-communication delay and partial failure of actuators, which brings great challenges to research. Odd-come-shortly, some effective research schemes have been expended for multilateral teleoperation systems, such as fuzzy control [
4], finite-time control [
5,
6], adaptive control [
7], sliding mode control [
8], robust control [
9], backstepping control [
10], adaptive robust control [
11,
12], and so on. However, most recent research results have been obtained without considering any faults, and the problems of partial actuator failure and fault-tolerant control of time-varying delays in multi-degree-of-freedom nonlinear teleoperation systems have not yet been fully investigated. In addition, most studies are limited to the tracking of operating forces while ignoring the telepresence provided by environmental forces to operators. These are the points that motivated the research carried out for this paper.
Among the many methods to solve the failure problem, the fault-tolerant control (FTC) approach is an effective means. In current mainstream research, this method is roughly divided into two branches: active fault-tolerant control (AFTC) [
13] and passive fault-tolerant control (PFTC) [
14]. The PFTC algorithm is obtained by considering all the fault modes and the normal running state of the system in the design phase [
15]. Ref. [
16] proposes a novel fault alarm based on a hybrid fault-tolerant control scheme, and the corresponding design system meets the performance requirement of being hybrid passive/
. A novel packet-dropout-probability-dependent PFTC approach is presented in [
17] for nonlinear networked control systems. In [
18], a fresh
performance index with a summation inequation and S-procedure is proposed for an uncertain discrete-time piecewise-affine (PWA) system with communication delay and actuator failure. For a type of uncertain discrete-time T-S fuzzy systems with actuator saturation and infinite distributed delays, a PFTC algorithm is presented in [
19]. But then, the AFTC method provides fault information to the corresponding controller through an adaptive algorithm or fault detection, isolation, and analysis mechanism, so that the controller can be reconfigured [
20,
21]. For example, ref. [
22] contrived an AFTC to solve the attitude control of spacecraft with actuator failures, model uncertainties, and evaluation errors. For the conundrum of bi-directional uncertainty and fault estimation, a new hybrid fault estimation and fault-tolerant control algorithm was proposed in [
23]. In [
24], a new synthesis method (including a collaborative AFTC and a high-gain observer like-protocol) was provided to overcome multiple types of topology and actuator failures. In fact, the occurrence of system failure often comes from the gradual seriousness of failures, and the characteristic of actuator failure of a nonlinear multilateral teleoperation system is seldom discussed in the existing research, and this is the third point that motivated this research article.
The main contributions of this article are as follows:
(a) The investigated nonlinear dynamics of teleoperation systems with multiple masters and multiple slaves are modeled as a type of T-S fuzzy system with multiple communication delays.
(b) Inspired by the fact that the probability of minor failure exists in a way that is often greater than that of serious failure in theory, a novel failure distribution model is established to reflect the distribution characteristic of failures.
(c) There may be actuator failure in multi-master and multi-slave robots, and a series of failure-distribution-dependent fuzzy fault-tolerant controllers are designed, respectively, to ensure force tracking and positional synchronization (master–slave and slave–slave) simultaneously.
The rest of this article is divided into the following parts: the model of a nonlinear multilateral teleoperation system is established in
Section 2. In
Section 3, a fault-tolerant
controller is designed for the considered nonlinear multilateral teleoperation system. In
Section 4, the effectiveness of the designed controller is verified through a numerical simulation. Finally, the conclusion of this article is summarized.
2. System Modeling
Throughout the article, the following notations are defined: denotes the n-dimensional Euclidean space, while is the real matrix of all . represents a block-diagonal matrix, and ′∗′ is a symmetric term in a symmetric matrix. stands for the mathematical expectation, and denotes the transpose of the matrix A. For a square matrix X and for subsequent simplicity, let us denote .
The model of a multilateral teleoperation system can be illustrated as [
25]
where the subscripts
m and
s stand for the master manipulator and the slave manipulator, respectively. For brevity, one can denote
and
.
,
, and
represent joint displacement, joint velocity, and joint acceleration vectors, respectively.
represents mass inertia matrices.
describes coriolis and centripetal matrices.
represents gravitational torques.
denotes control torques.
and
represent the human operator force and environmental force, respectively. The control torques with gravity compensation are designed as
, where
is the controller output corresponding to the master–slave robot pair. The structure diagram of multilateral teleoperation system is shown in
Figure 1.
Substitute
into System (1), so that System (1) can be re-represented as
For simplicity, consider that the multilateral teleoperation system consists of
N master robots and
N slave robots, both of which have two degrees of freedom. The configuration of a two-link robot is displayed in
Figure 2, where
represents the link massed, and
,
.
denotes the link lengths [
26].
As in [
4,
27,
28], we define
,
,
and
. Then, System (2) can be described as
where
and
In practice, partial actuator failure is one of the important factors leading to system instability. As in [
17,
29], the application of fault-tolerant control is an appropriate way to solve partial actuator failures. The controller is designed as
, where
denotes the partial actuator failure coefficients, which satisfy
There are two cases: when
, it means that the
ith actuator has partial failure; when
, the
ith actuator is operating normally. It is worth noting that in the above failure description, the failure distribution is the same. However, in practice, the distribution of failures is different, and minor failures are always more probably to occur than serious failures. In other words, select an appropriate scalar
in the interval
to divide the interval into two subintervals as
,
. From the failure features, majority of the actuator failures fall under the interval
as minor failures. The serious failure occurs at a low probability, which belongs to the interval
. Due to the characteristic of partial actuator failures, the failure matrix can be redefined as
where
belongs to the set
and is a random variable. In this research, the distribution probability of
is defined as
, and it obeys the Bernoulli distribution. According to the novel failure matrix with failure distributions (4) of the above design, the fault-tolerant controllers can be defined as
where
In this paper,
and
are the nominal controllers to be contrived. Obviously, due to System (3) being a kind of nonlinear system with actuator failure, it is difficult to design the corresponding fault-tolerant controller directly for such a system. In order to solve this problem, the nonlinear system (System 3) is modeled as a Takagi–Sugeno (T-S) fuzzy system, and some fuzzy IF-THEN rules can be used to describe it. Among them, the fuzzy rules (
) regarding the master robot can be written as
where
denotes the fuzzy set,
L represents the number of IF-THEN rules, and
are the premise variables. From this, the fuzzy system of the master manipulator can be deduced as follows:
where
We assume that
and
. Denoting
/
, it is obvious to infer that
for
and
. Thus, the model of the master manipulator can be depicted as
Similarly, the slave manipulator can be modeled as
For the fuzzy model of the master manipulator (7), select one of the following fuzzy controllers, as follows:
Control Rule k:
where
. Then, the nominal fuzzy logic controller for the master manipulator (7) is obtained as
Similarly, for slave manipulator (8), the nominal fuzzy controller is given as
Remark 1. Here, the position tracking errors between the master manipulators and slave manipulators are defined aswhere are the dominance factors having values in (see [30]), and . The position synchronization of the masters and slaves could be achieved, i.e., and . Assumption 1. We assume that denotes the delay from master i to slave i, and denotes the delay from slave v to master i. Here, it is assumed that the communication delay of each pair of master–slave manipulators is asymmetrically and continuously differentiable functions, satisfyingin which , . Additionally, μ, , and are positive scalars. Substituting Equations (5) and (9) into Equation (
7), it follows that
Similarly, the following results can be derived from Equations (5), (8), and (10):
Assuming that all the premise variables of the master manipulators and the slave manipulators are the same, one can obtain
where
A new variable
is defined as the controlled output:
Before construing the closed-loop system stability of Equations (13) and (14), basic lemmas are introduced beforehand, as follows:
Lemma 1 ([
31])
. For any symmetric constant matrix , as well as scalars α and β satisfying , a vector function ω: , such that the integration concerned exists; thus, Lemma 2 ([
32])
. Let , M and N be real symmetric matrices of suitable dimensions with satisfying , then the following inequality holds:if and only if there exists a scalar , such that Lemma 3 (Schur complement: [
33])
. Given a symmetric matrixthe following statements are equivalent: Main Results
In this section, the stability of the closed-loop systems (13), and (14) will be examinated. The issue will be depicted in more detail, as follows: on the premise of ensuring the mean square stability of the system (13) with a predefined performance requirement, a suitable fault-tolerant controller is designed.
1. The system (13) is a mean-square stable system with .
2. Under the premise of the initial condition being zero and given a noise attenuation level
, the system can live up to the following performance requirements.
The first result is obtained as follows:
Theorem 1. For positive scalar , there exist positive definite symmetrical matrices , , , , , and matrix N with suitable dimensions. Given the appropriate controller gains and , , as well as matrices and , the following linear matrix inequality is satisfied, and then the closed-loop system (13) is a mean-square stable system with an disturbance attenuation level γ.where Proof. The following Lyapunov–Krasovskii functions can be considered:
Then, the differentiation of
can be described as
Under the premise of the time-varying delay assumed above, using Lemma 1 yields
By substituting Equation (
14) into (18), it follows that
Using free-weight matrix technology yields
where
From the above Equations (19) and (20), one can induce that
where
Next, the system performance requirement can be structured, as follows:
Define
If
holds,
in Equation (
15) is naturally satisfied. Then, it follows that
It is clear that the system (13) is a mean-square stable system with
. In addition, Inequality (15) demonstrates that
holds. Furthermore, according to the initial condition of zero, by colligating both sides of Equation (
22) from 0 to t and setting
, one has
Thus, the performance requirement is achieved. This means that the system (13) is a mean-square stable system at the level
of interference attenuation
. □
Next, the second theorem derived from the first theorem is used to design the controller gains and .
Theorem 2. Given suitable matrices and , design the controller gains as , . For a positive scalar , there exist positive definite symmetrical matrices , , , , , and matrix , , with suitable dimensions; thus, the following linear matrix inequalities are satisfied, and then the closed-loop system (13) is a mean-square stable system with an disturbance attenuation level γ.where Proof. We multiply
and
on the left and right sides of
(15), respectively. Denoting
,
,
,
,
,
, the results listed below are derived:
Through the Schur complement of Lemma 3, the corresponding result in Equation (
23) is directly obtained. □
However, in Theorems 1 and 2, we assume that
and
are already known, and they are represented as follows:
Define
and Equation (
24) can be rewritten as
Nevertheless, in practice, the accurate values of
,
,
, and
are unknown beforehand. In order to address this problem, we introduce the characteristics of
,
,
, and
. For the purpose of being concise,
j is used to represent m and s, that is,
indicates the master robot and
indicates the slave robot; thus, the following results can be derived:
Then, for
, it follows that
Define
and
can be rewritten as
Replacing Equation (
27) by Equation (
25),
and
can be depicted as
From Equation (
28), one can obtain the following theorem:
Theorem 3. For positive scalars , , , there exist positive definite matrices , , , , , and matrices , and with appropriate dimensions, the following linear matrices inequality holds, and the closed-loop system (13) is a mean-square stable system with an disturbance attenuation level γ.where Proof. Replace
and
of Equation (
28) into
of Equation (
23); then,
can be separated into two subparts, as
, where
indicates the constant part and is expressed as follows:
where
denotes the uncertain part and it is depicted as
By applying Lemmas 2 and 3, the corresponding result in Equation (
29) can be obtained directly. □
3. Numerical Example
To validate the effectiveness of the closed-loop system (13), four identical two-DOF manipulators are set as the master and slave parts, respectively. Slaves 1 and 2 are controlled with the control signals of Masters 1 and 2, respectively. At the same time, the signals from Slaves 1 and 2 are fed back to both the masters, so that Masters 1 and 2 can synchronously control Slaves 1 and 2. Let
,
,
, and
, with angular positions
,
,
, and
being constrained with
. We have utilized a nine-rule fuzzy model for the master manipulators and the slave manipulators, respectively. As in [
4,
28], the specific fuzzy rules for the first master manipulator are listed as follows:
where
The nine fuzzy rules for the master manipulators in System 2 and the slave manipulators are similar to the rules for the master manipulators in System 1. For simplicity, some membership functions (
Figure 3) are used for Rule 1 through Rule 9.
The communication delays are set as
The parameters of failures are selected as
,
,
,
,
, where
Through Theorem 3, the following results are obtained:
In this article, we consider the interactive torque of human operators and environments as the passive spring–damper model, which can be described as
where
denote the damping matrices of the operator and environment.
express the spring matrices of the operator and environment.
and
are the extra operator and environment torque, and they are assumed to be bounded.
,
,
,
are all positive definite and diagonal constant matrices, and
,
,
,
,
, and
.
The position tracking performance of the corresponding master–slave robots were achieved and are shown in
Figure 2. The synchronous motion performance of the slave robots is shown in
Figure 3. Obviously,
Figure 2 and
Figure 3 reflect the good displacement tracking performance of the designed control scheme, and we introduced partial actuator failure fault in the simulation period of 2 to 3 s, with the simulation results showing strong system robustness. The corresponding force feedback tracking performance of environmental force and human force is shown in
Figure 4 and
Figure 5, respectively. This reflects the good fitting and tracking performance of the controller’s environmental force and operating force. From the above results, it is obvious that the designed controller is effective, even in the case of partial actuator failure. By using the algorithm in reference [
4], a comparison example is given in
Figure 6,
Figure 7 and
Figure 8, and the closed loop is uncontrollable when actuator failure exists.