1. Introduction
The multi-agent systems (MASs) composed of multiple robots can accomplish large-scale and complex tasks through communication, coordination, and cooperation. Their operational efficiency and overall performance are significantly superior to those of a single-agent system. Consequently, MASs have been widely applied in various fields, such as mobile robot transportation, 3D printing, welding, and other industrial applications [
1,
2]. The consensus problem, which is a representative topic in the cooperative control of MASs, refers to the design of appropriate control algorithms that enable the states or outputs of all agents to converge to a common value within a finite time. Therefore, coordination and consensus problems in multi-agent systems have attracted extensive attention from researchers, resulting in a high volume of significant research [
3,
4,
5,
6].
However, most of the existing literature on multi-agent consensus is based on integer-order system descriptions, in which the dynamics of robots are modeled using integer-order differential equations [
7,
8]. In complex natural environments, such as material mechanics, motor systems, robotic systems, and, in particular, robot dynamics, fractional calculus provides a more accurate description than traditional integer-order calculus [
9,
10]. Regarding the research on fractional-order systems, Tusset et al. develops a fractional-order bioreactor temperature model that accounts for asymmetric heat transfer via Riemann–Liouville operators, and designs a reduced-order LQR controller acting on jacket flow, which is shown to robustly and efficiently maintain reactor temperature while remaining practical for real applications [
11]. The work in [
12] addresses the lack of a unified theoretical framework for the robustness of fractional-order systems against parameter perturbations and time-delay variations. A robustness analysis framework was constructed, providing both theoretical foundations and computational tools for robustness analysis of fractional-order systems. In [
13], fractional-order control strategies for multi-agent systems with time delays were studied. Fractional-order P controllers were designed based on the generalized Nyquist criterion, and a traversal method was proposed to determine feasible controller parameter ranges for multi-robot and distributed cooperative systems. Bappa et al. investigated controller design and stability analysis for fractional-order nonlinear time-delay systems, proposing two delay-independent stability criteria. Nonlinear terms were compensated through feedback controllers, and the system stability was verified using Lyapunov functions [
14]. The above studies primarily focused on the “mathematical analysis” and “model formulation” of fractional-order systems. Strictly speaking, integer-order systems can be regarded as special cases of fractional-order systems. Therefore, with the increasing interest in multi-agent systems, many researchers have gradually shifted their focus from integer-order models to fractional-order models [
11,
12,
13,
14].
In the field of fractional-order control systems, Yu et al. were among the first to investigate the consensus control problem of fractional-order multi-agent systems (FOMASs), and established fundamental convergence criteria for leader–follower fractional-order multi-agent systems [
11,
12]. Subsequently, Bai et al. [
13] studied the consensus problem of fractional-order multi-agent systems under both fixed reference states and time-varying reference states. Similarly, the work in [
14] introduced and analyzed the concept of consensus in fractional-order dynamics, and proposed a consensus control algorithm based on relative output measurements. Furthermore, Yu et al. employed graph theory and Lyapunov-based methods to investigate the consensus problem of nonlinear FOMASs with a leader, and derived consensus criteria for nonlinear fractional-order multi-agent systems. On this basis, further studies on nonlinear FOMASs were conducted, and stability theories for fractional differential systems were developed using matrix inequalities and Lyapunov stability analysis [
15,
16]. In addition, the work in [
17] presented necessary and sufficient conditions for the consensus control of FOMASs with leaders, and designed an observer-based approach to solve the consensus problem. Moreover, adaptive control and sliding mode control methods were proposed in [
18,
19], respectively, to address the consensus control problem of fractional-order multi-agent systems.
However, most of the aforementioned studies focused on asymptotic consensus convergence, whereas fractional-order multi-agent systems with repetitive operation characteristics, such as coordinated multi-manipulator operations on production lines, typically require complete consensus within a finite time interval. Obviously, the existing results are insufficient to meet such practical requirements. Among the existing control strategies, iterative learning control (ILC) is capable of achieving complete tracking within a finite time interval for systems performing repetitive tasks. For integer-order multi-agent systems (IOMASs), a substantial number of studies have applied ILC to various system models and achieved satisfactory results [
20,
21,
22]. In contrast, research on fractional-order iterative learning control (FOILC) for fractional-order multi-agent systems remains very limited. Moreover, in practical engineering systems, owing to the characteristics of digital signal processors (DSPs), communication networks, and other processing units, state delays are often inevitable. Therefore, investigating the consensus problem of FOMASs with state delays is of significant practical and engineering relevance.
In this paper, considering the existence of time delays, three PDα-type fractional-order iterative learning control (FOILC) schemes, namely, open-closed-loop FOILC, closed-loop FOILC, and open-loop FOILC, are proposed to address the consensus problem of robot-based fractional-order multi-agent systems (FOMASs). The proposed PDα-type FOILC law integrates an open-loop component, which utilizes the control input from the previous iteration, and a closed-loop component, which exploits the real-time tracking error in the current iteration. This combined structure effectively incorporates historical learning information while responding to current disturbances, thereby accelerating convergence and enhancing system robustness. Based on graph theory, norm theory, and fundamental results from fractional calculus, the finite-time consensus convergence of the proposed algorithms for FOMASs with time delays have been rigorously analyzed and theoretically established. Finally, numerical simulations were conducted to verify the effectiveness of the proposed control strategies, and comparative analyses were performed to illustrate their respective performance characteristics.
2. Basic Knowledge and Problem Description
2.1. Graph Theory
We consider a system consisting of n fractional multi-agents. The communication connections between different individuals constitute a network topology . And represents the directed network weighted graph, where is the set of nodes and is the set of edges in the network topology, representing the index set of the node. The adjacency matrix of the network topology is represented by , where represents the connection weight from node i to node k. If node i transmits information to node k, then , otherwise . We also assume that each node in the network has no self-connection phenomenon, that is for .
We define the set of neighbor nodes of network node i as . We define , where is the sum of the elements in the i-th row of the network adjacency matrix M. As such, the Laplacian matrix of graph G is . For the two nodes i and k, if there is a set of subscripts that satisfy , , , and , then there is an information transmission channel between node i and node k, and it also means that node k can receive the information of node i. If a path can be found to reach any node in the graph for node i, it means that node i becomes globally reachable.
Lemma 1. Assumes a fractional-order multi-agent system comprising n autonomous individuals, where its connection topology is a directed weighted network and there is at least one globally reachable node in the network. Consequently, the rank of the Laplacian matrix L of the connection topology graph is , and there is a 0 eigenvalue. The corresponding feature vector is
2.2. Fractional Calculus and Norm Theories
The fractional calculus used in this paper is defined as follows [
23]:
Definition 1. In the interval
, the left-sided and the right-sided Riemann-Liouville’s fractional integral of order
for a function
are defined as
where
is Gamma function. The left-sided and the right-sided Caputo derivative are given by where , is the integral part of .
Lemma 2. For the continuous function
, as shown in (4),
Then, the equivalent Volterra type nonlinear integral equation for the initial value problem is We use and to denote any set of real numbers and complex numbers, and use to denote the set of natural numbers. For a vector , represents the norm of the vector , where . In fact, when p takes 1, 2 and ∞, we have , , and . For the matrix , represents the matrix norm and is the spectral radius of the matrix . In this paper, means the Kronecker product, represents the identity matrix.
2.3. Fractional Multi-Agent Model with State Delay
We assume that the fractional multi-agent with leader includes
N multi-agents, defined as 1, 2, 3,…,
N. The model of each fractional multi-agent is described as:
where
,
, and
are the state, input, and output vectors of the
j-th agent at the
i-th iteration, respectively,
means the
-order derivative of
,
i is the number of iterations, and
j means the
j-th agent. The matrices
,
, and
are constant, while
and the initial condition function
for
and
.
Formula (7) can be written in the multi-agent vector form as
where
,
,
, and
, with
representing the Kronecker product. In this paper, the expected trajectory
is generated by the leader as expressed in Formula (6) in the time interval
, and the leader is defined as
where
is the desired input.
Due to the limitations with either communication or sensors, the leader can only communicate with some multi-agents. The communication network can be defined as and the leader’s number as 0, and the complete graph containing the leader can be expressed as , where represents the corresponding edge in the new graph. The main task of this paper is to design a suitable fractional-order iterative learning controller to ensure that each multi-agent converges to the desired trajectory in the sense of the new graph .
Our definition for
as distributed error is as follows:
where
is the weight of the
-th neighborhood of the adjacent-order matrix
,
is the domain set of the
j-th multi-agent, and
is the sum of the elements in the
i-th row of the network adjacency matrix. If
, then the
j-th multi-agent can receive information from the leader, that is
, otherwise
. The error is defined as
.
Then, the open-closed
type FOILC is designed as:
where
denotes the α-th order derivative of
, and according to Equation (10) and the error expression we have:
The column vector is defined as
,
, and
. Therefore, Equation (12) can be rewritten as
where
L is the Laplacian matrix of graph
and
, and
m is the dimension of state
.
According to (13), the controller in Equation (10) is written as a matrix vector as follows:
In order to facilitate analysis, we define and as the eigenvalues of the matrix .
Remark 1. The proposed PDα-type FOILC law combines an open-loop component (utilizing the control input from the previous iteration) and a closed-loop component (utilizing the real-time tracking error from the current iteration). This structure leverages past experience while reacting to current disturbances, aiming to accelerate convergence and improve robustness.
3. Convergence Analysis
In order to facilitate the convergence analysis of the proposed algorithm, the following assumptions were established:
Assumption 1. The initial state of each subsystem (6) when it repeatedly runs on the interval
is equal to the expected initial state, that is, for all
,
is held.
Remark 2. In order to ensure more perfect tracking results, the initial value conditions in Assumption 2 need to be established in the ILC design. However, if the assumption does not hold, Optimal tracking can never be realized without an optimal initial condition. The initial state learning control is discussed in [24]. Assumption 2. The augmented communication graph contains a directed spanning tree with the leader (node 0) as the root.
Remark 3. This Assumption 2 is a pre-requisite for the FOMASs consensus tracking problem which states that all followers have access to the leader. Otherwise, due to the absence of data to make their control inputs accurate, the isolated agents cannot track the leader’s trajectory.
Theorem 1. Consider the fractional-order multi-agent system (8) under the conditions of graph
, assumptions 1–2. If the communication graph satisfies Assumption 2, and the distributed open-closed-loop PDα-type ILC law (13) is applied with learning gain matrices
,
,
,
satisfying the following conditions:
- (1)
- (2)
,
wherethen, as the iteration number increases i→∞, the tracking error
converges uniformly to zero on [0, T], i.e.,
,
for all j. Where is the unit matrix, and is a constant, , is the Laplacian matrix, .
Proof. We define
where
and
are the vector forms of
and
, and when
, we have
Hence
According to the definition of error and Assumption 1, we have
Based on Lemma 2 we have
Thus we can obtain
By taking the norm on both sides of Equation (20) at the same time, and according to Definition 1, we have
When
is held, we can obtain
Then, based on Equations (8) and (15), we have
By taking (18) and (19) into (23), we have
Sorting (24), we can obtain
By taking the norm on both sides of Equation (24) at the same time, we have
where
Thus, according to Equation (25), we can obtain
According to our theory, when
is held and based on (26), we have
It can be seen that as the number of iterations increases, when
, we have
According to (21) and (29), we can obtain
Equation (32) shows that the error of the FOMASs converges to 0. The proof is complete. □
For the controller shown in Equation (14), the open-closed-loop PD
α-type will degenerate into the open-loop PD
α-type fractional-order algorithm when
and
, which has the following form
Corollary 1. Consider the fractional-order multi-agent system (8) under the conditions of graph
, Assumptions 1 and 2. If the communication graph satisfies Assumption 2, and the distributed open-closed-loop PDα-type ILC law (33) is applied with learning gain matrices
,
satisfying the following conditions:
where . Then . Namely, the output converges uniformly to the desired trajectory as .
Similarly, for the controller shown in Equation (14), the open-closed-loop PD
α-type will degenerate into the closed-loop PD
α-type fractional-order algorithm when
and
, which has the following form
Corollary 2. Consider the fractional-order multi-agent system (8) under the conditions of graph
, Assumptions 1 and 2. If the communication graph satisfies Assumption 2, and the distributed open-closed-loop PDα-type ILC law (35) is applied with learning gain matrices
,
satisfying the following conditions:
where . Then . Namely, the output converges uniformly to the desired trajectory as .
Remark 4. According to the conditions of the Theorem 1, Corollary 1 and 2, the convergence condition of the control law in the sense of Lebesgue-p norm is determined by the learning gain and the system’s own properties.
Remark 5. In this paper, because the directed graph
is a connected graph, the matrix
is a positive definite matrix. Thus, we can obtain that the matrix
is the Hurwitz stable matrix, so the gain matrix
can be found to satisfy the conditions in Theorem 1 and (33) or (35).
4. Simulation Results
In order to verify the effectiveness of the proposed method, we considered a network containing delayed fractional-order multi-agents as shown in
Figure 1, where the virtual leader and followers are numbered 0, 1, 2, 3, and 4, and the leader and followers are represented by dotted lines.
From
Figure 1, the adjacency matrix
and
were
Then the Laplacian matrix can be obtained as
In this paper, the fractional-order multi-agent with state delay can be described as follows
The expected trajectory of the multi-agent was . In the simulation example, we set the fractional derivative α = 0.85, and the initial state and initial input of each iteration are 0 for all agents. That is , , and .
According to Theorem 1, we set the gain matrix to be
,
,
, and
. Thus, we obtained
, which satisfied the conditions in Theorem 1. In order to verify the effectiveness of the proposed method and the robustness to the delay time, the delay time was set to 0.1 and 0.5, or h = 0.1 and h = 0.5. The simulation results are shown in
Figure 2 and
Figure 3, which show the simulation results with the delay time of h = 0.1 and h = 0.5, respectively.
Figure 2a,
Figure 2b, and
Figure 2c represent the tracking results of the 5th, 10th, and 50th iterations, respectively.
Figure 2d shows the absolute value of the maximum errors in each iteration as the number of iterations changes. It can be seen from these results that as the number of iterations increased, each fractional-order multi-agent gradually tracked the desired trajectory. When h = 0.5, the maximum errors of the four followers were 0.0009, 0.0012, 0.0011, and 0.0015 at the fiftieth iteration, respectively. When compared with
Figure 2,
Figure 3 shows the tracking results where it can be seen that its convergence speed slowed down when h = 0.1 and the delay increased.
In addition, from the point of view of the convergence speed of each multi-agent, multi-agents 1 and 3 converged the fastest, while 2 and 4 converged slower. This is because multi-agents 1 and 3 could directly obtain information from the virtual leader.
According to Corollary 1 and the controller in Equation (32), we set the gain matrix to be
and
. Similarly to Case 1, the delay time is set to 0.1 and 0.5, or h = 0.1 and h = 0.5. The simulation results are shown in
Figure 4 and
Figure 5.
Figure 4a and
Figure 5a,
Figure 4b and
Figure 5b, and
Figure 4c and
Figure 5c represent the tracking results of the 5th, 10th, and 50th iterations, respectively.
Figure 4d and
Figure 5d show the absolute value of the maximum errors of each iteration as the number of iterations changes. As the number of iterations increased, the multi-agents gradually tracked the desired trajectory. When compared with the open-closed-loop PD
α-type FOILC under the same number of iterations, the control effect of the open-closed-loop PD
α-type FOILC was better than that of the open-loop PD
α-type FOILC. Thus, the introduction of closed-loop control in the open-closed-loop PDα-type FOILC improved the control performance and increased the convergence speed. In addition, it can be seen that the convergence speed slowed down when the delay increased.
According to Corollary 2 and the controller in Equation (34), we set the gain matrix to be
and
. Similar to the initial conditions in Case 1 and Case 2, the delay time was set to h = 0.1 and h = 0.5. When compared with the open-closed-loop PD
α-type FOILC and closed-loop PD
α-type FOILC, as shown in
Figure 6 and
Figure 7, we found that the close-loop PD
α-type FOILC has the slowest convergence speed.
According to Corollary 1 and Corollary 2 in the paper, we conducted simulation verification on the convergence of the fractional-order open-loop iterative learning control and the closed-loop iterative learning control, respectively. In the simulations, the delay time was set to 0.1 s, i.e.,
h = 0.1. The control parameters for both open-loop and closed-loop schemes were kept consistent with those in the paper, i.e.,
. By taking α as 0.2, 0.6, 0.95, and 1, respectively, we verified the convergence of the fractional-order multi-agent system under the fractional-order open-loop iterative learning control and the fractional-order closed-loop iterative learning control. The simulation results are shown in
Figure 8,
Figure 9,
Figure 10,
Figure 11,
Figure 12,
Figure 13,
Figure 14 and
Figure 15.
From the results of the fractional-order open-loop iterative learning control, it can be observed that when α = 0.2 and 0.95, the system failed to converge under the fractional-order open-loop iterative learning control strategy. For α = 0.4 and 0.6, although the fractional-order multi-agent system gradually converged, its convergence speed was noticeably slower compared with the control results for α = 0.85 under the same model and the same control law as discussed in the paper.
Regarding the simulation results under the fractional-order closed-loop iterative learning control, it can be seen that for different values of α, the fractional-order multi-agent system remained convergent in all cases. However, the convergence rate increased as α approached the system order of 0.85. Notably, when α = 1, the system failed to converge.
In nature, many actual physical systems have fractional-order dynamic characteristics, but the integer-order calculus theory that has been used is only a special case of the fractional-order calculus theory, which can only approximate the actual fractional-order system. However, the theory of fractional calculus can describe and reflect the nature of the object more truthfully and accurately, and through the fractional-order controller, the system can achieve better performance. Therefore, it is of great significance to the research results of this article.