Next Article in Journal
Asymptotic and Oscillatory Properties of Noncanonical Delay Differential Equations
Next Article in Special Issue
Lower and Upper Bounds of Fractional Metric Dimension of Connected Networks
Previous Article in Journal
Nonexistence of Global Solutions to Time-Fractional Damped Wave Inequalities in Bounded Domains with a Singular Potential on the Boundary
Previous Article in Special Issue
Integral Representation of the Solutions for Neutral Linear Fractional System with Distributed Delays
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quasi-Projective Synchronization of Distributed-Order Recurrent Neural Networks

1
College of Mathematics and Statistics, Sichuan University of Science & Engineering, Zigong 643000, China
2
Department of Mathematics, Chongqing Jiaotong University, Chongqing 400074, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Fractal Fract. 2021, 5(4), 260; https://doi.org/10.3390/fractalfract5040260
Submission received: 8 November 2021 / Revised: 28 November 2021 / Accepted: 2 December 2021 / Published: 6 December 2021
(This article belongs to the Special Issue Frontiers in Fractional-Order Neural Networks)

Abstract

:
In this paper, the quasi-projective synchronization of distributed-order recurrent neural networks is investigated. Firstly, based on the definition of the distributed-order derivative and metric space theory, two distributed-order differential inequalities are obtained. Then, by employing the Lyapunov method, Laplace transform, Laplace final value theorem, and some inequality techniques, the quasi-projective synchronization sufficient conditions for distributed-order recurrent neural networks are established in cases of feedback control and hybrid control schemes, respectively. Finally, two numerical examples are given to verify the effectiveness of the theoretical results.

1. Introduction

Fractional calculus has more merits than classical integer-order calculus in the description of memory and hereditary properties for a variety of materials and processes, and has therefore been of great interest to scholars [1,2]. Many researchers have realized that fractional calculus could be fit for theoretical research and practical application of science and engineering, such as fractal geometry, signal processing, pattern recognition, dynamics of complex dielectric, viscoelastic materials, and automatic control systems [3,4,5,6,7,8]. As a general rule of fractional calculus, the distributed-order derivative was proposed by Caputo [9]. It is worth noting that a distributed-order derivative is more accurate in describing and explaining some physical phenomena, such as networked structures, the complexity of nonlinear systems, non-homogeneous, multi-scale, and multi-spectral phenomena [10,11,12,13]. Therefore, an increasing number of scholars have set out to study distributed-order derivatives. In [14], the authors studied some properties of the viscoelastic rod with a fractional distributed-order derivative and exhibited its potential applications. Moreover, differential equations need to be solved in some cases. In [15,16], the authors presented a numerical method for solving differential equations of distributed-order.
In the past decades, with the development of modern technology, neural networks have been widely applied in various fields, such as signal processing, image recognition, control theory, associative memory, and optimization [17,18,19,20,21,22]. Nowadays, fractional calculus has been introduced into neural network modelling because it improves the ability of neurons to process information [23]. Fractional order recurrent neural networks, by using sequential information, can enable it to reveal time correlations between nodes that are far away from each other in the data. Thus, the characteristics of memory are endowed to the neural networks. Therefore, it is of great significance to study the dynamic behavior of fractional order recurrent neural networks. In [24], the authors investigated the multistability of fractional-order recurrent neural networks with nonmonotonic activation functions. In [25], through the Lyapunov method, some conditions for the global Mittag–Leffler stability and synchronization were presented. In [26], several Hopf bifurcation conditions for fractional order recurrent neural networks were presented. The authors pointed out that a fractional-order equation can simulate the activity of neuron oscillation and proposed stability theory of incommensurate fractional-order models. In [27], the authors proposed a fractional-order recurrent neural network sliding mode control scheme for a class of dynamic systems. The proposed RNNFSMC scheme is used for a dynamic model of an active power filter to realize the current harmonic compensation control.
Moreover, synchronization, which has been given full attention by scholars, has a number of potential applications in practice, including cryptography, secure communication, optimization of nonlinear systems performance, etc. [28,29,30,31,32,33,34,35]. Since the two state variables of projection synchronization can synchronize to a scaling factor, this feature has a great application prospect in improving transmission speed by extending binary to M base system in secure communication. In [36], the authors proposed a necessary and sufficient condition for projective synchronization of the chaotic systems in arbitrary dimensions and provided an algorithm to obtain all the solutions of the projective synchronization problem. In [37,38], the authors respectively studied the problem of projective synchronization for fractional order chaotic systems and fractional order delayed neural networks. Authors extend the conclusion of quasi-projection synchronization over real number fields to complex number fields, and give the error bound of quasi-projection synchronization for fractional order recurrent neural networks in [39].
To the best of our knowledge, there are few results on the synchronization of distributed-order recurrent neural networks. Therefore, motivated by the above discussions, in this paper, we investigate the quasi-projective synchronization of distributed-order recurrent neural networks. First, we extend some lemmas that are true at fractional order systems to distributed-order systems. Then, by applying the feedback control, the quasi-projective synchronization of distributed-order recurrent neural networks are obtained. Finally, the quasi-projective synchronization of distributed-order recurrent neural networks are investigated in the case of a hybrid control scheme.
The main contribution of this paper can be summarized in brief as follows. (1) The quasi-projective synchronization of distributed-order recurrent neural networks is investigated for the first time. (2) Based on the definition of distributed-order derivative and metric space theory, two distributed-order differential inequalities are obtained. (3) Several sufficient criteria for quasi-projective synchronization of distributed-order recurrent neural networks are established. (4) The error bound of the model is obtained.
The rest of the paper is structured as follows. In Section 2, the distributed-order recurrent neural networks model and relevant definitions are presented. And we deduced some necessary lemmas and some results that conduce to establish sufficient conditions for the quasi-projective synchronization of distributed-order recurrent neural networks. Then, in Section 3, several sufficient conditions are proposed to ensure the quasi-projective synchronization of such neural network models. Two numerical examples in Section 4 are given to illustrate the effectiveness of the theoretical results. Finally, the paper concludes in Section 5.
Notations: In this paper, D ω ( α ) denotes ω ( α ) -order distributed-order fractional derivative operator. R , R n , and Z + respectively indicate the set of real numbers, the n-dimensional Euclidean space, and the set of positive integer.

2. Model Description and Preliminaries

In this paper, we consider the following distributed-order recurrent neural networks
D ω ( α ) x i ( t ) = p i x i ( t ) + j = 1 m k = 1 n d i j k f j ( x j ( t ) ) + q i , i = 1 , 2 , , n ,
where ω ( α ) > 0 , α ( 0 , 1 ) ; i , k Z + = { 1 , 2 , , n } , j Z + = { 1 , 2 , , m } ; x i ( t ) denotes the state vector; f j ( x j ( t ) ) : R n R n is the activation functions of the ith neuron; p i > 0 denotes the decay rate; d i j k represents the interconnection weight of the ith neuron and jth neuron; q i is the constant control input vector.
In order to investigate the synchronization, the response system is depicted as
D ω ( α ) y i ( t ) = p i y i ( t ) + j = 1 m k = 1 n d i j k f j ( y j ( t ) ) + q i + u i ( t ) , i = 1 , 2 , , n ,
where y i ( t ) denotes the state vector of response system; the rest notations are same as in drive system (1). Through feedback control, the controller u i ( t ) can be described as
u i ( t ) = g i ( y i ( t ) β i x i ( t ) ) .
Let e i ( t ) = y i ( t ) β i x i ( t ) , then the error system between the drive system (1) and the response system (2) can be written as
D ω ( α ) e i ( t ) = ( p i + g i ) e i ( t ) + j = 1 m k = 1 n d i j k f j ( y j ( t ) ) j = 1 m k = 1 n d i j k β i f j ( x j ( t ) ) + ( 1 β i ) q i .
Hypothesis 1 (H1).
The function f j ( x ) is Lipschitz continuous, i.e., for any x , y R , there exists positive constant F j such that
f j ( x ) f j ( y ) F j x y , j = 1 , 2 , , n .
Hypothesis 2 (H2).
For any j Z + , there exist positive numbers H j such that
| f j | H j .
Definition 1
([40]). The Caputo fractional derivative of order α R + is defined as
D α x ( t ) = 1 Γ ( m α ) 0 t ( t τ ) m α 1 x ( m ) ( τ ) d τ ,
where m 1 < α < m , m Z + .
Definition 2
([41]). The distributed-order derivative in the Caputo sense with respect to ω ( α ) > 0 is defined as
D ω ( α ) x ( t ) = m 1 m ω ( α ) D α x ( t ) d α ,
where m 1 < α < m , m Z + . In particular, when α ( 0 , 1 ) , it holds that D ω ( α ) x ( t ) = 0 1 ω ( α ) D α x ( t ) d α .
Definition 3
([42]). The Laplace transform of distributed-order derivative of a function is
L t s { D ω ( α ) x ( t ) } = ( L t s { x ( t ) } x ( 0 ) / s ) 0 1 ω ( α ) s α d α ,
where L t s { · } represents the Laplace transform operator.
Definition 4
([39]). Systems (1) and (2) can be said to be quasi-projectively synchronized, if there exists a small error bound ϵ > 0 such that
lim t | y i ( t ) β i x i ( t ) | ϵ ,
where β i R is the projective coefficient and β i 0 .
Lemma 1.
Suppose function h ( t ) R is continuous and differentiable on t [ t 0 , ) , it has
D ω ( α ) h ( t ) 2 2 h ( t ) D ω ( α ) h ( t ) ,
where ω ( α ) > 0 , α ( 0 , 1 ) .
Proof. 
From Definitions 1 and 2, we have
D ω ( α ) h ( t ) 2 = t 0 t ω ( α ) 1 Γ ( 1 α ) t 0 t 2 ( h ( τ ) h ( τ ) ( t τ ) α d τ d α = t 0 t ω ( α ) 2 Γ ( 1 α ) t 0 t ( h ( τ ) h ( t ) + h ( t ) ) h ( τ ) ( t τ ) α d τ d α = t 0 t ω ( α ) 2 Γ ( 1 α ) t 0 t ( h ( τ ) h ( t ) ) h ( τ ) ( t τ ) α d τ + 2 h ( t ) D α h ( t ) d α = t 0 t ω ( α ) 2 Γ ( 1 α ) t 0 t ϕ ( τ ) ϕ ( τ ) ( t τ ) α d τ + 2 h ( t ) D α h ( t ) d α ,
where
t 0 t ϕ ( τ ) ϕ ( τ ) ( t τ ) α d τ = ϕ 2 ( τ ) ( t τ ) α | t 0 t t 0 t ϕ ( τ ) d ϕ ( τ ) ( t τ ) α = lim τ t ϕ 2 ( τ ) ( t τ ) α ϕ 2 ( t 0 ) ( t t 0 ) α t 0 t ϕ ( τ ) ϕ ( τ ) ( t τ ) α d τ α t 0 t ϕ 2 ( τ ) ( t τ ) α + 1 d τ .
By transposing, it can obtain
2 t 0 t ϕ ( τ ) ϕ ( τ ) ( t τ ) α d τ = lim τ t ϕ 2 ( τ ) ( t τ ) α ϕ 2 ( t 0 ) ( t t 0 ) α α t 0 t ϕ 2 ( τ ) ( t τ ) α + 1 d τ ,
then, we have
t 0 t ϕ ( τ ) ϕ ( τ ) ( t τ ) α d τ = 1 2 lim τ t ϕ 2 ( τ ) ( t τ ) α ϕ 2 ( t 0 ) ( t t 0 ) α α t 0 t ϕ 2 ( τ ) ( t τ ) α + 1 d τ = 1 2 lim τ t 2 ϕ ( τ ) ϕ ( τ ) ( t τ ) 1 α α ϕ 2 ( t 0 ) ( t t 0 ) α α t 0 t ϕ 2 ( τ ) ( t τ ) α + 1 d τ 0 .
Submitting (15) into (12), we have
D ω ( α ) h ( t ) 2 2 h ( t ) D ω ( α ) h ( t ) .
For more details of the proof process, one can refer to the proof of Theorem 2 in [43].
Lemma 2.
If x ( t ) C 1 ( [ 0 , + ] , R ) is a continuously differentiable function, for any ω ( α ) > 0 and α ( 0 , 1 ) , the following inequality holds almost everywhere
D ω ( α ) x ( t ) s g n ( x ( t ) ) D ω ( α ) x ( t ) .
Proof. 
It is easy to obtain that x ( t ) is differentiable except several points, which belong to the set Ω = { t | x ( t ) = 0 , x ( t ) 0 } . In addition, according to measure theory, we assert that Ω is a countable set and its measure is 0.
Afterwards, we prove that inequation (17) holds except at the set Ω . Without loss of generality, the trajectory of | x ( t ) | can be depicted as Figure 1. The solid line indicating | x ( t ) | is divided into two parts by S 3 Ω . Suppose that there exists only one extreme point as point S 2 and every part is divided into two pieces like R 1 , R 2 in part A. The dash line is the trajectory of | x ( t ) | which may be the one of x ( t ) in any part. ( x s , y s ) denotes the coordinate of point S in Figure 1. When t Ω , we have
D ω ( α ) x ( t ) = 0 1 ω ( α ) 1 Γ ( 1 α ) 0 t | x ( t ) | ( t τ ) α d τ d α = 0 1 ω ( α ) 1 Γ ( 1 α ) 0 x S 3 + x S 3 t | x ( τ ) | ( t τ ) α d τ d α ,
and
s g n ( x ( t ) ) D ω ( α ) x ( t ) = s g n ( x ( t ) ) 0 1 ω ( α ) 1 Γ ( 1 α ) 0 x S 3 + x S 3 t x ( τ ) ( t τ ) α d τ d α .
In Part A, if s g n ( x ( t ) ) x ( τ ) = | x ( τ ) | , then 0 x S 3 | x ( t ) | ( t τ ) α d τ = 0 x S 3 s g n ( x ( t ) ) x ( τ ) ( t τ ) α d τ ; lif s g n ( x ( t ) ) x ( τ ) = | x ( τ ) | , according to the properties of integrals and derivatives, we have
0 x S 3 | x ( t ) | ( t τ ) α d τ = 0 x S 2 | x ( t ) | ( t τ ) α d τ + x S 2 x S 3 | x ( t ) | ( t τ ) α d τ < 1 ( t x S 2 ) α 0 x S 2 | x ( t ) | d τ + 1 ( t x S 2 ) α x S 2 x S 3 | x ( t ) | d τ = y S 1 ( t x S 2 ) α 0 .
Due to s g n ( x ( t ) ) x ( τ ) = | x ( τ ) | , then we have
0 x S 3 | x ( t ) | ( t τ ) α d τ < 0 x S 3 s g n ( x ( t ) ) x ( τ ) ( t τ ) α d τ .
In Part B, whether x ( t ) > 0 or x ( t ) < 0 , s g n ( x ( t ) ) x ( τ ) = | x ( τ ) | holds, thus
x S 5 t | x ( t ) | ( t τ ) α d τ = x S 5 t s g n ( x ( t ) ) x ( τ ) ( t τ ) α d τ .
To sum up, inequation (17) holds almost everywhere. For the case where multiple extreme points exist, in [44] the authors prove that the inequation (17) is still valid. □
Remark 1.
It is noted that a distributed-order derivative is a generalization of a fractional derivative. In Lemmas 1 and 2, if the order of the distributed-order derivative changes from ω ( α ) to α, the above two distributed-order inequalities become fractional inequalities, and their conclusions are proved in references [43,44].
Lemma 3
([45]). Let λ 1 > 0 , λ 2 > 0 , λ 3 > 1 , λ 4 > 1 and 1 λ 3 + 1 λ 4 = 1 . Then, for any ϱ > 0 , it holds that
λ 1 λ 2 1 λ 3 λ 1 ϱ λ 3 + 1 λ 4 λ 2 1 ϱ λ 4 .

3. Main Results

Theorem 1.
Under assumptions (H1) and (H2), if the following inequalities hold
λ 1 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) 2 d i j k 2 ξ j ξ i F i 2 1 > 0 ,
λ 2 = i = 1 n ξ i j = 1 m k = 1 n H j 2 ( 1 + β i 2 2 β i ) + ( 1 β i ) 2 q i 2 > 0 ,
L 1 1 0 1 ω ( α ) s α d α + λ 1 0 ,
and the roots of 0 1 ω ( α ) s α d α + λ 1 are in the open left-half complex plane, then systems (1) and (2) can achieve quasi-projectively synchronized under the controller (3).
Proof. 
Consider the Lyapunov function candidate as follows
V ( t ) = i = 1 n ξ i e i 2 ( t ) ,
where ξ i is positive constant.
According to Lemma 1, it shows that
D ω ( α ) V ( t ) i = 1 n 2 ξ i e i ( t ) D ω ( α ) e i ( t ) = 2 i = 1 n ξ i e i ( t ) [ ( p i + g i ) e i ( t ) + j = 1 m k = 1 n d i j k f j ( y j ( t ) ) f j ( β j x j ( t ) ) + j = 1 m k = 1 n d i j k f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) + ( 1 β i ) q i ] = i = 1 n ξ i 2 ( p i + g i ) e i 2 ( t ) + i = 1 n ξ i [ j = 1 m k = 1 n 2 e i ( t ) d i j k f j ( y j ( t ) ) f j ( β j x j ( t ) ) + j = 1 m k = 1 n 2 e i ( t ) d i j k f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) ] + i = 1 n ξ i 2 e i ( t ) ( 1 β i ) q i i = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) + i = 1 n ξ i d i j k 2 e i 2 ( t ) + f j ( y j ( t ) ) f j ( β j x j ( t ) ) 2 + i = 1 n ξ i d i j k 2 e i 2 ( t ) + f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) 2 + i = 1 n ξ i e i 2 ( t ) + ξ i ( 1 β i ) 2 q i 2 i = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) + i = 1 n ξ i e i 2 ( t ) j = 1 m k = 1 n d i j k 2 + ξ j ξ i F i 2 + i = 1 n ξ i j = 1 m k = 1 n d i j k 2 e i 2 ( t ) + H j 2 ( 1 + β i 2 2 β i ) + i = 1 n ξ i e i 2 ( t ) + ξ i ( 1 β i ) 2 q i 2 = i = 1 n j = 1 m k = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) 2 d i j k 2 ξ j ξ i F i 2 1 + i = 1 n ξ i j = 1 m k = 1 n H j 2 ( 1 + β i 2 2 β i ) + ( 1 β i ) 2 q i 2 λ 1 V ( t ) + λ 2 ,
where
λ 1 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) 2 d i j k 2 ξ j ξ i F i 2 1
and
λ 2 = i = 1 n ξ i j = 1 m k = 1 n H j 2 ( 1 + β i 2 2 β i ) + ( 1 β i ) 2 q i 2 .
Since λ 1 > 0 , λ 2 > 0 , hence, we can find n ( t ) such that
D ω ( α ) V ( t ) = λ 1 V ( t ) + λ 2 n ( t ) .
Taking the Laplace transform from both sides of (29), one has
V ( s ) V ( 0 ) s 0 1 ω ( α ) s α d α + N ( s ) = λ 1 V ( s ) + λ 2 s .
It follows from (30) that
V ( s ) = λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s N ( s ) 0 1 ω ( α ) s α d α + λ 1 ,
then
V ( t ) = L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 L 1 N ( s ) 0 1 ω ( α ) s α d α + λ 1 = L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 N ( t ) g ( t ) = L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 0 t N ( η ) g ( t η ) d η ,
where g ( t ) = L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 . Since g ( t ) 0 , N ( t ) 0 , then
V ( t ) L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 .
In light of Laplace final value theorem, we have
lim t + V ( t ) lim t + L 1 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α s 0 1 ω ( α ) s α d α + λ 1 = lim s 0 λ 2 + V ( 0 ) 0 1 ω ( α ) s α d α 0 1 ω ( α ) s α d α + λ 1 = λ 2 λ 1 .
Furthermore, one has
min 1 i n ξ i lim t + i = 1 n e i 2 ( t ) lim t + i = 1 n ξ i e i 2 ( t ) ,
which means that
lim t + e ( t ) 2 λ 2 λ 1 min 1 i n ξ i .
Thus, in accordance with Definition 4, system (1) and system (2) can be said to be quasi-projectively synchronized. □
Theorem 2.
Under assumptions (H1) and (H2), if the following inequalities hold
λ 3 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) d i j k d j i k F i 2 d i j k μ 1 > 0 ,
λ 4 = i = 1 n j = 1 m k = 1 n ξ i d i j k 2 μ H j 2 ( 1 + β i 2 ) + ξ i ( 1 β i ) 2 q i 2 > 0 ,
L 1 1 0 1 ω ( α ) s α d α + λ 3 0 ,
and the roots of 0 1 ω ( α ) s α d α + λ 3 are in the open left-half complex plane, then systems (1) and (2) can achieve quasi-projectively synchronization under the controller (3).
Proof. 
Consider the Lyapunov function candidate as follows
V ( t ) = i = 1 n ξ i e i 2 ( t ) ,
where ξ i is positive constant.
According to Lemmas 1 and 3, for any positive constant μ , it shows that
D ω ( α ) V ( t ) ξ i e i ( t ) D ω ( α ) e i ( t ) = 2 i = 1 n ξ i e i ( t ) [ ( p i + g i ) e i ( t ) + j = 1 m k = 1 n d i j k f j ( y j ( t ) ) f j ( β j x j ( t ) ) + j = 1 m k = 1 n d i j k f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) + ( 1 β i ) q i ] = i = 1 n ξ i 2 ( p i + g i ) e i 2 ( t ) + i = 1 n ξ i [ j = 1 m k = 1 n 2 e i ( t ) d i j k f j ( y j ( t ) ) f j ( β j x j ( t ) ) + j = 1 m k = 1 n 2 e i ( t ) d i j k f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) ] + i = 1 n ξ i 2 e i ( t ) ( 1 β i ) q i i = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) + i = 1 n ξ i j = 1 m k = 1 n 2 d i j k e i ( t ) e j ( t ) F j + i = 1 n j = 1 m k = 1 n ξ i d i j k μ e i 2 ( t ) + 1 μ f j ( β j x j ( t ) ) β i f j ( x j ( t ) ) 2 + i = 1 n ξ i e i 2 ( t ) + ξ i ( 1 β i ) 2 q i 2 i = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) + i = 1 n j = 1 m k = 1 n ξ i e i 2 ( t ) d i j k + d j i k F i 2 + i = 1 n j = 1 m k = 1 n ξ i d i j k μ e i 2 + 2 μ f j ( β j x j ( t ) ) 2 + β i 2 f j ( x j ( t ) ) 2 + i = 1 n [ ξ i e i 2 ( t ) + ξ i ( 1 β i ) 2 q i 2 ] i = 1 n ξ i e i 2 ( t ) 2 ( p i + g i ) + i = 1 n j = 1 m k = 1 n ξ i e i 2 ( t ) d i j k + d j i k F i 2 + d i j k μ + i = 1 n j = 1 m k = 1 n ξ i d i j k 2 μ H j 2 ( 1 + β i 2 ) + i = 1 n ξ i e i 2 ( t ) + ξ i ( 1 β i ) 2 q i 2 = λ 3 V ( t ) + λ 4 ,
where λ 3 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) d i j k d j i k F i 2 d i j k μ 1 and λ 4 = i = 1 n j = 1 m k = 1 n ξ i d i j k 2 μ H j 2 ( 1 + β i 2 ) + ξ i ( 1 β i ) 2 q i 2 .
Same as the proof of Theorem 1, by applying the Laplace transform and final value theorem, one has
lim t + e ( t ) 2 λ 4 λ 3 min 1 i n ξ i .
Thus, in accordance with Definition 4, systems (1) and (2) can be said to be quasi-projectively synchronized. □
Depending on different proof methods, we obtain Theorems 1 and 2, which have different conditions. However, they both guarantee that systems (1) and (2) can achieve quasi-projectively synchronization.
Next, we consider the following hybrid control scheme, the controller u ^ i ( t ) can be described as
u ^ i ( t ) = g i ( y i ( t ) β i x i ( t ) ) j = 1 m k = 1 n d i j k f j ( β j x j ( t ) ) + j = 1 m k = 1 n d i j k β i f j ( x j ( t ) ) ( 1 β i ) q i .
Theorem 3.
Under assumptions (H1) and (H2), if the following inequality holds
λ 5 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) μ d i j k F j 1 μ d j i k F i > 0 ,
L 1 1 0 1 ω ( α ) s α d α + λ 5 0 ,
and the roots of 0 1 ω ( α ) s α d α + λ 5 are in the open left-half complex plane, then systems (1) and (2) can achieve quasi-projectively synchronization under the controller (43).
Proof. 
Consider the Lyapunov function candidate as follows
V ( t ) = i = 1 n 1 2 | e i ( t ) | 2 ,
where ξ i is positive constant.
According to Lemmas 1 and 2, for any positive constant μ , it shows that
D ω ( α ) V ( t ) = i = 1 n 1 2 D ω ( α ) | e i ( t ) | 2 i = 1 n | e i ( t ) | D ω ( α ) | e i ( t ) | i = 1 n | e i ( t ) | s g n ( e i ( t ) ) D ω ( α ) e i ( t ) = i = 1 n | e i ( t ) | s g n ( e i ( t ) ) ( p i + g i ) e i ( t ) + j = 1 m k = 1 n d i j k f j ( y j ( t ) ) f j ( β j x j ( t ) ) i = 1 n | e i ( t ) | ( p i + g i ) | e i ( t ) | + j = 1 m k = 1 n d i j k F j | e j ( t ) | = i = 1 n ( p i + g i ) | e i ( t ) | 2 + j = 1 m k = 1 n d i j k F j | e j ( t ) | | e i ( t ) | .
By applying Lemma 3, we can obtain that
D ω ( α ) V ( t ) i = 1 n ( p i + g i ) | e i ( t ) | 2 + j = 1 m k = 1 n d i j k F j μ 2 | e i ( t ) | 2 + 1 2 μ | e j ( t ) | 2 = i = 1 n ( p i + g i ) | e i ( t ) | 2 + μ 2 j = 1 m k = 1 n d i j k F j | e i ( t ) | 2 + 1 2 μ j = 1 m k = 1 n d j i k F i | e i ( t ) | 2 = λ 5 V ( t ) ,
where λ 5 = i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) μ d i j k F j 1 μ d j i k F i .
Same as the proof of Theorem (1), by applying the Laplace transform and final value theorem, one has
lim t + e ( t ) 2 1 λ 5 min 1 i n ξ i .
Thus, in accordance with Definition 4, system (1) and system (2) can be said to be quasi-projectively synchronized. □

4. Numerical Simulation Examples

By applying the predictor—corrector scheme [46], two numerical examples are given to demonstrate the theoretical results in this section.
Example 1.
Consider the following distributed-order system
D ω ( α ) x 1 ( t ) = p 1 x 1 ( t ) + j = 1 2 k = 1 2 d 1 j k f j ( x j ( t ) ) + q 1 , D ω ( α ) x 2 ( t ) = p 2 x 2 ( t ) + j = 1 2 k = 1 2 d 2 j k f j ( x j ( t ) ) + q 2 ,
where ω ( α ) = τ 1 δ ( α α 1 ) + τ 2 δ ( α α 2 ) , α 1 = 2 3 , α 2 = 1 3 , δ ( · ) denotes Dirac function; f j ( x j ( x ) ) = tanh ( x ) , j = 1 , 2 ; q i = 1 , i = 1 , 2 and
P = d i a g ( p 1 , p 2 ) = 1.03125 0 0 1 ,
D 1 = ( d i j 1 ) 2 × 2 = 1 0 0 1 ,
D 2 = ( d i j 2 ) 2 × 2 = 1 0 1 0 ,
The response system is depicted as
D ω ( α ) y 1 ( t ) = p 1 y 1 ( t ) + j = 1 2 k = 1 2 d 1 j k f j ( y j ( t ) ) + q 1 + u 1 ( t ) , D ω ( α ) y 2 ( t ) = p 2 y 2 ( t ) + j = 1 2 k = 1 2 d 2 j k f j ( y j ( t ) ) + q 2 + u 2 ( t ) ,
where f j ( y j ( x ) ) = tanh ( y ) , j = 1 , 2 and ω ( α ) , P , D i , q i , i = 1 , 2 are the same as the drive system (50).
Take β 1 = 1.5 , β 2 = 1 , g 1 = g 2 = 2 , τ 1 = 4 , τ 2 = 1 , by calculation, we have i = 1 n j = 1 m k = 1 n [ 2 ( p i + g i )   2 d i j k 2 ξ j ξ i F i 2 1 ] = 0.0625 > 0 and the error bounded λ 2 λ 1 min 1 i n ξ i 2.83 . Moreover, one has
0 1 ω ( α ) s α d α + λ 1 = 4 s 2 3 + s 1 3 + 1 16 = 0 ,
therefore s = 1 512 , which are located in the open left-half complex plane. In addition,
L 1 1 0 1 ω ( α ) s α d α + λ 1 = L 1 1 ( 2 s 1 3 + 1 4 ) 2 = 1 4 L 1 1 ( s 1 3 + 1 8 ) 2 = 1 4 0 t η 2 3 E 1 3 , 1 3 1 8 η 1 3 ( t η ) 2 3 E 1 3 , 1 3 1 8 ( t η ) 1 3 d η 0 ,
which means that all conditions in Theorem 1 hold. Hence, it follows from Theorem 1 that systems (50) and (51) can achieve quasi-projectively synchronization. Figure 2 is shows the numerical simulation result.
Example 2.
Consider the following distributed-order system
D ω ( α ) x 1 ( t ) = p 1 x 1 ( t ) + j = 1 2 k = 1 2 d 1 j k f j ( x j ( t ) ) + q 1 , D ω ( α ) x 2 ( t ) = p 2 x 2 ( t ) + j = 1 2 k = 1 2 d 2 j k f j ( x j ( t ) ) + q 2 ,
where ω ( α ) = τ 1 δ ( α α 1 ) + τ 2 δ ( α α 2 ) , α 1 = 2 3 , α 2 = 1 3 , δ ( · ) denotes Dirac function; f j ( x j ( x ) ) = tanh ( x ) , j = 1 , 2 ; q i = 1 , i = 1 , 2 .
P = d i a g ( p 1 , p 2 ) = 1.5 0 0 1 ,
D 1 = ( d i j 1 ) 2 × 2 = 1 2 2 1 ,
D 2 = ( d i j 2 ) 2 × 2 = 2 1 1 2 ,
The response system is depicted as
D ω ( α ) y 1 ( t ) = p 1 y 1 ( t ) + j = 1 2 k = 1 2 d 1 j k f j ( y j ( t ) ) + q 1 + u 1 ( t ) , D ω ( α ) y 2 ( t ) = p 2 y 2 ( t ) + j = 1 2 k = 1 2 d 2 j k f j ( y j ( t ) ) + q 2 + u 2 ( t ) ,
where ω ( α ) , P , D i , q i , i = 1 , 2 are the same as the drive system (54).
Take β 1 = 1.5 , β 2 = 1 , g 1 = 2 , g 2 = 1.5 , τ 1 = 1 , τ 2 = 2 , by calculation, we have i = 1 n j = 1 m k = 1 n 2 ( p i + g i ) μ d i j k F j 1 μ d j i k F i = 1 > 0 and the error bounded 1 λ 5 min 1 i n ξ i = 1 , by similar with the processes in Example 1, we can obtain that all conditions in Theorem 3 hold. Hence, it follows from Theorem 3 that systems (54) and (55) can achieve quasi-projectively synchronized. Figure 3 is figure of numerical simulation result.

5. Conclusions

In this paper, the problems of quasi-projective synchronization of distributed-order recurrent neural networks have been investigated. Based on the definition of the distributive-order derivative and the metric space theory, some lemmas that are widely used in fractional order systems have been generalized to distributed-order systems. Afterwards, according to the Lyapunov method, Laplace transform, Laplace final value theorem, and some inequality techniques, the quasi-projective synchronization of the aforementioned neural networks have been investigated. Finally, two numerical examples have been given to manifest the validity of the theoretical results.
We would like to point out that it is possible to use our method to discuss some dynamic behavior, such as synchronization, passivity and state estimation of distributed-order complex-valued neural networks and quaternion-valued neural networks. The corresponding results will be carried out in the near future.

Author Contributions

Conceptualization, Writing—original draft, X.L.; Project administration, Writing—review & editing, K.L.; Supervision, Writing—review & editing, Q.S.; Software, Revised manuscript, X.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant 61573010 and 61906023, the Opening Project of Sichuan Province University Key Laboratory of Bridge Non-Destruction Detecting and Engineering Computing under Grant 2021QYJ06, and in part by the Chongqing Research Program of Basic Research and Frontier Technology under Grant cstc2019jcyj-msxmX0710.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Machado, J.T.; Kiryakova, V.; Mainardi, F. Recent history of fractional calculus. Commun. Nonlinear Sci. Numer. Simul. 2011, 16, 1140–1153. [Google Scholar] [CrossRef] [Green Version]
  2. Uchaikin, V.V. Fractional Derivatives for Physicists and Engineers; Springer: Berlin/Heidelberg, Germany, 2013; Volume 2. [Google Scholar]
  3. Baleanu, D.; Güvenç, Z.B.; Machado, J.T. New Trends in Nanotechnology and Fractional Calculus Applications; Springer: Berlin/Heidelberg, Germany, 2010. [Google Scholar]
  4. Engheia, N. On the role of fractional calculus in electromagnetic theory. IEEE Antennas Propag. Mag. 1997, 39, 35–46. [Google Scholar] [CrossRef]
  5. Heymans, N.; Bauwens, J.-C. Fractal rheological models and fractional differential equations for viscoelastic behavior. Rheol. Acta 1994, 33, 210–219. [Google Scholar] [CrossRef]
  6. Kempfle, S.; Schäfer, I.; Beyer, H. Fractional calculus via functional calculus: Theory and applications. Nonlinear Dyn. 2002, 29, 99–127. [Google Scholar] [CrossRef]
  7. Machado, J.T.; Jesus, I.S.; Galhano, A.; Cunha, J.B. Fractional order electromagnetics. Signal Process. 2006, 86, 2637–2644. [Google Scholar] [CrossRef] [Green Version]
  8. Mainardi, F. Fractional relaxation-oscillation and fractional diffusion-wave phenomena. Chaos Solitons Fractals 1996, 7, 1461–1477. [Google Scholar] [CrossRef]
  9. Caputo, M. Mean fractional-order-derivatives differential equations and filters. Ann. Dellniversita Ferrara 1995, 41, 73–84. [Google Scholar]
  10. Atanacković, T.M.; Oparnica, L.; Pilipović, S. On a nonlinear distributed order fractional differential equation. J. Math. Anal. Appl. 2007, 328, 590–608. [Google Scholar] [CrossRef]
  11. Chen, W.; Sun, H.; Zhang, X.; Korošak, D. Anomalous diffusion modeling by fractal and fractional derivatives. Comput. Math. Appl. 2010, 59, 1754–1758. [Google Scholar] [CrossRef] [Green Version]
  12. Sun, H.; Chen, W.; Sheng, H.; Chen, Y. On mean square displacement behaviors of anomalous diffusions with variable and random orders. Phys. Lett. A 2010, 374, 906–910. [Google Scholar] [CrossRef]
  13. Xu, M.; Tan, W. Intermediate processes and critical phenomena: Theory, method and progress of fractional operators and their applications to modern mechanics. Sci. China Ser. G 2006, 49, 257–272. [Google Scholar] [CrossRef]
  14. Atanackovic, T.; Budincevic, M.; Pilipovic, S. On a fractional distributed-order oscillator. J. Phys. A Math. Gen. 2005, 38, 6703. [Google Scholar] [CrossRef]
  15. Diethelm, K.; Ford, N.J. Numerical solution methods for distributed order differential equations. Fract. Calc. Appl. Anal. 2001, 4, 531–542. [Google Scholar]
  16. Diethelm, K.; Ford, N.J. Numerical analysis for distributed-order differential equations. J. Comput. Appl. Math. 2009, 225, 96–104. [Google Scholar] [CrossRef] [Green Version]
  17. Lu, J.; Ho, D.W. Stabilization of complex dynamical networks with noise disturbance under performance constraint. Nonlinear Anal. Real World Appl. 2011, 12, 1974–1984. [Google Scholar] [CrossRef]
  18. Song, Q.; Long, L.; Zhao, Z.; Liu, Y.; Alsaadi, F.E. Stability criteria of quaternion-valued neutral-type delayed neural networks. Neurocomputing 2020, 412, 287–294. [Google Scholar] [CrossRef]
  19. Sun, C.; He, W.; Ge, W.; Chang, C. Adaptive neural network control of biped robots. IEEE Trans. Syst. Man Cybern. Syst. 2016, 47, 315–326. [Google Scholar] [CrossRef]
  20. Yang, R.; Wu, B.; Liu, Y. A halanay-type inequality approach to the stability analysis of discrete-time neural networks with delays. Appl. Math. Comput. 2015, 265, 696–707. [Google Scholar] [CrossRef]
  21. Zeng, Z.; Wang, J. Design and analysis of high-capacity associative memories based on a class of discrete-time recurrent neural networks. IEEE Trans. Syst. Man Cybern. Part B 2008, 38, 1525–1536. [Google Scholar] [CrossRef]
  22. Zhang, W.; Tang, Y.; Miao, Q.; Du, W. Exponential synchronization of coupled switched neural networks with mode-dependent impulsive effects. IEEE Trans. Neural Netw. Learn. Syst. 2013, 24, 1316–1326. [Google Scholar] [CrossRef]
  23. Lundstrom, B.N.; Higgs, M.H.; Spain, W.J.; Fairhall, A.L. Fractional differentiation by neocortical pyramidal neurons. Nat. Neurosci. 2008, 11, 1335. [Google Scholar] [CrossRef]
  24. Liu, P.; Zeng, Z.; Wang, J. Multiple mittag–leffler stability of fractional-order recurrent neural networks. IEEE Trans. Syst. Man Cybern. Syst. 2017, 47, 2279–2288. [Google Scholar] [CrossRef]
  25. Chen, J.J.; Zeng, Z.G.; Jiang, P. Global Mittag-Leffler stability and synchronization of memristor-based fractional-order neural networks. Neural Netw. 2014, 51, 1–8. [Google Scholar] [CrossRef]
  26. Wang, W.; Qiao, Y.; Miao, J.; Duan, L. Dynamic analysis of fractional-order recurrent neural network with caputo derivative. Int. J. Bifurc. Chaos 2017, 27, 1750181. [Google Scholar] [CrossRef]
  27. Fei, J.; Wang, H. Recurrent neural network fractional-order sliding mode control of dynamic systems. J. Frankl. Inst. 2020, 357, 4574–4591. [Google Scholar] [CrossRef]
  28. Boccaletti, S.; Kurths, J.; Osipov, G.; Valladares, D.; Zhou, C. The synchronization of chaotic systems. Phys. Rep. 2002, 366, 1–101. [Google Scholar] [CrossRef]
  29. Chen, G.; Dong, X. From Chaos to Order: Methodologies, Perspectives and Applications; World Scientific: Singapore, 1998; Volume 24. [Google Scholar]
  30. Sprott, J.; Jeffrey, D. Chaos and Time-Series Analysis; Oxford University Press: Oxford, UK, 2003; Volume 47, p. 373. [Google Scholar]
  31. Yang, T.; Chua, L.O. Impulsive stabilization for control and synchronization of chaotic systems: Theory and application to secure communication. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 1997, 44, 976–988. [Google Scholar] [CrossRef] [Green Version]
  32. Yang, X.; Li, C.; Huang, T.; Song, Q.; Chen, X. Quasi-uniform synchronization of fractional-order memristor-based neural networks with delay. Neurocomputing 2017, 234, 205–215. [Google Scholar] [CrossRef]
  33. Li, H.; Cao, J.; Hu, C.; Jiang, H. Quasi-projective and complete synchronization of fractional-order complex-valued neural networks with time delays. Neural Netw. 2019, 118, 102–109. [Google Scholar] [CrossRef]
  34. Guo, R.; Lv, W.; Zhang, Z. Quasi-projective synchronization of stochastic complex-valued neural networks with time-varying delay and mismatched parameters. Neurocomputing 2020, 415, 184–192. [Google Scholar] [CrossRef]
  35. Anbuvithya, R.; Sri, S.; Vadivel, R.; Gunasekaran, N.; Hammachukiattikul, P. Extended dissipativity and non-fragile synchronization for recurrent neural networks with multiple time-varying delays via sampled-data control. IEEE Access 2021, 9, 31454–31466. [Google Scholar] [CrossRef]
  36. Guo, R. Projective synchronization of a class of chaotic systems by dynamic feedback control method. Nonlinear Dyn. 2017, 90, 53–64. [Google Scholar] [CrossRef]
  37. Ding, Z.; Shen, Y. Projective synchronization of nonidentical fractional-order neural networks based on sliding mode controller. Neural Netw. 2016, 76, 97–105. [Google Scholar] [CrossRef] [Green Version]
  38. Zhang, W.; Cao, J.; Wu, R.; Alsaedi, A.; Alsaadi, F.E. Projective synchronization of fractional-order delayed neural networks based on the comparison principle. Adv. Differ. Equ. 2018, 2018, 73. [Google Scholar] [CrossRef] [Green Version]
  39. Yang, S.; Yu, J.; Hu, C.; Jiang, H. Quasi-projective synchronization of fractional-order complex-valued recurrent neural networks. Neural Netw. 2018, 104, 104–113. [Google Scholar] [CrossRef]
  40. Gorenflo, R.; Mainardi, F.; Podlubny, I. Fractional Differential Equations; Academic Press: Cambridge, MA, USA, 1999; Volume 8, pp. 683–699. [Google Scholar]
  41. Caputo, M. Rigorous time domain responses of polarizable media. Ann. Geophys. Ann. Geofis. 1997, 40, 97–106. [Google Scholar] [CrossRef]
  42. Jiao, Z.; Chen, Y.-Q.; Podlubny, I. Distributed-Order Dynamic Systems: Stability, Simulation, Applications and Perspectives; Springer: London, UK, 2012. [Google Scholar]
  43. Aguila-Camacho, N.; Duarte-Mermoud, M.A.; Gallegos, J.A. Lyapunov functions for fractional order systems. Commun. Nonlinear Sci. Numer. Simul. 2014, 19, 2951–2957. [Google Scholar] [CrossRef]
  44. Zhang, S.; Yu, Y.; Wang, H. Mittag-leffler stability of fractional-order hopfield neural networks. Nonlinear Anal. Hybrid Syst. 2015, 16, 104–121. [Google Scholar] [CrossRef]
  45. Cao, J. New results concerning exponential stability and periodic solutions of delayed cellular neural networks. Phys. Lett. A 2003, 307, 136–147. [Google Scholar] [CrossRef]
  46. Diethelm, K.; Ford, N.J.; Freed, A.D. A predictor-corrector approach for the numerical solution of fractional differential equations. Nonlinear Dyn. 2002, 29, 3–22. [Google Scholar] [CrossRef]
Figure 1. The | x ( t ) | ’s trajectory.
Figure 1. The | x ( t ) | ’s trajectory.
Fractalfract 05 00260 g001
Figure 2. The state of error system when g i = 2 , β 1 = 1.5 , β 2 = 1 .
Figure 2. The state of error system when g i = 2 , β 1 = 1.5 , β 2 = 1 .
Fractalfract 05 00260 g002
Figure 3. The state of error system when β 1 = 1.5 , β 2 = 1 , g 1 = 2 , g 2 = 1.5 .
Figure 3. The state of error system when β 1 = 1.5 , β 2 = 1 , g 1 = 2 , g 2 = 1.5 .
Fractalfract 05 00260 g003
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, X.; Li, K.; Song, Q.; Yang, X. Quasi-Projective Synchronization of Distributed-Order Recurrent Neural Networks. Fractal Fract. 2021, 5, 260. https://doi.org/10.3390/fractalfract5040260

AMA Style

Liu X, Li K, Song Q, Yang X. Quasi-Projective Synchronization of Distributed-Order Recurrent Neural Networks. Fractal and Fractional. 2021; 5(4):260. https://doi.org/10.3390/fractalfract5040260

Chicago/Turabian Style

Liu, Xiao, Kelin Li, Qiankun Song, and Xujun Yang. 2021. "Quasi-Projective Synchronization of Distributed-Order Recurrent Neural Networks" Fractal and Fractional 5, no. 4: 260. https://doi.org/10.3390/fractalfract5040260

Article Metrics

Back to TopTop