Adaptive Synchronization of Fractional Neural Networks with Unknown Parameters and Time Delays

In this paper, the parameters identification and synchronization problem of fractional-order neural networks with time delays are investigated. Based on some analytical techniques and an adaptive control method, a simple adaptive synchronization controller and parameter update laws are designed to synchronize two uncertain complex networks with time delays. Besides, the system parameters in the uncertain network can be identified in the process of synchronization. To demonstrate the validity of the proposed method, several illustrative examples are presented.


Introduction
Since the pioneering work on Hopfield neural networks was reported in [1], the investigation of the dynamics of neurons has been receiving a lot of attention.In cellular neural networks [2], Petráš pointed out that fractional derivatives instead of the integer order one were a natural choice.Recently, the utilities of fractional-order neural networks have been extensively studied, since the networks provide neurons with a fundamental and general computation ability that can contribute to efficient information processing, stimulus anticipation and frequency-independent phase shifts of oscillatory neuronal firing [3].It is well known that the uncertainty and time delay are unavoidable in many practical situations.For example, due to the finite switching speed of amplifier circuits in neural networks or dealing with motion-related problems, time delays exist in the information processing of neurons [4].On the other hand, most studies have been available under the assumption that the system parameters are assumed to be known in advance.However, under some circumstances, it is difficult to determine the values of parameters.Therefore, the fractional neural networks with unknown parameters and time delay are more general and reasonable in the real world.
If the parameters and time delays are appropriately chosen, the neural networks can exhibit complicated behaviors even with strange chaotic attractors.Meanwhile, synchronization of coupled neural networks has been investigated due to its potential applications in various engineering, including chaos generators design, secure communications, chemical and biological systems, information processing, distributed computation, optics, social science, harmonic oscillation generation, human heartbeat regulation and power system protection (see, e.g., [4][5][6][7][8][9][10][11] and the references therein).However, there are very limited results on the synchronization of fractional-order neural networks.
In this paper, an identification method based on fractional adaptive synchronization is applied to parameter identification of fractional-order neural networks with time delays.Fractional adaptive synchronization was a generalization of the integer case [12,13].The main contributions of this paper mainly include three aspects: (i) An adaptive controller is first proposed, which is more general than the nonlinear controller [14][15][16].Furthermore, the adaptive controller can be used to identify the unknown parameters of nonlinear part, but the nonlinear one may not.(ii) Our model of fractional neural networks with time delays and unknown parameters is more general.(iii) Based on a novel Lyapunov-like function and the Gronwall-Bellman integral inequality, we derive synchronization criteria analytically.
As mentioned above, fractional-order neural networks are very effective at applications due to their infinite memory.Besides, the fractional-order parameter and time delays enrich the system performance by increasing freedom.Synchronization of fractional neural networks with time delays may be more useful in many applications, such as information, pattern recognition and image processing.Therefore, it is necessary and interesting to study time-delayed fractional neural networks both in theory and in applications.The outline of the paper is organized as follows: some preliminaries and fractional-order neural networks are introduced in Section 2. The adaptive controller is proposed for two coupling networks, such that they can be synchronized in the following section.Numerical experiments are presented to support the theoretical analysis in Section 4. The conclusions are given in the last section.

Preliminaries and Model Description
In the following, we introduce some basic definitions and the corresponding results, which will be used later on.Definition 1 ( [17]).The fractional integral of order α for function f is defined as: where t ≥ t 0 , α > 0 and Γ(•) is the Gamma function.

Definition 2 ([17]
).The α-th-order Caputo fractional derivative of the given function f (t) is defined as: In most situations, the initial time t 0 is often set to zero.Throughout the paper, t 0 = 0 and D −α 0,t is simply denoted by I α and C D α 0,t by D α for brevity. (2)

Lemma 4 ([21]
).For the given vectors x, y and a positive definite matrix Q > 0 with compatible dimensions, the following inequality holds, Lemma 5 (Gronwall-Bellman integral inequality [22]).If z(t) satisfies z(t) ≤ t 0 a(τ )z(τ )dτ + b(t) with a(t) and b(t) being known real functions, then We study the following drive and response fractional neural networks with time delays: Here, denotes the state variable of the i-th neuron at time t; a ij and b ij denote the connection strengths and the time delay connection strengths, respectively; âij and bij are the estimations for the unknown connection strengths a ij and b ij ; f j (x j (t)), g j (x j (t)) denote the activation functions of neurons; τ is the time delay; I i is the input; u i (t) is a controller.Hereafter, suppose that the activation functions f i (u) and g i (u) satisfy the Lipschitz conditions; that is, there exist constants for u, v ∈ R and i = 1, 2, • • • , m.

Adaptive Controller for Uncertain Fractional-Order Neural Networks
In this section, we study the adaptive synchronization of two coupled fractional neural networks with unknown parameters.By the adaptive control theory, a simple controller for synchronization is designed and parameters identification is realized. Let Our goal is to design controller u, such that the trajectory of the response system (6) with initial condition y 0 can asymptotically approach that of the drive system (5) with initial condition x 0 and, finally, implement synchronization, in the sense that: where • is the Euclidean norm.
Theorem 1.The drive and response complex networks ( 5) and ( 6) can achieve synchronization, if the controller and the adaptive laws of parameters are taken as: where q ij , r ij , λ i are arbitrary positive constants and the feedback strength k i (t) is adapted according to the following update law: Proof.From networks ( 5) and ( 6), one can get the following error system: Now, we introduce the following Lyapunov-like function for system (11): where ρ i > 0, i = 1, 2, • • • , m and P is a semi-positive definite matrix under determination. Define: Applying Equation (3) to (13) yields: By Lemma 2, we have that w(t) is monotonously non-decreasing, i.e., w(t) ≥ w(t − τ ).Therefore, V (t) ≥ 0.
From Lemma 3, Equations ( 9)-( 11), the fractional derivatives of V (t) along the solution can be derived as: It immediately follows from ( 14) that: Here, ) n×n are the connection matrices, and: From Lemma 4 and assumption (7), we can get the following two inequalities: and: where It follows from Equations ( 16) and ( 17) that: Let: Then, one has: After fractional integration on both sides of the inequality (18), we have: Using Equation ( 4) leads to: Additionally, e T (t)e(t) ≤ V (t) gives: By Lemma 5, one has: ).
Remark 1.It should be noted that Theorem 1 only derives the local stability of the fractional error system (11).In order to successfully identify the unknown parameters, other conditions must be satisfied.When achieving the synchronization, i.e., y i (t) = x i (t), as t → ∞, error system ( 11) can be simplified as follows: According to the linear independence [23], the correct identification of the unknown parameters âij , bij is equivalent to the fact that the function elements {f j (x j (t)), g j (x j (t−τ )), j = 1, 2, • • • , m} are linearly independent.
Remark 3. Assume b ij = bij = 0.The complete synchronization between system (5) and system ( 6) can be realized via the following control strategy: where q ij , λ i are positive.

Synchronization and Parameter Identification
In this section, numerical experiments are displayed to illustrate the effectiveness of the proposed method.
A group of fractional-order neural networks with time delay is considered, whose integer-order case was reported in [10], where: The initial conditions for fractional neural networks (19) are given as follows: When we choose: and A in the following three forms: fractional system (19) is chaotic (corresponding to A 1 , see Figure 1), has asymptotically stable equilibrium (corresponding to A 2 , see Figure 2), and has stable periodic solution (corresponding to A 3 , see Figure 3), respectively.In the numerical simulations, the initial conditions and parameter values are given in the following: Now, we choose A = A 1 , q ij = 5, r ij = 5 and λ 1 = λ 2 = 5 for the synchronization test.
In the following, the adaptive control strategy ( 9) and ( 10) is used to identify the uncertain system parameters.From Figures 4 and 5, it can be clearly seen that all the unknown system parameters âij and bij are successfully identified, respectively.Figure 6 shows that the synchronization error converges to zero asymptotically.From Figure 7, we can see that the adaptive control gains k i (t), i = 1, 2 tend to some positive constants when system (5) and system (6) are synchronized.

The Impact of Fractional Order on the Identification Process
The fractional order α i has a direct effect on the chaotic behavior of the nonlinear dynamical systems.As a result, it also affects the synchronization behavior of fractional system.Bhalekar et al. observed that the synchronization error decreases as the order α increases [12,24].However, the opposite phenomenon is also observed in [25].In this section, a more visible method is used to examine its impact on the fractional order neural networks with unknown parameters and time delays.
In order to numerically examine and avoid the linear dependence of the related functions [12,26], we let α 1 = 0.6, α 2 = 0.8, α 3 = 0.99.All of the other settings remain unchanged as stated in Section 4.1.From Figures 8-10, we can obtain that the small value of the fractional order α i would be harmful not only for synchronization state, but also for identification of unknown parameters for fractional neural networks.

Conclusions
In this paper, the identification of parameters and synchronization of fractional-order neural networks with time delays were studied.Especially, our designed adaptive controllers for network synchronization are rather simple in form.Moreover, the method discussed in this work can be well applied to other fractional-order complex networks with time delays.

Figure 8 .
Figure 8.The system errors of different fractional.

Figure 9 .
Figure 9.The error norms A − Â of different fractional.

Figure 10 .
Figure 10.The error norms B − B of different fractional.