Next Article in Journal
Entropiesand Degree-Based Topological Indices of Generalized Sierpiński Graphs
Previous Article in Journal
Fractional Calculus of Variations for Composed Functionals with Generalized Derivatives
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigation of Delay-Induced Hopf Bifurcation in a Fractional Neutral-Type Neural Network

School of Mathematics and Statistic, Xinyang Normal University, Xinyang 464000, China
*
Author to whom correspondence should be addressed.
Fractal Fract. 2025, 9(3), 189; https://doi.org/10.3390/fractalfract9030189
Submission received: 12 February 2025 / Revised: 9 March 2025 / Accepted: 14 March 2025 / Published: 19 March 2025

Abstract

This paper investigates stability switches induced by Hopf bifurcation in a fractional three-neuron network that incorporates both neutral time delay and communication delay, as well as a general structure. Initially, we simplified the characteristic equation by eliminating trigonometric terms associated with purely imaginary roots, enabling us to derive the Hopf bifurcation conditions for communication delay while treating the neutral time delay as a constant. The results reveal that communication delay can drive a stable equilibrium into instability once it exceeds the Hopf bifurcation threshold. Furthermore, we performed a sensitivity analysis to identify the fractional order and neutral delay as the two most sensitive parameters influencing the bifurcation value for the illustrative example. Notably, in contrast to neural networks with only retarded delays, our numerical observations show that the Hopf bifurcation curve is non-monotonic, highlighting that the neural network with a fixed communication delay can exhibit stability switches and eventually stabilize as the neutral delay increases.

1. Introduction

Neural networks, as energetic frontal interdisciplinary studies, have garnered considerable scientific interest due to their applications as diverse as pattern recognition and deep learning in recent decades [1,2]. These applications are closely contingent on the related dynamical mechanism of the designed neural networks. Therefore, we need to detail the dynamics of neural networks [3]. In scenarios where neural networks are designed to address practical issues, communication delays cannot be avoided due to the influence of the reaction to the speed of electronic devices or the non-instantaneous propagation of signals of biological neurons [4,5]. Moreover, the incorporation of communication delays in neural networks is essential and can be better used to describe some circuits [6]. However, communication delays usually have adverse effects on the stability performance of neural networks, which may give rise to stability switches due to Hopf bifurcation. This transition of stability could be pertinent to some cognitive diseases [7]. The study of Hopf bifurcation in neural networks still constitutes a important topic that deserves further study [8,9].
On the other hand, when large-scale integrated circuits constitute a neural network, the appearance of various categories of time delays is undeniable [10,11,12]. For example, the rate of change of the state variables pertaining to some neural networks hinges on the current and past states, as well as the change in past rates [13,14,15]. That is, time delays appear not only in the current states themselves but also in the time derivative of past states of the neurons. This kind of neural networks is called a neutral-type neural network [16,17]. The dynamics of a neutral-type neural network without external input can be characterized by the following system, as introduced in [18]:
d x i ( t ) d t = k i x i ( t ) + j = 1 n α i j f j ( x j ( t ) ) + j = 1 n β i j f j ( x j ( t τ x ) ) + j = 1 n d i j x j ( t τ y ) , i = 1 , 2 , , n .
In system (1), x i ( t ) relates to the state variable of the i-th neuron at time t; k i > 0 represents the internal decay rate; f ( · ) stands for the neuron activation function; α i j , β i j , and d i j refer to the connection weight, the delayed connection weight and the neutral delayed connection, respectively, of the three neurons; τ x and τ y measure the constant communication delay and the constant neutral time delay, respectively. They presented the equilibrium global stability criteria. Since neutral-type neural networks can precisely characterize the complicated properties of neural cells, including neuron reactions [19,20], they have attracted many investigations in recent years [21,22].
Recently, fractional differential equations have gained increasing recognition for their effectiveness in modeling the temporal evolution of neural networks, thanks to the unique strengths of fractional calculus [23,24,25]. These advantages include its ability to capture memory effects, provide better parameter fitting, and describe the behavior of the inverse power law [26,27]. As a result, fractional differential equations have garnered significant attention in the study of neural networks, with numerous works exploring their applications in this context [28,29]. For instance, research has demonstrated that the drift effects observed in fingerprints related to Fracmemristors can only be accurately described using fractional-order systems [30]. Additionally, it has been revealed that neuronal responses inherently follow the principles of fractional derivatives [28], further underscoring the relevance of fractional calculus in neural network modeling. Consequently, fractional neural networks have emerged as a promising advancement in the field [31,32]. There are now numerous definitions of fractional derivatives, each suited to different application scenarios [33]. Among the classical definitions are the Caputo, Grünwald–Letnikov, and Riemann–Liouville derivatives. Compared to the other two classical fractional derivatives, the Caputo derivative of a constant function and its initial conditions are the same as those of the integer-order derivative. In addition, the Caputo derivative is a special case of the unified fractional derivative defined in [34]. Therefore, many researchers utilize the Caputo derivative to describe the memory properties of neurons, benefiting from its intuitive physical interpretation and wide applicability across diverse fields [35]. For instance, the authors in [36,37] incorporate the Caputo derivative into neutral-type neural networks, examining their robust stability and asymptotic stability, respectively.
Most previous studies have primarily focused on stability analysis, with relatively little attention given to Hopf bifurcation induced by two delays in neutral-type neural networks. While recent research has increasingly explored Hopf bifurcation in fractional neural networks with retarded delays [24,25], investigations into more complex scenarios—such as fractional neural networks that incorporate both neutral and retarded delays, as well as networks with more than two neurons—remain limited [38,39]. This gap underscores the need for further exploration in this direction. To address this limitation, our study systematically examined the impact of both neutral and retarded delays on the Hopf bifurcation dynamics of fractional neural networks. Specifically, we incorporated the Caputo derivative into system (1) following the approach in [36] and considered the case where n = 3 . As a result, the dynamics of our fractional neutral-type neural network can be described by the following system:
D ϑ x 1 ( t ) = k 1 x 1 ( t ) + α 11 f ( x 1 ( t ) ) + α 12 f ( x 2 ( t ) ) + α 13 f ( x 3 ( t ) ) + β 11 f ( x 1 ( t τ x ) ) + β 12 f ( x 2 ( t τ x ) ) + β 13 f ( x 3 ( t τ x ) ) + d 11 D ϑ x 1 ( t τ y ) + d 12 D ϑ x 2 ( t τ y ) + d 13 D ϑ x 3 ( t τ y ) , D ϑ x 2 ( t ) = k 2 x 2 ( t ) + α 21 f ( x 1 ( t ) ) + α 22 f ( x 2 ( t ) ) + α 23 f ( x 3 ( t ) ) + β 21 f ( x 1 ( t τ x ) ) + β 22 f ( x 2 ( t τ x ) ) + β 23 f ( x 3 ( t τ x ) ) + d 21 D ϑ x 1 ( t τ y ) + d 22 D ϑ x 2 ( t τ y ) + d 23 D ϑ x 3 ( t τ y ) , D ϑ x 3 ( t ) = k 3 x 2 ( t ) + α 31 f ( x 1 ( t ) ) + α 32 f ( x 2 ( t ) ) + α 33 f ( x 3 ( t ) ) + β 31 f ( x 1 ( t τ x ) ) + β 32 f ( x 2 ( t τ x ) ) + β 33 f ( x 3 ( t τ x ) ) + d 31 D ϑ x 1 ( t τ y ) + d 32 D ϑ x 2 ( t τ y ) + d 33 D ϑ x 3 ( t τ y ) .
In system (2), the symbol D ϑ g ( t ) ( ϑ ( 0 , 1 ] ) refers to the Caputo fractional derivative of fractional order ϑ for a function g ( t ) , t [ 0 , + ) ; the initial conditions are
x i ( t ) = Ψ i ( t ) , t [ max { τ x , τ y } , 0 ] , i = 1 , 2 , 3 ,
where Ψ i ( t ) C ( [ max { τ x , τ y } , 0 ] , R ) . We usually assume that Hypothesis 1 f ( · ) C 1 ( R , R ) , f ( 0 ) = 0 and f ( 0 ) 0 . Obviously, Hypothesis 1 implies the origin is the equilibrium of system (2). We intend to, as best as we are able, procure the conditions for the Hopf bifurcation induced by delays for system (2).
Building on the previous discussions, we analyze the instability behaviors due to Hopf bifurcation of system (2). The main contributions and novelties of this paper are as follows:
  • System (2) extends the works of Gupta [9] and Li et al. [40] by incorporating neutral terms, while also generalizing the systems studied by Huang et al. [41] and Kumar et al. [39] by considering a network with more than two neurons and a more generalized structure.
  • We establish the conditions under which system (2) can undergo bifurcation without imposing additional parameter constraints. Notably, our analysis does not require assumptions such as identical neurons [9] or the equality of communication delay and neutral time delay [42].
  • Our numerical findings indicate that neutral delay and fractional order are the two most sensitive parameters affecting the bifurcation value. Notably, neutral delay can trigger multiple stability switches.
In summary, our results could provide a new avenue to understand the dynamics of neural networks. The rest of this paper is structured as follows. In Section 2, by eliminating all trigonometric functions of the characteristic equation with purely imaginary roots, we establish criteria to detect the Hopf bifurcation point of communication delay. It is shown that the system can not preserve its stability when the communication delay increases through the Hopf bifurcation point. In Section 3, we provide a numerical example to verify the validation of the technique used. We finalize our paper with some conclusions in Section 4.

2. Main Results

In this section, we present the main results of this paper. The proof of our results is structured as follows. First, we derive the associated characteristic Equation (4) using the Laplace transform. Next, we establish the conditions for the local stability of the trivial equilibrium of system (2) in the absence of delays. We then determine the neutral delay range within which the system (2) remains stable. Finally, we provide the conditions for the occurrence of Hopf bifurcation induced by communication delay, considering the neutral time delay within its stability interval.
We linearize system (2) at origin yielding
D ϑ x 1 ( t ) = k 1 x 1 ( t ) + a 11 x 1 ( t ) + a 12 x 2 ( t ) + a 13 x 3 ( t ) + b 11 x 1 ( t τ x ) + b 12 x 2 ( t τ x ) + b 13 x 3 ( t τ x ) + d 11 D ϑ x 1 ( t τ y ) + d 12 D ϑ x 2 ( t τ y ) + d 13 D ϑ x 3 ( t τ y ) , D ϑ x 2 ( t ) = k 2 x 2 ( t ) + a 21 x 1 ( t ) + a 22 x 2 ( t ) + a 23 x 3 ( t ) + b 21 x 1 ( t τ x ) + b 22 x 2 ( t τ x ) + b 23 x 3 ( t τ x ) + d 21 D ϑ x 1 ( t τ y ) + d 22 D ϑ x 2 ( t τ y ) + d 23 D ϑ x 3 ( t τ y ) , D ϑ x 3 ( t ) = k 3 x 2 ( t ) + a 31 x 1 ( t ) + a 32 x 2 ( t ) + a 33 x 3 ( t ) + b 31 x 1 ( t τ x ) + b 32 x 2 ( t τ x ) + b 33 x 3 ( t τ x ) + d 31 D ϑ x 1 ( t τ y ) + d 32 D ϑ x 2 ( t τ y ) + d 33 D ϑ x 3 ( t τ y ) ,
where a i j = α i j f ( 0 ) and b i j = β i j f ( 0 ) .
Inspired by the ideas in [43,44], we can procure the following characteristic determinant for system (3) by performing Laplace transform on both sides of (3):
s ϑ + k 1 a 11 b 11 e s τ x d 11 s ϑ e s τ y a 12 b 12 e s τ x d 12 s ϑ e s τ y a 21 b 21 e s τ x d 21 s ϑ e s τ y s ϑ + k 2 a 22 b 22 e s τ x d 22 s ϑ e s τ y a 31 b 31 e s τ x d 31 s ϑ e s τ y a 32 b 32 e s τ x d 32 s ϑ e s τ y a 13 b 13 e s τ x d 13 s ϑ e s τ y a 23 b 23 e s τ x d 23 s ϑ e s τ y s ϑ + k 3 a 33 b 33 e s τ x d 33 s ϑ e s τ y = 0 .
That is,
ϕ 3 ( s ) e 3 s τ x + ( ϕ 2 ( s ) ψ 2 ( s ) e s τ y ) e 2 s τ x + ϕ 0 ( s ) + ψ 01 ( s ) e s τ y + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y e s τ x + ψ 02 ( s ) e 2 s τ y ψ 03 ( s ) e 3 s τ y = 0 ,
where
ϕ 3 ( s ) = c 30 , ϕ 2 ( s ) = c 21 s ϑ + c 20 , ψ 2 ( s ) = l 21 s ϑ , ϕ 1 ( s ) = c 12 s 2 ϑ + c 11 s ϑ + c 10 , ψ 11 ( s ) = l 12 s 2 ϑ + l 11 s ϑ , ψ 12 ( s ) = l 13 s 2 ϑ , ϕ 0 ( s ) = c 03 s 3 ϑ + c 02 s 2 ϑ + c 01 s ϑ + c 00 , ψ 01 ( s ) = q 13 s 3 ϑ + q 12 s 2 ϑ + q 11 s ϑ , ψ 02 ( s ) = q 23 s 3 ϑ + q 22 s 2 ϑ , ψ 03 ( s ) = q 33 s 3 ϑ ,
and
c 30 = b 11 ( b 23 b 32 b 22 b 33 ) + b 12 b 21 b 33 b 12 b 23 b 31 b 13 b 21 b 32 + b 13 b 22 b 31 , c 21 = b 11 ( b 33 + b 22 ) + b 22 b 33 b 12 b 21 b 13 b 31 b 23 b 32 , c 20 = a 11 ( b 23 b 32 b 22 b 33 ) + a 22 ( b 13 b 31 b 11 b 33 ) + a 33 ( b 12 b 21 b 11 b 22 ) + b 11 ( a 23 b 32 + a 32 b 23 + b 22 k 3 + b 33 k 2 ) + b 22 ( a 13 b 31 + a 31 b 13 + b 33 k 1 ) a 23 b 12 b 31 a 31 b 12 b 23 a 32 b 13 b 21 b 12 b 21 k 3 b 13 b 31 k 2 a 12 b 23 b 31 + b 33 ( a 12 b 21 + a 21 b 12 ) a 13 b 21 b 32 a 21 b 13 b 32 b 23 b 32 k 1 , l 21 = b 11 ( b 22 d 33 + b 33 d 22 b 23 d 32 b 32 d 23 ) + b 22 ( b 33 d 11 b 13 d 31 b 31 d 13 ) b 33 ( b 12 d 21 + b 21 d 12 ) b 23 b 32 d 11 b 13 b 31 d 22 b 12 b 21 d 33 + b 21 b 32 d 13 + b 13 ( b 21 d 32 + b 32 d 21 ) + b 12 ( b 23 d 31 + b 31 d 23 ) + b 23 b 31 d 12 , c 12 = b 11 b 22 b 33 , c 11 = a 11 ( b 33 + b 22 ) + a 22 ( b 11 + b 33 ) + a 33 ( b 11 + b 22 ) b 11 ( k 3 + k 2 ) b 22 ( k 1 + k 3 ) b 33 ( k 1 + k 2 ) a 13 b 31 a 21 b 12 a 23 b 32 a 31 b 13 a 32 b 23 a 12 b 21 , c 10 = a 11 ( a 23 b 32 + a 32 b 23 + b 22 k 3 + b 33 k 2 a 22 b 33 a 33 b 22 ) k 2 ( a 13 b 31 + a 31 b 13 ) + a 22 ( a 13 b 31 + a 31 b 13 + b 11 k 3 + b 33 k 1 a 33 b 11 ) + a 33 ( a 12 b 21 + a 21 b 12 + b 11 k 2 + b 22 k 1 ) k 1 ( a 23 b 32 + a 32 b 23 ) + b 11 ( a 23 a 32 k 2 k 3 ) + b 22 ( a 13 a 31 k 1 k 3 ) + b 33 ( a 12 a 21 k 1 k 2 ) k 3 ( a 12 b 21 + a 21 b 12 ) a 12 ( a 23 b 31 + a 31 b 23 ) a 13 ( a 21 b 32 + a 32 b 21 ) a 21 a 32 b 13 a 23 a 31 b 12 , l 12 = b 11 ( d 22 + d 33 ) + b 22 ( d 11 + d 33 ) + b 33 ( d 11 + d 22 ) d 21 b 12 d 31 b 13 d 12 b 21 b 23 d 32 d 13 b 31 b 32 d 23 , l 11 = a 11 ( b 22 d 33 + b 33 d 22 b 23 d 32 b 32 d 23 ) a 22 ( b 11 d 33 + b 33 d 11 b 13 d 31 b 31 d 13 ) a 33 ( b 11 d 22 + b 22 d 11 b 12 d 21 b 21 d 12 ) + b 11 ( a 23 d 32 + a 32 d 23 + d 22 k 3 + d 33 k 2 ) + b 22 ( a 13 d 31 + a 31 d 13 + d 11 k 3 + d 33 k 1 ) + b 33 ( a 12 d 21 + a 21 d 12 + d 11 k 2 + d 22 k 1 ) + d 11 ( a 23 b 32 + a 32 b 23 ) + d 22 ( a 13 b 31 + a 31 b 13 ) + d 33 ( a 12 b 21 + a 21 b 12 ) k 1 ( b 23 d 32 + b 32 d 23 ) k 2 ( b 13 d 31 + b 31 d 13 ) k 3 ( b 12 d 21 + b 21 d 12 ) a 12 ( b 23 d 31 + b 31 d 23 ) a 13 ( b 21 d 32 + b 32 d 21 ) a 21 ( b 13 d 32 + b 32 d 13 ) a 23 ( b 12 d 31 + b 31 d 12 ) a 31 ( b 12 d 23 + b 23 d 12 ) a 32 ( b 13 d 21 + b 21 d 13 ) , l 13 = b 11 ( d 22 d 33 d 23 d 32 ) + b 22 ( d 11 d 33 d 13 d 31 ) + b 33 ( d 11 d 22 d 12 d 21 ) d 11 ( b 23 d 32 + b 32 d 23 ) d 22 ( b 13 d 31 + b 31 d 13 ) d 33 ( b 12 d 21 + b 21 d 12 ) + b 12 d 23 d 31 + b 13 d 21 d 32 + b 21 d 13 d 32 + b 23 d 12 d 31 + b 31 d 12 d 23 + b 32 d 13 d 21 , c 03 = 1 , c 02 = k 1 + k 2 + k 3 a 11 a 22 a 33 , c 01 = a 11 ( a 22 + a 33 k 2 k 3 ) + a 22 ( a 33 k 1 k 3 ) a 33 ( k 1 + k 2 ) + k 1 ( k 2 + k 3 ) a 13 a 31 a 12 a 21 a 23 a 32 + k 2 k 3 , c 00 = a 11 a 22 ( k 3 a 33 ) + a 23 a 32 + k 2 a 33 k 2 k 3 + a 22 ( a 13 a 31 + a 33 k 1 k 1 k 3 ) + a 33 ( a 12 a 21 k 1 k 2 ) + k 1 ( k 2 k 3 a 23 a 32 ) a 13 a 21 a 32 a 13 a 31 k 2 a 12 a 21 k 3 a 12 a 23 a 31 , q 13 = ( d 22 + d 11 + d 33 ) , q 12 = a 11 ( d 22 + d 33 ) + a 22 ( d 11 + d 33 ) + a 33 ( d 11 + d 22 ) d 11 ( k 3 + k 2 ) d 22 ( k 1 + k 3 ) d 33 ( k 1 + k 2 ) a 13 d 31 a 21 d 12 a 23 d 32 a 31 d 13 a 32 d 23 a 12 d 21 , q 11 = ( a 11 ( a 22 d 33 + a 33 d 22 a 23 d 32 a 32 d 23 d 22 k 3 d 33 k 2 ) + a 21 a 32 d 13 + a 12 ( a 23 d 31 + a 31 d 23 ) + a 22 ( a 33 d 11 a 13 d 31 a 31 d 13 d 11 k 3 d 33 k 1 ) a 33 ( a 12 d 21 + a 21 d 12 + d 11 k 2 + d 22 k 1 ) + d 11 ( k 2 k 3 a 23 a 32 ) + d 22 ( k 1 k 3 a 13 a 31 ) + d 33 ( k 1 k 2 a 12 a 21 ) + k 1 ( a 23 d 32 + a 32 d 23 ) + k 2 ( a 13 d 31 + a 31 d 13 ) + k 3 ( a 12 d 21 + a 21 d 12 ) + a 13 ( a 21 d 32 + a 32 d 21 ) + a 23 a 31 d 12 ) , q 23 = d 11 ( d 22 + d 33 ) + d 22 d 33 d 12 d 21 d 13 d 31 d 23 d 32 , q 22 = a 11 ( d 23 d 32 d 22 d 33 ) + a 22 ( d 13 d 31 d 11 d 33 ) + a 33 ( d 12 d 21 d 11 d 22 ) + d 33 ( a 12 d 21 + a 21 d 12 ) + d 11 ( a 23 d 32 + a 32 d 23 + d 22 k 3 + d 33 k 2 ) + d 22 ( a 13 d 31 + a 31 d 13 + d 33 k 1 ) a 13 d 21 d 32 a 21 d 13 d 32 a 23 d 12 d 31 a 31 d 12 d 23 a 32 d 13 d 21 d 12 d 21 k 3 d 13 d 31 k 2 a 12 d 23 d 31 d 23 d 32 k 1 , q 33 = d 11 ( d 22 d 33 d 23 d 32 ) + d 12 d 23 d 31 + d 13 d 21 d 32 d 12 d 21 d 33 d 13 d 31 d 22 .
We first consider the scenario τ x = τ y = 0 ; we then convert Equation (4) into
s 3 ϑ + ι 1 s 2 ϑ + ι 2 s ϑ + ι 3 = 0 ,
where
ι 1 = c 02 + c 12 + l 12 + q 12 + q 22 l 13 c 03 + q 13 + q 23 q 33 , ι 2 = c 01 + c 11 + c 21 + l 11 + q 11 l 21 c 03 + q 13 + q 23 q 33 , ι 3 = c 00 + c 10 + c 20 + c 30 c 03 + q 13 + q 23 q 33 .
In the remainder of this paper, we assume the following.
Hypothesis 2.
ι ζ > 0 ( ζ = 1 , 2 , 3 ) , ι 1 ι 2 ι 3 > 0 .
We can deduce that all the roots of Equation (5) are in the left-half complex plane by dint of the results set forth in [43]. Therefore, the following result is true.
Lemma 1. 
The origin of system (2) is stable provided τ x = τ y = 0 .
Now, we explore the scenario when communication delay is absent. Then, Equation (4) turns into
ϕ 0 ( s ) + ϕ 1 ( s ) + ϕ 2 ( s ) + ϕ 3 ( s ) + ψ 01 ( s ) + ψ 11 ( s ) ψ 2 ( s ) e s τ y + ψ 02 ( s ) ψ 12 ( s ) e 2 s τ y ψ 03 ( s ) e 3 s τ y = 0 .
Multiplying e 2 s τ y on both sides of Equation (6), we have
ψ 03 ( s ) e s τ y + ψ 02 ( s ) ψ 12 ( s ) + ψ 01 ( s ) + ψ 11 ( s ) ψ 2 ( s ) e s τ y + ϕ 0 ( s ) + ϕ 1 ( s ) + ϕ 2 ( s ) + ϕ 3 ( s ) e 2 s τ y = 0 .
Suppose s = ς e i π 2 ( ς > 0 ) is a root of Equation (7). Performing some algebra yields
R 3 cos 2 ς τ y T 3 sin 2 ς τ y + ( R 2 + R 0 ) cos ς τ y + ( T 0 T 2 ) sin ς τ y + R 1 = 0 , T 3 cos 2 ς τ y + R 3 sin 2 ς τ y + ( T 2 + T 0 ) cos ς τ y + ( R 2 R 0 ) sin ς τ y + T 1 = 0 ,
where
R 0 = q 33 ς 3 ϑ cos 3 ϑ π 2 , T 0 = q 33 ς 3 ϑ sin 3 ϑ π 2 , R 1 = q 23 ς 3 ϑ cos 3 ϑ π 2 + q 22 ς 2 ϑ cos 2 ϑ π 2 l 13 ς 2 ϑ cos 2 ϑ π 2 , T 1 = q 23 ς 3 ϑ sin 3 ϑ π 2 + q 22 ς 2 ϑ sin 2 ϑ π 2 l 13 ς 2 ϑ sin 2 ϑ π 2 , R 2 = q 13 ς 3 ϑ cos 3 ϑ π 2 + q 12 ς 2 ϑ cos 2 ϑ π 2 + q 11 ς ϑ cos ϑ π 2 + l 12 ς 2 ϑ cos 2 ϑ π 2 + l 11 ς ϑ cos ϑ π 2 l 21 ς ϑ cos ϑ π 2 , T 2 = q 13 ς 3 ϑ sin 3 ϑ π 2 + q 12 ς 2 ϑ sin 2 ϑ π 2 + q 11 ς ϑ sin ϑ π 2 + l 12 ς 2 ϑ sin 2 ϑ π 2 + l 11 ς ϑ sin ϑ π 2 l 21 ς ϑ sin ϑ π 2 , R 3 = c 03 ς 3 ϑ cos 3 ϑ π 2 + c 02 ς 2 ϑ cos 2 ϑ π 2 + c 01 ς ϑ cos ϑ π 2 + c 00 + c 10 + c 20 + c 30 + c 12 ς 2 ϑ cos 2 ϑ π 2 + c 11 ς ϑ cos ϑ π 2 + c 21 ς ϑ cos ϑ π 2 , T 3 = c 03 ς 3 ϑ sin 3 ϑ π 2 + c 02 ς 2 ϑ sin 2 ϑ π 2 + c 01 ς ϑ sin ϑ π 2 + c 12 ς 2 ϑ sin 2 ϑ π 2 + c 11 ς ϑ sin ϑ π 2 + c 21 ς ϑ sin ϑ π 2 .
On the other hand, multiplying e s τ y on both sides of Equation (6) yields
ψ 03 ( s ) e 2 s τ y + ψ 02 ( s ) ψ 12 ( s ) e s τ y + ψ 01 ( s ) + ψ 11 ( s ) ψ 2 ( s ) + ϕ 0 ( s ) + ϕ 1 ( s ) + ϕ 2 ( s ) + ϕ 3 ( s ) e s τ y = 0 .
We can deduce the following equations by substituting s = ς e i π 2 ( ς > 0 ) into Equation (9):
R 0 cos 2 ς τ y + T 0 sin 2 ς τ y + ( R 1 + R 3 ) cos ς τ y + ( T 1 T 3 ) sin ς τ y + R 2 = 0 , T 0 cos 2 ς τ y R 0 sin 2 ς τ y + ( T 1 + T 3 ) cos ς τ y + ( R 3 R 1 ) sin ς τ y + T 2 = 0 .
We can solve cos 2 ς τ y , sin 2 ς τ y from Equation (10):
cos 2 ς τ y = R 0 ( R 1 + R 3 ) + T 0 ( T 1 + T 3 ) cos ς τ y + R 0 ( T 1 T 3 ) + T 0 ( R 3 R 1 ) sin ς τ y + R 0 R 2 + T 0 T 2 ( R 0 2 + T 0 2 ) , sin 2 ς τ y = T 0 ( R 1 + R 3 ) R 0 ( T 1 + T 3 ) cos ς τ y + R 0 ( R 1 R 3 ) + T 0 ( T 1 T 3 ) sin ς τ y R 0 T 2 + R 2 T 0 ( R 0 2 + T 0 2 ) .
Substituting these into Equation (8) results in
Π 1 sin ς τ y + Ξ 1 cos ς τ y = Θ 1 , Π 2 sin ς τ y + Ξ 2 cos ς τ y = Θ 2 ,
where
Π 1 = ( T 0 T 2 ) R 0 2 + ( R 1 T 3 R 3 T 1 ) R 0 + T 0 T 0 2 T 0 T 2 R 3 2 + R 1 R 3 T 3 ( T 3 T 1 ) , Ξ 1 = R 0 3 + R 0 2 R 2 + T 0 2 R 3 2 R 1 R 3 T 3 ( T 1 + T 3 ) R 0 + T 0 ( R 1 T 3 + R 2 T 0 R 3 T 1 ) , Θ 1 = R 1 T 0 2 + ( R 3 T 2 R 2 T 3 ) T 0 + R 0 ( R 2 R 3 + T 2 T 3 R 0 R 1 ) , Π 2 = R 0 3 + R 0 2 R 2 + R 3 2 R 1 R 3 + T 3 ( T 3 T 1 ) T 0 2 R 0 + ( R 1 T 3 + R 2 T 0 R 3 T 1 ) T 0 , Ξ 2 = ( T 0 + T 2 ) R 0 2 + ( R 3 T 1 R 1 T 3 ) R 0 R 3 2 + R 1 R 3 + T 3 ( T 1 + T 3 ) T 0 2 T 0 T 2 T 0 , Θ 2 = T 0 2 T 1 + ( R 2 R 3 + T 2 T 3 ) T 0 + R 0 ( R 2 T 3 R 0 T 1 R 3 T 2 ) .
We can deduce from Equation (11) that
cos ς τ y = Π 1 Θ 2 Π 2 Θ 1 Π 1 Ξ 2 Ξ 1 Π 2 : = 1 ( ς ) , sin ς τ y = Ξ 2 Θ 1 Ξ 1 Θ 2 Π 1 Ξ 2 Ξ 1 Π 2 : = 2 ( ς ) .
We can derive from Equation (12) that
1 2 ( ς ) + 2 2 ( ς ) = 1 .
If Equation (13) admits positive real roots ς i ( i = 1 , 2 , ) , we can deduce from the first equation of (12) that
τ y k ( i ) = arccos 1 ( ς i ) + 2 κ π ς i , i = 1 , 2 , , κ = 0 , 1 , .
Hence, we define the critical value for τ y without τ x as follows:
τ y 0 = min { τ y κ ( i ) } , ς 0 = ς i .
The delay τ y cannot alter the stability of system (2) provided that the real number can not be the root of Equation (13). Hence, τ y 0 can be defined as + under such a scenario.
Now, we consider the case where a communication delay is present. Multiplying e 2 s τ x on both sides of Equation (4), we directly have
ϕ 3 ( s ) e s τ x + ( ϕ 2 ( s ) ψ 2 ( s ) e s τ y ) + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y e s τ x + ϕ 0 ( s ) + ψ 01 ( s ) e s τ y + ψ 02 ( s ) e 2 s τ y ψ 03 ( s ) e 3 s τ y e 2 s τ x = 0 ,
We perform elementary calculations by substituting s = ϱ e i π 2 ( ϱ > 0 ) into Equation (14), yielding
R 3 cos 2 ϱ τ x T 3 sin 2 ϱ τ x + ( R 0 + R 2 ) cos ϱ τ x + ( T 0 T 2 ) sin ϱ τ x + R 1 = 0 , T 3 cos 2 ϱ τ x + R 3 sin 2 ϱ τ x + ( T 0 + T 2 ) cos ϱ τ x + ( R 2 R 0 ) sin ϱ τ x + T 1 = 0 ,
where
R 0 = c 30 , T 0 = 0 , R 1 = c 21 ϱ ϑ cos ϑ π 2 + c 20 l 21 ϱ ϑ cos ϑ π 2 cos ( ϱ τ y ) l 21 ϱ ϑ sin ϑ π 2 sin ( ϱ τ y ) , T 1 = c 21 ϱ ϑ sin ϑ π 2 + l 21 ϱ ϑ cos ϑ π 2 sin ( ϱ τ y ) l 21 ϱ ϑ sin ϑ π 2 cos ( ϱ τ y ) , R 2 = c 12 ϱ 2 ϑ cos 2 ϑ π 2 + c 11 ϱ ϑ cos ϑ π 2 + c 10 + l 12 ϱ 2 ϑ cos 2 ϑ π 2 + l 11 ϱ ϑ cos ϑ π 2 cos ( ϱ τ y ) + l 12 ϱ 2 ϑ sin 2 ϑ π 2 + l 11 ϱ ϑ sin ϑ π 2 sin ( ϱ τ y ) l 13 ϱ 2 ϑ cos ϑ π 2 cos ( 2 ϱ τ y ) l 13 ϱ 2 ϑ sin ϑ π 2 sin ( 2 ϱ τ y ) , T 2 = c 12 ϱ 2 ϑ sin 2 ϑ π 2 + c 11 ϱ ϑ sin ϑ π 2 l 12 ϱ 2 ϑ cos 2 ϑ π 2 + l 11 ϱ ϑ cos ϑ π 2 sin ( ϱ τ y ) + l 12 ϱ 2 ϑ sin 2 ϑ π 2 + l 11 ϱ ϑ sin ϑ π 2 cos ( ϱ τ y ) + l 13 ϱ 2 ϑ cos ϑ π 2 sin ( 2 ϱ τ y ) l 13 ϱ 2 ϑ sin ϑ π 2 cos ( 2 ϱ τ y ) , R 3 = c 03 ϱ 3 ϑ cos 3 ϑ π 2 + c 02 ϱ 2 ϑ cos 2 ϑ π 2 + c 01 ϱ ϑ cos ϑ π 2 + c 00 + q 13 ϱ 3 ϑ cos 3 ϑ π 2 + q 12 ϱ 2 ϑ cos 2 ϑ π 2 + q 11 ϱ ϑ cos ϑ π 2 cos ( ϱ τ y ) + q 13 ϱ 3 ϑ sin 3 ϑ π 2 + q 12 ϱ 2 ϑ sin 2 ϑ π 2 + q 11 ϱ ϑ sin ϑ π 2 sin ( ϱ τ y ) + q 23 ϱ 3 ϑ cos 3 ϑ π 2 + q 22 ϱ 2 ϑ cos 2 ϑ π 2 cos ( 2 ϱ τ y ) q 33 ϱ 3 ϑ cos 3 ϑ π 2 cos ( 3 ϱ τ y ) + q 23 ϱ 3 ϑ sin 2 ϑ π 2 + q 22 ϱ 2 ϑ sin 2 ϑ π 2 sin ( 2 ϱ τ y ) q 33 ϱ 3 ϑ sin 3 ϑ π 2 sin ( 3 ϱ τ y ) , T 3 = c 03 ϱ 3 ϑ sin 3 ϑ π 2 + c 02 ϱ 2 ϑ sin 2 ϑ π 2 + c 01 ϱ ϑ sin ϑ π 2 q 13 ϱ 3 ϑ cos 3 ϑ π 2 + q 12 ϱ 2 ϑ cos 2 ϑ π 2 + q 11 ϱ ϑ cos ϑ π 2 sin ( ϱ τ y ) + q 13 ϱ 3 ϑ sin 3 ϑ π 2 + q 12 ϱ 2 ϑ sin 2 ϑ π 2 + q 11 ϱ ϑ sin ϑ π 2 cos ( ϱ τ y ) q 23 ϱ 3 ϑ cos 3 ϑ π 2 + q 22 ϱ 2 ϑ cos 2 ϑ π 2 sin ( 2 ϱ τ y ) + q 33 ϱ 3 ϑ cos 3 ϑ π 2 sin ( 3 ϱ τ y ) + q 23 ϱ 3 ϑ sin 2 ϑ π 2 + q 22 ϱ 2 ϑ sin 2 ϑ π 2 cos ( 2 ϱ τ y ) q 33 ϱ 3 ϑ sin 3 ϑ π 2 cos ( 3 ϱ τ y ) .
We also multiply both sides of Equation (4) by e s τ x , yielding
ϕ 3 ( s ) e 2 s τ x + ϕ 2 ( s ) ψ 2 ( s ) e s τ y e s τ x + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y + ϕ 0 ( s ) + ψ 01 ( s ) e s τ y + ψ 02 ( s ) e 2 s τ y ψ 03 ( s ) e 3 s τ y e s τ x = 0 .
Similarly, by plugging s = ϱ e i π 2 ( ϱ > 0 ) into Equation (16), we can deduce the following equations:
R 0 cos 2 ϱ τ x + T 0 sin 2 ϱ τ x + ( R 1 + R 3 ) cos ϱ τ x + ( T 1 T 3 ) sin ϱ τ x + R 2 = 0 , T 0 cos 2 ϱ τ x R 0 sin 2 ϱ τ x + ( T 1 + T 3 ) cos ϱ τ x + ( R 3 R 1 ) sin ϱ τ x + T 2 = 0 .
We can solve cos 2 ϱ τ x , sin 2 ϱ τ x from Equation (17):
cos 2 ϱ τ x = R 0 ( R 1 + R 3 ) + T 0 ( T 1 + T 3 ) cos ϱ τ x + R 0 ( T 1 T 3 ) + T 0 ( R 3 R 1 ) sin ϱ τ x + R 0 R 2 + T 0 T 2 ( R 0 2 + T 0 2 ) , sin 2 ϱ τ x = T 0 ( R 1 + R 3 ) R 0 ( T 1 + T 3 ) cos ϱ τ x + R 0 ( R 1 R 3 ) + T 0 ( T 1 T 3 ) sin ϱ τ x R 0 T 2 + R 2 T 0 ( R 0 2 + T 0 2 ) .
Substituting these into Equation (15) results in
M 1 sin ϱ τ x + N 1 cos ϱ τ x = Q 1 , M 2 sin ϱ τ x + N 2 cos ϱ τ x = Q 2 ,
where
M 1 = ( T 0 T 2 ) R 0 2 + ( R 1 T 3 R 3 T 1 ) R 0 + T 0 T 0 2 T 0 T 2 R 3 2 + R 1 R 3 T 3 ( T 3 T 1 ) , N 1 = R 0 3 + R 0 2 R 2 + T 0 2 R 3 2 R 1 R 3 T 3 ( T 1 + T 3 ) R 0 + T 0 ( R 1 T 3 + R 2 T 0 R 3 T 1 ) , Q 1 = R 1 T 0 2 + ( R 3 T 2 R 2 T 3 ) T 0 + R 0 ( R 2 R 3 + T 2 T 3 R 0 R 1 ) , M 2 = R 0 3 + R 0 2 R 2 + R 3 2 R 1 R 3 + T 3 ( T 3 T 1 ) T 0 2 R 0 + ( R 1 T 3 + R 2 T 0 R 3 T 1 ) T 0 , N 2 = ( T 0 + T 2 ) R 0 2 + ( R 3 T 1 R 1 T 3 ) R 0 R 3 2 + R 1 R 3 + T 3 ( T 1 + T 3 ) T 0 2 T 0 T 2 T 0 , Q 2 = T 0 2 T 1 + ( R 2 R 3 + T 2 T 3 ) T 0 + R 0 ( R 2 T 3 R 0 T 1 R 3 T 2 ) .
From Equation (18), we can deduce that
cos ϱ τ x = M 1 Q 2 M 2 Q 1 M 1 N 2 N 1 M 2 : = f 1 ( ϱ ) , sin ϱ τ x = N 2 Q 1 N 1 Q 2 M 1 N 2 N 1 M 2 : = f 2 ( ϱ ) .
We directly acquire from Equation (19) that
f 1 2 ( ϱ ) + f 2 2 ( ϱ ) = 1 .
We further assume that
Hypothesis 3.
Equation (20) has positive real roots  ϱ ( = 1 , 2 , ) .
Thereupon, Equation (19) implies that
τ x k ( ) = arccos f 1 ( ϱ ) + 2 k π ϱ , = 1 , 2 , , k = 0 , 1 , .
Hence, we can define the critical value as follows:
τ x 0 = min { τ x k ( ) } , ϱ 0 = ϱ .
To ensure τ x 0 is the Hopf bifurcation point, we also postulate the following assumption:
Hypothesis 4.
( Φ ( i ϱ ) ) ( Ψ ( i ϱ ) ) + ( Φ ( i ϱ ) ) ( Ψ ( i ϱ ) ) 2 ( Ψ ( i ϱ ) ) + 2 ( Ψ ( i ϱ ) ) | ( ϱ = ϱ 0 , τ x = τ x 0 ) > 0  , where  Φ ( i ϱ )  and  Ψ ( i ϱ )  are subject to Equation (23).
Lemma 2. 
The following transversality condition holds given (Hypothesis 4):
d s d τ | ( ϱ = ϱ 0 , τ x = τ x 0 ) > 0 .
Proof.
We differentiate both sides of Equation (4) about τ x to give
3 ϕ 3 ( s ) s e 3 s τ x + τ e 3 s τ x d s d τ x + ϕ 2 ( s ) ψ 2 ( s ) e s τ y + ψ 2 ( s ) τ y e s τ y e 2 s τ x d s d τ x ( ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y ) s e s τ x + τ x e s τ x d s d τ x 2 ( ϕ 2 ( s ) ψ 2 ( s ) e s τ y ) s e 2 s τ x + τ x e 2 s τ x d s d τ x + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 11 ( s ) τ y e s τ y ψ 12 ( s ) e 2 s τ y + 2 ψ 12 ( s ) τ y e 2 s τ y e s τ x d s d τ x + [ ϕ 0 ( s ) + ψ 01 ( s ) e s τ y ψ 01 ( s ) τ y e s τ y + ψ 02 ( s ) e 2 s τ y 2 ψ 02 ( s ) τ y e 2 s τ y ψ 03 ( s ) e 3 s τ y + 3 ψ 03 ( s ) τ y e 3 s τ y ] d s d τ x = 0 .
We solve from Equation (22) that
d s d τ x = Φ ( s ) Ψ ( s ) ,
where
Φ ( s ) = 3 ϕ 3 ( s ) s e 3 s τ x + 2 ϕ 2 ( s ) ψ 2 ( s ) e s τ y s e 2 s τ x + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y s e s τ x ,
and
Ψ ( s ) = 3 ϕ 3 ( s ) τ x e 3 s τ x + [ ϕ 2 ( s ) ψ 2 ( s ) e s τ y + ψ 2 ( s ) τ y e s τ y ] e 2 s τ x + ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 11 ( s ) σ e s τ y ψ 12 ( s ) e 2 s τ y + 2 ψ 12 ( s ) τ y e 2 s τ y e s τ x + [ ϕ 0 ( s ) + ψ 01 ( s ) e s τ y ψ 01 ( s ) τ y e s τ y + ψ 02 ( s ) e 2 s τ y 2 ψ 02 ( s ) τ y e 2 s τ y ψ 03 ( s ) e 3 s τ y + 3 ψ 03 ( s ) τ y e 3 s τ y ] ϕ 1 ( s ) + ψ 11 ( s ) e s τ y ψ 12 ( s ) e 2 s τ y τ x e s τ x 2 ϕ 2 ( s ) ψ 2 ( s ) e s τ y τ x e 2 s τ x .
We readily check from Equation (23) that
d s d τ | ( ϱ = ϱ 0 , τ x = τ x 0 ) = ( Φ ( i ϱ ) ) · ( Ψ ( i ϱ ) ) + ( Φ ( i ϱ ) ) · ( Ψ ( i ϱ ) ) 2 ( Ψ ( i ϱ ) ) + 2 ( Ψ ( i ϱ ) ) | ( ϱ = ϱ 0 , τ x = τ x 0 ) > 0 .
Hence, the transversality condition is matched. □
In fact, τ x 0 depends on τ y for τ y [ 0 , τ y 0 ] ; that is, τ x 0 = τ x 0 ( τ y ) . To sum up the above arguments, we procure the following main Theorem.
Theorem 1. 
If (H1)–(H4) hold, then the origin of system (2) is asymptotically stable given τ x < τ x 0 ( τ y ) and becomes unstable when τ x is increased past τ x 0 ( τ y ) .
Remark 1. 
The same sort of analysis can apply to the scenario in which we can take τ y as the bifurcation parameter by letting τ x be a constant. We can procure the same Hopf bifurcation curve in the ( τ y , τ x ) plane as illustrated in Figure 3.

3. Illustrative Example

We shed some light on the validity of our developed technique by providing a numerical example in this section. All calculations and simulations were performed using MATLAB 2016b. The numerical scheme proposed in [45] was applied to visualize the results obtained. All initial conditions are given as follows:
x 1 ( t ) = 0.1 , x 2 ( t ) = 0.1 , x 3 ( t ) = 0.1 , t [ max { τ x , τ y } , 0 ] .
We fixed f i ( · ) = g i ( · ) = tanh ( · ) , and
k 1 = 1 , k 2 = 1 , k 3 = 1 , α i j = 0 ,
and we chose ϑ= 0.95, β11 = −0.8, β12 = −1.3, β13 = −1.3, β21 = 0.02, β22 = −0.8, β23 = −1.3, β31 = 0.02, β32 = −1.3, β33 = −0.8, d11 = 0.2, d12 = 0.5, d13 = 0.5, d21 = 0.05, d22 = 0.2, d23 = 0.5, d31 = 0.05, d32 = 0.5, d33 = 0.2. Then, system (2) obtained the following form:
D 0.95 x 1 ( t ) = x 1 ( t ) 0.8 tanh ( x 1 ( t τ x ) ) 1.3 tanh ( x 2 ( t τ x ) ) 1.3 tanh ( x 3 ( t τ x ) ) + 0.2 D 0.95 x 1 ( t τ y ) + 0.5 D 0.95 x 2 ( t τ y ) + 0.5 D 0.95 x 3 ( t τ y ) , D 0.95 x 2 ( t ) = x 2 ( t ) + 0.02 tanh ( x 1 ( t τ x ) ) 0.8 tanh ( x 2 ( t τ x ) ) 1.3 tanh ( x 3 ( t τ x ) ) + 0.05 D 0.95 x 1 ( t τ y ) + 0.2 D 0.95 x 2 ( t τ y ) + 0.5 D 0.95 x 3 ( t τ y ) , D 0.95 x 3 ( t ) = x 3 ( t ) + 0.02 tanh ( x 1 ( t τ x ) ) 1.3 tanh ( x 2 ( t τ x ) ) 0.8 tanh ( x 3 ( t τ x ) ) + 0.05 D 0.95 x 1 ( t τ y ) + 0.5 D 0.95 x 2 ( t τ y ) + 0.2 D 0.95 x 3 ( t τ y ) .
We can see that τ y 0 = . It is easy to compute from (21) that ϱ 0 = 3.9084 , τ x 0 = 0.2760 , and d s d τ | ( ϱ = ϱ 0 , τ x = τ x 0 ) = 3.5917 > 0 by choosing τ y = 0.2 . Theorem 1 states that the trivial equilibrium of system (24) is locally asymptotically stable when τ x < τ x 0 . This is further confirmed by Figure 1, where τ x = 0.27 < τ x 0 . In comparison, the trivial equilibrium loses its stability, causing system (24) to exhibit oscillatory behaviors over time if τ x > τ x 0 . This is further supported by Figure 2, where τ = 0.28 > τ x 0 .
We next plotted the Hopf bifurcation curves τ x 0 ( τ y ) for different orders based on the calculations in Table 1, as shown in Figure 3. In Figure 3, the Hopf bifurcation curves divide the first quadrant of the ( τ x , τ y ) plane into two categories: the domain above τ x 0 ( τ y ) is the unstable one, while the other below is the stable one. We can observe the following:
  • Although, in general, the stability of the equilibrium improves as the fractional order decreases, opposite trends can be observed when the neutral delay is small, as shown in Table 1.
  • In contrast to neural networks with only retarded delays, the Hopf bifurcation curve is non-monotonic. This indicates that system (24) with a fixed communication delay can exhibit stability switches and eventually stabilize as the neutral delay increases. We also plotted the time series for τ y = 0.005 , τ y = 0.030 , and τ y = 0.200 , respectively, by fixing τ x = 0.17 , as shown in Figure 4 which is in excellent agreement with our observation.
Finally, we conducted a sensitivity analysis to show how variations in the parameters affect the Hopf bifurcation point τ x 0 . We applied the normalized forward sensitivity index to the positive parameter P, as presented in [46].
N o r m a l i z e d f o r w a r d s e n s i t i v i t y i n d e x = τ x 0 P · P τ x 0 .
We adopted the central difference approximation technique to evaluate the following partial derivatives:
τ x 0 P = τ x 0 ( P + ξ ) τ x 0 ( P ξ ) 2 ξ + o ( ξ 2 ) .
Accordingly, we defined the sensitivity index S . I . ( P ) of the positive parameter P by choosing ϵ = 1 % P as below [47]:
S . I . ( P ) = τ x 0 ( 1.01 P ) τ x 0 ( 0.99 P ) 0.02 τ x 0 ( P ) .
If the parameter P is negative, the result differs from formula (25) by a negative sign. Therefore, we can use formula (25) to evaluate the impacts of the variations in the fractional order and delay-relevant parameters on the stability of system (24). The results are presented in Table 2.
A positive (negative) value of the index indicates that an increase (decrease) in the associated parameter enhances the system stability. The magnitude reflects the strength of this relationship. It is observed that the fractional order ϑ and the neutral delay τ y are the two most sensitive parameters affecting the bifurcation point τ x 0 . In other words, compared to other parameters, small variations in the two parameters can significantly impact the stability of system (24).

4. Conclusions

In this study, we propose a novel delayed fractional neutral tri-neuron network that integrates key factors such as the memory properties of neural networks, communication delay, and neutral delay. By applying the Laplace transformation [43,44], we derived the corresponding characteristic equation. To determine the bifurcation value of the communication delay, we overcame significant mathematical challenges associated with handling the terms e 3 s τ x and e 3 s τ y in the characteristic equation. Our findings reveal that as the communication delay surpasses the bifurcation threshold, the system transitions into an unstable state. Furthermore, sensitivity analysis indicates that neutral delay and fractional order are the two most sensitive parameters affecting the bifurcation value. The simulations showed that increasing the neutral delay induces stability switches.
Despite these insights, several essential and challenging issues remain open for future research. The study of neural networks can be broadly categorized into theoretical research and applied research. Some applications rely heavily on the dynamic properties of the designed neural networks. For instance, the robustness of associative memory is closely tied to the attractive domain of equilibrium points. Our findings offer valuable insights into the stability of equilibrium under fixed parameters, laying a solid foundation for further advancements. A promising direction for future research involves the circuit implementation of memristors to design robust associative memories [48] and hardware implementation to conduct image encryption based on our theoretical framework [49]. Additionally, our approach to calculating the Hopf bifurcation draws inspiration from previous work [43,44], where the authors employed the Caputo derivative and applied the Laplace transform to analyze the associated linear system. It is worth noting that fractional derivatives extend beyond the Caputo definition. The formulation of time delays and characteristic equations can vary significantly under different fractional derivatives, such as the Caputo–Hadamard derivative [50]. Successfully extending our approach to analyze Hopf bifurcations across various fractional derivatives remains a complex mathematical challenge. Addressing these questions is an important avenue for future investigation.

Author Contributions

Methodology, C.H.; Validation, X.S.; Formal analysis, S.L.; Writing—original draft, S.L.; Writing—review & editing, C.H.; Supervision, X.S.; Funding acquisition, S.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Natural Sciences and Engineering Research Council of Canada, grant number 2019-03907 and 2019-04830.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created.

Acknowledgments

This work was supported by the Nanhu Scholars Program for Young Scholars of the Xinyang Normal University.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Bishop, C.M. Neural Networks for Pattern Recognition; Oxford University Press: Oxford, UK, 1995. [Google Scholar]
  2. Aggarwal, C.C. Neural Networks and Deep Learning; Springer: Berlin/Heidelberg, Germany, 2018; Volume 10. [Google Scholar]
  3. Hopfield, J.J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. USA 1984, 81, 3088–3092. [Google Scholar] [CrossRef]
  4. Marcus, C.M.; Westervelt, R.M. Stability of analog neural networks with delay. Phys. Rev. A 1989, 39, 347. [Google Scholar] [CrossRef]
  5. Krstic, M. Delay Compensation for Nonlinear, Adaptive, and PDE Systems; Springer: Berlin/Heidelberg, Germany, 2009. [Google Scholar] [CrossRef]
  6. Pahnehkolaei, S.M.A.; Alfi, A.; Machado, J.T. Delay-dependent stability analysis of the QUAD vector field fractional order quaternion-valued memristive uncertain neutral type leaky integrator echo state neural networks. Neural Netw. 2019, 117, 307–327. [Google Scholar] [CrossRef] [PubMed]
  7. Lu, Y.X.; Xiao, M.; Liang, J.L.; Chen, J.; Lin, J.X.; Wang, Z.X.; Cao, J.D. Spatiotemporal Evolution of Large-Scale Bidirectional Associative Memory Neural Networks With Diffusion and Delays. IEEE Trans. Syst. Man. Cybern. Syst. 2023, 54, 1388–1400. [Google Scholar] [CrossRef]
  8. Wei, J.J.; Ruan, S.G. Stability and bifurcation in a neural network model with two delays. Phys. D 1999, 130, 255–272. [Google Scholar] [CrossRef]
  9. Gupta, P.D.; Majee, N.; Roy, A. Stability, bifurcation and global existence of a Hopf-bifurcating periodic solution for a class of three-neuron delayed network models. Nonlinear Anal. Theory Methods Appl. 2007, 67, 2934–2954. [Google Scholar] [CrossRef]
  10. Lien, C.H.; Yu, K.W.; Lin, Y.F.; Chung, Y.J.; Chung, L.Y. Global exponential stability for uncertain delayed neural networks of neutral type with mixed time delays. IEEE Trans. Syst. Man. Cybern. B. 2008, 38, 709–720. [Google Scholar] [CrossRef]
  11. Song, Q.K.; Zhao, Z.J.; Liu, Y.R.; Alsaadi, F.E. Mean-square input-to-state stability for stochastic complex-valued neural networks with neutral delay. Neurocomputing 2022, 470, 269–277. [Google Scholar] [CrossRef]
  12. Zhang, Z.Q.; Liu, W.B.; Zhou, D.M. Global asymptotic stability to a generalized Cohen–Grossberg BAM neural networks of neutral type delays. Neural Netw. 2012, 25, 94–105. [Google Scholar] [CrossRef]
  13. Fridman, E. New Lyapunov–Krasovskii functionals for stability of linear retarded and neutral type systems. Syst. Control. Lett. 2001, 43, 309–319. [Google Scholar] [CrossRef]
  14. Han, Q.L. Robust stability of uncertain delay-differential systems of neutral type. Automatica 2002, 38, 719–723. [Google Scholar] [CrossRef]
  15. Cheng, C.J.; Liao, T.L.; Yan, J.J.; Hwang, C.C. Globally asymptotic stability of a class of neutral-type neural networks with delays. IEEE Trans. Syst. Man. Cybern. B. 2006, 36, 1191–1195. [Google Scholar] [CrossRef]
  16. Zhang, H.G.; Liu, Z.W.; Huang, G.B. Novel delay-dependent robust stability analysis for switched neutral-type neural networks with time-varying delays via SC technique. IEEE Trans. Syst. Man. Cybern. B. 2010, 40, 1480–1491. [Google Scholar] [CrossRef]
  17. Faydasicok, O. New criteria for global stability of neutral-type Cohen–Grossberg neural networks with multiple delays. Neural Netw. 2020, 125, 330–337. [Google Scholar] [CrossRef] [PubMed]
  18. Arik, S. New criteria for stability of neutral-type neural networks with multiple time delays. IEEE Trans. Neural Networks Learn. Syst. 2019, 31, 1504–1513. [Google Scholar] [CrossRef]
  19. He, Y.; Liu, G.P.; Rees, D.; Wu, M. Stability analysis for neural networks with time-varying interval delay. IEEE Trans. Neural Netw. 2007, 18, 1850–1854. [Google Scholar] [CrossRef] [PubMed]
  20. Dong, T.; Xia, L.M. Stability and Hopf bifurcation of a reaction–diffusion neutral neuron system with time delay. Int. J. Bifurcat. Chaos 2017, 27, 1750214. [Google Scholar] [CrossRef]
  21. Park, J.H.; Kwon, O.M.; Lee, S.M. LMI optimization approach on stability for delayed neural networks of neutral-type. Appl. Math. Comput. 2008, 196, 236–244. [Google Scholar] [CrossRef]
  22. Feng, J.E.; Xu, S.Y.; Zou, Y. Delay-dependent stability of neutral type neural networks with distributed delays. Neurocomputing 2009, 72, 2576–2580. [Google Scholar] [CrossRef]
  23. Zhang, Y.; Li, L.; Huang, J.; Gorbachev, S.; Aravind, R.V. Exploration on bifurcation for an incommensurate five-neuron fractional-order BAM neural network involving multiple delays. Phys. D 2024, 460, 134047. [Google Scholar] [CrossRef]
  24. Xu, C.; Zhao, Y.; Lin, J.; Pang, Y.; Liu, Z.; Shen, J.; Liao, M.; Li, P.; Qin, Y. Bifurcation investigation and control scheme of fractional neural networks owning multiple delays. Comp. Appl. Math. 2024, 43, 1–33. [Google Scholar] [CrossRef]
  25. Li, S.; Cao, J.; Liu, H.; Huang, C. Delay-dependent parameters bifurcation in a fractional neural network via geometric methods. Appl. Math. Comput. 2024, 478, 128812. [Google Scholar] [CrossRef]
  26. Wu, Z.; Cai, Y.; Wang, Z.; Wang, W. Global stability of a fractional order SIS epidemic model. J. Differ. Equations 2023, 352, 221–248. [Google Scholar] [CrossRef]
  27. Khalighi, M.; Lahti, L.; Ndaïrou, F.; Rashkov, P.; Torres, D.F. Fractional modelling of COVID-19 transmission incorporating asymptomatic and super-spreader individuals. Math. Biosci. 2025, 380, 109373. [Google Scholar] [CrossRef]
  28. Lundstrom, B.N.; Higgs, M.H.; Spain, W.J.; Fairhall, A.L. Fractional differentiation by neocortical pyramidal neurons. Nat. Neurosci. 2008, 11, 1335–1342. [Google Scholar] [CrossRef]
  29. Anastasio, T.J. The fractional-order dynamics of brainstem vestibulo-oculomotor neurons. Biol. Cybern. 1994, 72, 69–79. [Google Scholar] [CrossRef]
  30. Pu, Y.F.; Yuan, X.; Yu, B. Analog circuit implementation of fractional-order memristor: Arbitrary-order lattice scaling fracmemristor. IEEE Trans. Circuits Syst. I: Regul. Pap. 2018, 65, 2903–2916. [Google Scholar] [CrossRef]
  31. Chen, J.J.; Zeng, Z.G.; Jiang, P. Global Mittag-Leffler stability and synchronization of memristor-based fractional-order neural networks. Neural Netw. 2014, 51, 1–8. [Google Scholar] [CrossRef] [PubMed]
  32. Cheng, Z. Control of the Bifurcation Behaviors of Delayed Fractional-Order Neural Networks with Cooperation–Competition Topology. Fractal Fract. 2024, 8, 689. [Google Scholar] [CrossRef]
  33. Ortigueira, M.D. A factory of fractional derivatives. Symmetry 2024, 16, 814. [Google Scholar] [CrossRef]
  34. Valério, D.; Ortigueira, M.D.; Lopes, A.M. How many fractional derivatives are there? Mathematics 2022, 10, 737. [Google Scholar] [CrossRef]
  35. Podlubny, I. Fractional Differential Equations: An Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications; Academic Press: New York, NY, USA, 1999. [Google Scholar]
  36. Huang, W.; Song, Q.; Zhao, Z.; Liu, Y.; Alsaadi, F.E. Robust stability for a class of fractional-order complex-valued projective neural networks with neutral-type delays and uncertain parameters. Neurocomputing 2021, 450, 399–410. [Google Scholar] [CrossRef]
  37. Popa, C.A. Neutral-type and mixed delays in fractional-order neural networks: Asymptotic stability analysis. Fractal Fract. 2022, 7, 36. [Google Scholar] [CrossRef]
  38. Huang, C.D.; Liu, H.; Huang, T.W.; Cao, J.D. Bifurcations Due to Different Neutral Delays in a Fractional-Order Neutral-Type Neural Network. IEEE Trans. Emerg. Top. Comput. 2024, 8, 563–575. [Google Scholar] [CrossRef]
  39. Kumar, P.; Lee, T.H.; Erturk, V.S. A novel fractional-order neutral-type two-delayed neural network: Stability, bifurcation, and numerical solution. Math. Comput. Simul. 2025, 232, 245–260. [Google Scholar] [CrossRef]
  40. Li, L.; Yuan, Y. Dynamics in three cells with multiple time delays. Nonlinear Anal. Real World Appl. 2008, 9, 725–746. [Google Scholar] [CrossRef]
  41. Wang, H.; Huang, C.; Liu, S.; Cao, J.; Liu, H. Bifurcation detection of a neutral-type fractional-order delayed neural network via stability switching curve. Nonlinear Dyn. 2025, 113, 3781–3790. [Google Scholar] [CrossRef]
  42. Gao, J.; Huang, C.D.; Liu, H. Hopf bifurcations in a fractional-order neural network introducing delays into neutral terms. Eur. Phys. J. Plus. 2024, 139, 1–11. [Google Scholar] [CrossRef]
  43. Deng, W.H.; Li, C.P.; Lü, J.H. Stability analysis of linear fractional differential system with multiple time delays. Nonlinear Dyn. 2007, 48, 409–416. [Google Scholar] [CrossRef]
  44. Pakzad, M.A.; Pakzad, S.; Nekoui, M.A. On the stability of fractional-order systems of neutral type. J. Comput. Nonlinear Dyn. 2015, 10, 051013. [Google Scholar] [CrossRef]
  45. Tuan, H.T.; Thai, H.D.; Garrappa, R. An analysis of solutions to fractional neutral differential equations with delay. Commun. Nonlinear Sci. Numer. Simul. 2021, 100, 105854. [Google Scholar] [CrossRef]
  46. Chitnis, N.; Hyman, J.M.; Cushing, J.M. Determining important parameters in the spread of malaria through the sensitivity analysis of a mathematical model. Bull. Math. Biol. 2008, 70, 1272–1296. [Google Scholar] [CrossRef] [PubMed]
  47. Li, S.; Huang, C.D.; Yuan, S.L. Hopf bifurcation of a fractional-order double-ring structured neural network model with multiple communication delays. Nonlinear Dyn. 2022, 108, 379–396. [Google Scholar] [CrossRef]
  48. Chen, C.; Min, F.; Cai, J.; Bao, H. Memristor synapse-driven simplified Hopfield neural network: Hidden dynamics, attractor control, and circuit implementation. IEEE Trans. Circuits Syst. I Regul. Pap. 2024, 71, 2308–2319. [Google Scholar] [CrossRef]
  49. Kong, X.; Yu, F.; Yao, W.; Cai, S.; Zhang, J.; Lin, H. Memristor-induced hyperchaos, multiscroll and extreme multistability in fractional-order HNN: Image encryption and FPGA implementation. Neural Netw. 2024, 171, 85–103. [Google Scholar] [CrossRef]
  50. Bounoua, M.D.; Yin, C. Hopf bifurcation in Caputo–Hadamard fractional-order differential system. Fractals 2022, 30, 2250015. [Google Scholar] [CrossRef]
Figure 1. Time series of system (24) with τ x = 0.27 < τ x 0 .
Figure 1. Time series of system (24) with τ x = 0.27 < τ x 0 .
Fractalfract 09 00189 g001
Figure 2. Time series of system (24) with τ x = 0.28 > τ x 0 .
Figure 2. Time series of system (24) with τ x = 0.28 > τ x 0 .
Fractalfract 09 00189 g002
Figure 3. Hopf bifurcation curves and stable and unstable regions in the ( τ x , τ y ) plane for different fractional orders.
Figure 3. Hopf bifurcation curves and stable and unstable regions in the ( τ x , τ y ) plane for different fractional orders.
Fractalfract 09 00189 g003
Figure 4. Stability switches occur as τ y increases in system (24) with τ x = 0.17 .
Figure 4. Stability switches occur as τ y increases in system (24) with τ x = 0.17 .
Fractalfract 09 00189 g004
Table 1. The values of Hopf bifurcation point τ x 0 for different orders and neutral delays.
Table 1. The values of Hopf bifurcation point τ x 0 for different orders and neutral delays.
ϑ ϑ = 1 ϑ = 0.95 ϑ = 0.90 ϑ = 0.85 ϑ = 0.80
ine τ y
ine τ y = 0.0000 0.21950.22060.21970.21470.2042
τ y = 0.0250 0.14970.15010.14910.14670.1431
τ y = 0.0500 0.16100.16540.16810.16960.1701
τ y = 0.0750 0.17730.18450.19000.19440.1982
τ y = 0.1000 0.19400.20360.21150.21850.2252
τ y = 0.1250 0.21040.22220.23240.24190.2513
τ y = 0.1500 0.22650.24030.25290.26480.2767
τ y = 0.1750 0.24240.25830.27300.28730.3017
τ y = 0.2000 0.24840.27600.29290.30940.3261
τ y = 0.2250 0.27380.29360.31260.33140.3503
τ y = 0.2500 0.28410.31120.33230.35320.3742
τ y = 0.2750 0.30500.32870.35190.37490.3977
τ y = 0.3000 0.31850.34630.37150.39640.4212
τ y = 0.3250 0.33540.36400.39100.41790.4444
τ y = 0.3500 0.35200.38170.41070.43930.4675
τ y = 0.3750 0.36850.40000.43030.46060.4904
τ y = 0.4000 0.38440.41740.44990.48180.5131
τ y = 0.4250 0.40110.43540.46950.50300.5357
τ y = 0.4500 0.41700.45350.48920.52410.5581
τ y = 0.4750 0.43340.47160.50880.54510.5804
τ y = 0.5000 0.45020.48980.52840.56600.6025
Table 2. The sensitivity indix S . I . ( P ) of τ x 0 about the parameters.
Table 2. The sensitivity indix S . I . ( P ) of τ x 0 about the parameters.
Parameters S . I . ( P ) for τ x 0 Parameters S . I . ( P ) for τ x 0
ϑ −1.1851 τ y 0.5117
β 11 0.0541 d 11 0.0097
β 12 0.0400 d 12 −0.0428
β 13 0.0400 d 13 −0.0428
β 21 0.0043 d 21 −0.0872
β 22 0.1166 d 22 −0.1726
β 23 0.1803 d 23 −0.4168
β 31 −0.0043 d 31 −0.0872
β 32 0.1803 d 32 −0.4168
β 33 0.1166 d 33 −0.1726
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, S.; Song, X.; Huang, C. Investigation of Delay-Induced Hopf Bifurcation in a Fractional Neutral-Type Neural Network. Fractal Fract. 2025, 9, 189. https://doi.org/10.3390/fractalfract9030189

AMA Style

Li S, Song X, Huang C. Investigation of Delay-Induced Hopf Bifurcation in a Fractional Neutral-Type Neural Network. Fractal and Fractional. 2025; 9(3):189. https://doi.org/10.3390/fractalfract9030189

Chicago/Turabian Style

Li, Shuai, Xinyu Song, and Chengdai Huang. 2025. "Investigation of Delay-Induced Hopf Bifurcation in a Fractional Neutral-Type Neural Network" Fractal and Fractional 9, no. 3: 189. https://doi.org/10.3390/fractalfract9030189

APA Style

Li, S., Song, X., & Huang, C. (2025). Investigation of Delay-Induced Hopf Bifurcation in a Fractional Neutral-Type Neural Network. Fractal and Fractional, 9(3), 189. https://doi.org/10.3390/fractalfract9030189

Article Metrics

Back to TopTop