Abstract
This paper focuses on the asymptotic behavior of nonautonomous neural networks with delays. We establish criteria for analyzing the asymptotic behavior of nonautonomous recurrent neural networks with delays by means of constructing some new generalized Halanay inequalities. We do not require to constructi any complicated Lyapunov function and our results improve some existing works. Lastly, we provide some illustrative examples to demonstrate the effectiveness of the obtained results.
Keywords:
generalized Halanay inequalities; dissipativity; asymptotic behavior; recurrent neural networks MSC:
34A40; 35B40; 92B20
1. Introduction
Recently, neural networks (NNs) have garnered significant attention and have found extensive applications across various domains, including image restoration [1], pattern recognition [2] and associative memory [3]. In practical applications, time delays are an unavoidable factor stemming from the finite switching speed of amplifiers. It’s well-established that time delays can potentially induce oscillations and instability in systems. Consequently, the asymptotic behavior of NNs with delays has been a focal point of research for numerous authors.
The study of asymptotic behavior such as dissipativity [4,5,6,7] attracting sets [8], stabilization [9,10,11] and stability offers potent tools for addressing the problem of controlling dynamics systems. In the asymptotic behavior analysis, one powerful tool is Lyapunov function or functional. Wang and Zhu [12] used a novel Lyapunov–Krasovskill functional to consider the stability of discrete-time semi-Markov jump linear systems with time delay. Fan et al. [13] using multiple Lyapunov-Krasovskii functionals to investigate the stability of switched stochastic nonlinear systems. Xu et al. [14] used the improved Lyapunov Razumikhin method to consider exponential stability of stochastic nonlinear delay systems. Zhu and Zhu [15] constructed the Lyapunov-Krasovskii functional to the stability of stochastic Highly Nonlinear Systems.
Especially, Cao and Zhou [16], Cao [17], Mohanmad and Gopalsamy [18], Sun et al. [19], Zeng et al. [7], Zeng et al. [20], Zhang et al. [21], Zhang et al. [22], Zhao and Cao [23], Zheng and Zhang [24], and Zhou and Zhang [25] used the Lypunov functional to investigate the stability of delayed cellular NNs with constant coefficient, respectively. Jiang and Cao [26], Jiang and Teng [27,28], Long et al. [29], Rehim et al. [30], Song and Zhao [6], Yu et al. [31], Zhang et al. [32], Zhang et al. [33] investigated the stability of recurrent NNs with variable coefficient by constructing Lyapunov function or functional, respectively. Through the construction of Lyapunov functions or functionals, one can find some interesting results. Nevertheless, constructing an appropriate Lyapunov function or functional can be a challenging task, particularly in the context of nonautonomous NNs with unbounded delays [34].
On the other hand, Halanay inequalities can be also used to consider the asymptotic behavior of NNs [5,29,34,35,36,37,38]. It should be noted that only [5,35,38] considered the unbounded coefficient functions, and unbounded delay functions. Hien et al. [35] considered the generalized exponential stability of one-dimensional Halalay inequalities and gave application to nonautonomous NNs. Later, Lu et al. [38] studied the global generalized exponential stability of nonautonomous NNs by multi-dimensional generalized Halanay inequalities which extended the results in [35]. However, when the coefficient functions are constants and the delay functions are infinite the works in [35,38] do not work. Hien et al. [5] considered the global dissipativity of nonautonomous NNs with delays. Howerer, their delay functions are required to be proportional.
Inspired by the preceding discussion, in this paper, we propose some generalized Halanay inequalities to investigate the asymptotic behaviour of neural networks with unbounded variable coefficients and infinite delay, and our assumptions are less restrictive than most of existing works. Our results not only enhance but also extend the results initially presented in [5,35,38].
The structure of this paper unfolds as follows. Section 2 provides an introduction to some preliminaries, definitions and model descriptions. Section 3 investigates the asymptotic behavior of NNs with delays by means of constructing some generalized Halanay inequalities. Section 4 offers some examples and simulations to exemplify the practical utility of our theoretical results. Finally, this paper concludes in the Section 5.
Notations: let and denotes the transpose of matrix A. is the n-dimensional Euclidean space equipped with the norm for . For , stands for the space of all bounded and continuous functions equipped with the norm . For any sets D and E, define . .
2. Preliminaries and Model Description
This paper investigates the following NNs with delays
where is the neuron state variable of the neural network, is the initial value, denotes the solution (1) with initial value , sometimes we write for short. stands for self-feedback coefficient, and stand for neuron connect weight. represents the transmission delay. is the external bias, and stand for the activation functions. If the initial value of defined on , define for , then (1) is clearly defined.
Now, we introduce four definitions of asymptotic behavior.
Definition 1
([5]). A compact set is called to be a global attracting set of (1), provided , where represents the distance between q and Ω.
Definition 2
([5]). A compact set is called to be a global generalized exponential attracting set of (1), provided there exists a satisfies that
where is a nondecreasing function satisfies that .
Remark 1.
Substituting with , , and , (), respectively, results in Ω becoming a global exponential, polynomial as well as logarithmic attracting set of system (1), correspondingly.
Definition 3
Remark 2.
Definition 4
([38]). System (1) is called to be globally generalized exponential stable, provided for any two solutions and , each having distinct initial values , there exists a non-negative function and a non-decreasing function with property such that
where represents the decay rate.
3. Main Results
In this section, the asymptotic behavior of (1) is discussed by means of generalized Halanay inequalities.
Theorem 1.
Let the following conditions hold
Remark 3.
Conditions – imply the local Lipschitz condition and local linear growth condition. So the existence and uniqueness of solution can be guaranteed.
Proof.
Assume is the solution of (1) with initial value . Let
then
For each and , from , (3) and (4), we have
where is the upper-right Dini derivative. Define . It is clear that for and . Suppose there exist , and such that , and for and . Then we get . In contrast
This signifies a contradiction, implying that
So we get
Then
This completes the proof. □
Remark 4.
Condition can be omitted, but in order to see our main results clearly, so we reserve it.
Theorem 2.
Assume – and the following conditions hold:
- (C.4)
- For , there exist constants and such thatwhere
- (C.5)
- For ,andwhere, were introduced in Theorem 1.
Then we have the following assertions:
Proof.
When , the proof is deduce from Theorem (1). Now, suppose and define
Note that, for each , is continuous on ,
and . So for , equation has an unique solution . Define , then
Multiply both sides of (6) by , we get
From , and (7), we have
and
For , define
Then
Hence
By (11) and the definition of , we get
Thus, for and , from –, (8)–(10) and (12), we get
At last, we show when , for and by reduction to absurdity. Clearly, for . Suppose there exist , and such that , and for and , then we get . In contrast, from (5) and (13), we get
This is a contradiction, the proof is completed. So for each , we get
and
Now, we proof the assertion . Define
By (14), we get
This means that is the global generalized exponential attracting set of (1). Now, we prove the assertion . Obvious, the ball is an absorbing set of (1) for any . This completes the proof. □
Remark 5.
and for each , there exist positive constants , such that
They got the following results
and the global generalized exponential attracting set is
where and .
Hien et al. [5] investigated the dissipativity of the specific instance of the system (1), namely, the delay functions are proportional. Under condition and the following conditions
- (C.4′)
- For , there exist constants and such that
- (C.5′)
- For , there exist constants , and such that
We mention here that our conditions are less restrictive, i.e., can be zero at some time and the delay functions can be other types of delay functions. Besides our results also improve the results in [5]. Especially when condtions and hold, obvious,
and for each , we get
So we have , this means that our estimate is sharper than [5]. The above discussion shows that this paper improves and extends the results in [5].
Theorem 3.
Let and denote two solutions of (1) with distinct initial values . Assume that conditions , , and the following conditions are satisfied:
- (C.6)
- For , there exist positive constants , such thatand there exists such that
- (C.7)
- For , there exist constants and such thatThen,and
Proof.
For each and , define . Then for each and , we get
Firstly, we prove
Obviously, for and . Suppose there exist , and such that , and for and , then . In contrast
This is a contradiction. Then we get for and . Construct the following inequalities:
and define
Similar to the proof of Theorem 2, one can find a such that
then we have following estimates
and
This completes the proof. □
Remark 6.
Remark 7.
and
Then, system (1) is globally generalized exponential stable. We mention here that if we choose , then our condtions are similar to the conditions in [38], but less conservative, the results in [38] do not work if at some time, or for all . Besides, is quite restrictive. For instance, when , and the delay functions are infinite, then the condition is not satisfied. However, in such cases, we have the flexibility to select a suitable that aligns with our condtions. so this paper enhances and broadens the results in [38].
Lu et al. [38] considered the globally generalized exponential stability of (1). Under condition and the following conditions
- (C.1′)
- For each , , , and are all continuous functions defined on .
- (C.6′)
- For each ,
- (C.7′)
- For , there exists a such that
4. Examples
This section gives four illustrative examples to demonstrate the practical applicability of the theoretical results. To enhance the clarity of the obtained results, we employ a linear representation instead of a nonlinear one.
Example 1.
Consider the following NNs with proportional delays:
where , , , , , , , , , , , , , , . It can be verified that, . Obviously, , and . we can find conditions – are satisfied, from Theorem 1, we get
Then system (16) is dissipative, while the ball serves as both a globally attracting and an absorbing set, as depicted in Figure 1.
Figure 1.
and of Example 1.
Remark 8.
All the coefficient and delay functions of Example (1) are unbounded.
Example 2.
Consider the following NNs with proportional delays:
where , , , , , , , , , , , , , and and .
It can be verified that, , , , , , , , , .
Choose , and , then , and . One can find , and . Then conditions of – are satisfied, for different initial values and , from Theorem 2, we get
which are shown in Figure 2, Figure 3 and Figure 4, respectively.
Figure 2.
and of Example 2 and their estimates.
Figure 3.
and of Example 2.
Figure 4.
and of Example 2 and their estimates.
Remark 9.
All the coefficient, activation and delay functions in Example 2 are unbounded, and , for , which means that the results in [22,26,27,32,33,35,36,37,38] can not solve this case.
Example 3.
Consider the following 2-dimensional NNs with time-varying delays:
where, , , , , , , , , , , , , , , and .
It can be verified that, , , , , , , , , .
Choose , and , then , and . We can find , and . Then conditions – are satisfied, for different initial values and , from Theorem 2, we get
which are shown by Figure 5, Figure 6 and Figure 7, respectively.
Figure 5.
and of Example 3 and their estimates.
Figure 6.
and of Example 3.
Figure 7.
and of Example 3 and their estimates.
Remark 10.
It is worth noting that , for , and as well as the delay functions lack differentiability at points where for , which make the results in [22,26,28,32,33,36,37] be invalid.
Example 4.
Consider the following 2-dimensional NNs with proportional delays:
where , , for , for , for , for , , , , , and for .
It can be verified that, . Obviously, , then
and
Choose , , then , and . We can find . Then conditions of , , and are satisfied, from Theorem 3, we get the following estimate
which are illustrated by Figure 8.
Figure 8.
and of Example 4 and their estimate.
Remark 11.
We note that , for , which makes the results in [38] be invalid.
5. Conclusions
In this paper, we obtained some criteria on dissipativity and globally generalized exponential stability of a class of NNs with delays by constructing some generalized Halanay inequalities. We mention here that our coefficient functions and delay functions can be all unbounded, and our results improve and generalize some existing works [5,35,38]. At last, four numerical examples have shown the effectiveness of our main results.
Our method has its limitations, when the is oscillation, such as , our method is invalid in this case. The author will investigate this case in the future.
Author Contributions
D.R.: Writing and original draft. Y.L.: Review and editing. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by Talent Special Project of Guangdong Polytechnic Normal University (2021SDKYA053 and 2021SDKYA068), Guangzhou Basic and Applied Basic Research Foundation (2023A04J0031 and 2023A04J0032) and Young Innovative Talents Project of Guangdong Universities (2021KQNCX130).
Data Availability Statement
No data was used for the research described in the article.
Conflicts of Interest
The authors declare that they have no competing interests.
References
- Hu, X.; Feng, G.; Duan, S.; Liu, L. Multilayer rtd-memristor-based cellular neural networks for color image processing. Neurocomputing 2015, 162, 150–162. [Google Scholar] [CrossRef]
- Suganthan, P.N.; Teoh, E.K.; Mital, D.P. Pattern recognition by homomorphic graph matching using Hopfield neural networks. Image Vis. Comput. 2015, 13, 45–60. [Google Scholar] [CrossRef]
- Liu, D.; Michel, A.N. Cellular neural networks for associative memories. IEEE Trans. Circuits Syst. II Analog. Digit. Signal Process. 1993, 40, 119–121. [Google Scholar] [CrossRef]
- Feng, Z.; Lam, J. Stability and dissipativity analysis of distributed delay cellular neural networks. IEEE Trans. Neural Netw. 2011, 22, 976–981. [Google Scholar] [CrossRef]
- Hien, L.V.; Phat, V.N.; Trinh, H. On global dissipativity of nonautonomous neural networks with multiple proportional delays. IEEE Trans. Neural Netw. Learn. Syst. 2018, 29, 225–231. [Google Scholar] [CrossRef] [PubMed]
- Song, Q.; Zhao, Z. Global dissipativity of neural networks with both variable and unbounded delays. Chaos Solitons Fractals 2005, 25, 393–401. [Google Scholar] [CrossRef]
- Zeng, H.; He, Y.; Shi, P.; Wu, M.; Xiao, S. Dissipativity analysis of neural networks with time-varying delays. Neurocomputing 2015, 16, 741–746. [Google Scholar] [CrossRef]
- Chen, A.; Cao, J. Existence and attractivity of almost periodic solutions for cellular neural networks with distributed delays and variable coefficients. Appl. Math. Comput. 2003, 134, 125–140. [Google Scholar]
- Ding, K.; Zhu, Q. Intermittent static output feedback control for stochastic delayed-switched positive systems with only partially measurable information. IEEE Trans. Autom. Control 2023, 68, 8150–8157. [Google Scholar] [CrossRef]
- Xiao, Q.; Huang, T.; Zeng, Z. Stabilization of nonautonomous recurrent neural networks with bounded and unbounded delays on time scales. IEEE Trans. Cybern. 2019, 50, 4307–4317. [Google Scholar] [CrossRef]
- Zhu, Q. Stabilization of stochastic nonlinear delay systems with exogenous disturbances and the event-triggered feedback control. IEEE Trans. Autom. Control 2019, 64, 3764–3771. [Google Scholar] [CrossRef]
- Wang, B.; Zhu, Q. Stability analysis of discrete-time semi-Markov jump linear systems with time delay. IEEE Trans. Autom. Control 2023, 68, 6758–6765. [Google Scholar] [CrossRef]
- Fan, L.; Zhu, Q.; Zheng, W. Stability analysis of switched stochastic nonlinear systems with state-dependent delay. IEEE Trans. Autom. Control 2023. [Google Scholar] [CrossRef]
- Xu, H.; Zhu, Q.; Zheng, W. Exponential stability of stochastic nonlinear delay systems subject to multiple periodic impulses. IEEE Trans. Autom. Control 2023. [Google Scholar] [CrossRef]
- Zhu, Z.; Zhu, Q. Adaptive event-triggered fuzzy control for stochastic highly nonlinear systems with time delay and non-triangular structure interconnections. IEEE Trans. Fuzzy Syst. 2023. [Google Scholar] [CrossRef]
- Cao, J.; Zhou, D. Stability analysis of delayed cellular neural networks. Neural Netw. 1998, 11, 1601–1605. [Google Scholar] [CrossRef]
- Cao, J. New results concerning exponential stability and periodic solutions of delayed cellular neural networks. Phys. Lett. A 2003, 307, 136–147. [Google Scholar] [CrossRef]
- Mohamad, S.; Gopalsamy, K. Exponential stability of continuous-time and discrete-time cellular neural networks with delays. Appl. Math. Comput. 2003, 135, 17–38. [Google Scholar] [CrossRef]
- Sun, L.; Tang, Y.; Wang, W.; Shen, S. Stability analysis of time-varying delay neural networks based on new integral inequalities. J. Frankl. Inst. 2020, 357, 10828–10843. [Google Scholar] [CrossRef]
- Zeng, Z.; Wang, J.; Liao, X. Global asymptotic stability and global exponential stability of neural networks with unbounded time-varying delays. IEEE Trans. Neural Netw. Learn. Syst. 2005, 52, 168–173. [Google Scholar]
- Zhang, B.; Lam, J.; Xu, S. Stability analysis of distributed delay neural networks based on relaxed Lyapunov-Krasovskii functionals. IEEE Trans. Neural Netw. Learn. Syst. 2015, 26, 1480–1492. [Google Scholar] [CrossRef]
- Zhang, Q.; Wei, X.; Xu, J. Delay-dependent exponential stability of cellular neural networks with time-varying delays. Chaos Solitons Fractals 2005, 23, 1363–1369. [Google Scholar] [CrossRef]
- Zhao, H.; Cao, J. New conditions for global exponential stability of cellular neural networks with delays. Neural Netw. 2005, 18, 1332–1340. [Google Scholar] [CrossRef] [PubMed]
- Zheng, C.; Zhang, H. New delay-dependent global exponential stability criterion for cellular-type neural networks with time-varying delays. IEEE Trans. Neural Netw. Learn. Syst. 2009, 56, 250–254. [Google Scholar]
- Zhou, L.; Zhang, Y. Global exponential periodicity and stability of recurrent neural networks with multi-proportional delays. ISA Trans. 2016, 60, 89–95. [Google Scholar] [CrossRef]
- Jiang, H.; Cao, J. Global exponential stability of periodic neural networks with time-varying delays. Neurocomputing 2006, 70, 343–350. [Google Scholar] [CrossRef]
- Jiang, H.; Teng, Z. Global exponential stability of cellular neural networks with time-varying coefficients and delays. Neural Netw. 2004, 17, 1415–1425. [Google Scholar] [CrossRef]
- Jiang, H.; Teng, Z. Boundedness and global stability for nonautonomous recurrent neural networks with distributed delays. Chaos Solitons Fractals 2006, 30, 83–93. [Google Scholar] [CrossRef]
- Long, S.; Li, H.; Zhang, Y. Dynamic behavior of nonautonomous cellular neural networks with time-varying delays. Neurocomputing 2015, 168, 846–852. [Google Scholar] [CrossRef]
- Rehim, M.; Jiang, H.; Li, Z.; Teng, Z. Boundedness and stability for nonautonomous cellular neural networks with delay. Neural Netw. 2004, 17, 1017–1025. [Google Scholar] [CrossRef]
- Yu, T.; Cao, D.; Liu, S.; Chen, H. Stability analysis of neural networks with periodic coefficients and piecewise constant arguments. J. Frankl. Inst. 2016, 353, 409–425. [Google Scholar] [CrossRef]
- Zhang, Q.; Wei, X.; Xu, J. Global exponential stability for nonautonomous cellular neural networks with delays. Phys. Lett. A 2006, 351, 153–160. [Google Scholar] [CrossRef]
- Zhang, Q.; Wei, X.; Xu, J. Global exponential stability for nonautonomous cellular neural networks with unbounded delays. Phys. Lett. A 2009, 39, 1144–1151. [Google Scholar] [CrossRef]
- Li, H.; Zhang, W.; Li, C.; Zhang, W. Global asymptotical stability for a class of non-autonomous impulsive inertial neural networks with unbounded time-varying delay. Neural Comput. Appl. 2019, 31, 6757–6766. [Google Scholar] [CrossRef]
- Hien, L.V.; Son, D.T.; Trinh, H. New generalized Halanay inequalities with applications to stability of nonlinear non-autonomous time-delay systems. Nonlinear Dyn. 2015, 82, 563–575. [Google Scholar] [CrossRef]
- Jiang, M.; Mu, J.; Huang, D. Globally exponential stability and dissipativity for nonautonomous neural networks with mixed time-varying delays. Neurocomputing 2016, 205, 421–429. [Google Scholar] [CrossRef]
- Liu, B.; Lu, W.; Chen, T. Generalized Halanay inequalities and their applications to neural networks with unbounded time-varying delays. IEEE Trans. Neural Netw. 2011, 22, 1508–1513. [Google Scholar] [CrossRef]
- Lu, B.; Jiang, H.; Abdurahman, A.; Hu, C. Global generalized exponential stability for a class of nonautonomous cellular neural networks via generalized Halanay inequalities. Neurocomputing 2016, 214, 1046–1052. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).