Abstract
In this work, we recall some definitions on fractional calculus with discrete-time. Then, we introduce a discrete-time Hopfield neural network (D.T.H.N.N) with non-commensurate fractional variable-order (V.O) for three neurons. After that, phase-plot portraits, bifurcation and Lyapunov exponents diagrams are employed to verify that the proposed discrete time Hopfield neural network with non-commensurate fractional variable order has chaotic behavior. Furthermore, we use the 0-1 test and complexity algorithm to confirm and prove the results obtained about the presence of chaos. Finally, simulations are carried out in Matlab to illustrate the results.
1. Introduction
Recently, due to its multiple applications, particularly in the context of secure communication [1,2,3,4] and control [5,6], chaotic discrete-time systems have gained a lot of attention. Lozi map [7], 2-D Hénon system [8], Zeraoulia-Sprott map [9], Baier–Klein map [10], the generalized Hénon system [11] and the discrete Rössler system [12] are a few examples of chaotic discrete-time systems with integer order that have been presented over time. Researchers have lately become more interested in the systems with fractional order that correspond to the previous chaotic systems with integer order [13].
Fractional-order derivatives are more precise than integer-order derivatives because they are a great tool for describing the memory effect in a variety of materials and processing [14].
Discrete fractional calculus and fractional difference operators have received the attention of mathematicians [15,16,17]. Refs. [18,19] introduced the concept of discrete fractional calculus to chaotic maps and showed that chaos characteristics remain. For instance, in [20], the authors analysed the existence of chaos in 2D maps with fractional order, the chaotic behavior of Ikeda map with a non-integer order was studied in [21], in [22], fractional chaotic systems with discrete time and without equilibrium points were introduced, and, in [23], bifurcation and dynamics of systems with fractional and various closed curve equilibrium points were investigated, while control and dynamics of fractional quadratic map with no equilibrium points were analysed in [24].
The great interest of taking into account a Caputo fractional difference operator [25] in the modeling of dynamical systems with discrete time was demonstrated by the pertinent publications cited above.
Since fractional calculus has more advantages than an integer one, it makes sense for us to use this approach in studying neural networks’ systems [26,27,28,29]. The modeling of neural networks with fractional order is used to investigate biological neurons for two reasons. First, by increasing one degree of freedom, the fractional order increases the performance of the system. Second, the modeling of neural networks with fractional order has an infinite memory. Fractional-order neural networks hope to play an important role in the field of parameter estimation. Neural networks approximation showed higher rates of approximation at a fractional level [30].
A lot of attention has been paid to the analysis of the dynamics of neural networks with fractional order, and significant results have been achieved. For instance, in [31], LMI conditions for global stability of fractional-order neural networks were studied; in Ref. [32], the authors presented an adaptive model-free synchronization of different fractional-order neural networks with an application in cryptography, the stability, bifurcation, and chaos of Hopfield neural networks with a non-integer order were analysed. In [33,34,35,36,37], the stability of the Hopfield neural networks with fractional order was investigated, in [38], complexity, chaos and multi-stability of a discrete time Hopfield neural network with variable order and short memory were studied, whereas, in [39], the dynamics of the fractional order neural network were analysed. Recently, in [40], a study of discrete time Hopfield neural network with incommensurate fractional order was presented.
The major purpose of this research is to study the effect of using the non-commensurate fractional variable-order on the system studied in [40]. The fractional variable-order form is likely to exhibit even more complex dynamics.
Inspired by the research cited above, firstly, a discrete time Hopfield neural network with a non-commensurate fractional variable order is proposed. Then, the dynamics of the presented model are analysed via phase-plot portraits, bifurcation and maximum Lyapunov exponent (MLE) diagrams. After that, 0-1 test and the complexity algorithm are used to confirm the chaotic behavior of the system. Finally, the corresponding simulations are performed.
2. Preliminaries on Discrete Fractional Calculus
In this section, we present some definitions according to fractional discrete calculus to describe the discrete time Hopfield neural network (D.T.H.N.N.) with an incommensurate fractional variable-order.
Discrete Fractional Calculus
Let h be a function defined on a time scale .
- The -th fractional sum for the function h is defined as [16]:wherewhich represents the falling factorial function.
- The -Caputo fractional difference operator for the function h is defined as [25]:where , and .
3. The Discrete-Time Neural Network with an Incommensurate Fractional Variable Order
Sivasundaram and Kaslik [41] described the model of the Hopfield fractional neural network consisting of m neurons as follows:
Given that:
- represents the activation function of the neurons;
- denotes the weights matrix which describes the connection between i and j neurons;
- represents the self-regulating neurons’ parameters;
- are the external inputs; in our work, they are equal to 0.
Note that is the Caputo fractional order derivative defined as:
where the fractional order .
Here, we consider a system with three neurons. To simplify calculations, herein choose , , and the matrix A is chosen as:
As a result, we obtain the following Hopfield neural network with continuous time:
From system (9), we obtain a new D.T.H.N.N with incommensurate fractional variable-order by replacing the operator with the Caputo-like difference operator with fractional variable-order , which can be given by:
with , being the variable order and ,
3.1. Dynamical Analysis and Numerical Simulations
The goal of this section is to illustrate the dynamics of the D.T.H.N.N with incommensurate fractional variable order (10) via numerical simulation.
Now, according to the theorem cited in [42], the unique solution of the system (10) is given by:
Take and since , and the numerical formula of the system (10) is designed as:
with the known initial condition , , .
To study the effect of the fractional variable order on the D.T.H.N.N (10), we take and the initial condition , where the fractional variable order is chosen as: , and .
Firstly, we draw the discrete time evolution of the states as shown in Figure 1.
Figure 1.
Time evolution of the states , and of the D.T.H.N.N with incommensurate fractional V.O (10).
We observe that the states , and of the system (10) exhibit chaotic behaviour, but we do not rely on it to determine the nature of the dynamic; for this reason, we need to plot the trajectories in the state space.
Figure 2 depicts the plot of phase portraits of our system (10), which displays a chaotic attractor.
Figure 2.
Phase-plot portraits of the D.T.H.N.N with incommensurate fractional variable-order (10).
3.2. Bifurcation Diagram and Maximum Lyapunov Exponents
Now, in order to explore the presence of chaos, we consider the bifurcation diagram and maximum Lyapunov exponents of the state by varying the parameter P in the interval with the step . Note that we calculate the maximum L.E using the algorithm of Jacobian matrix [43].
In our case, the matrix of the system (10) is given by:
where
Finally, the maximum L.E has the following formula:
Note that are the eigenvalues of the matrix .
As can be observed in the bifurcation and the Maximum L.E represented in Figure 3 and Figure 4, respectively, upon varying the parameter P, system (10) exhibits complex dynamics which include chaos and quasi-periodic behavior. In particular, system (10) is chaotic when the parameter , where the value of the maximum Lyapunov exponents is positive, while for the rest of values of the parameter P, the system is quasi-periodic since it can not be periodic because fractional order systems cannot have periodic non-constant solutions (for more details, see [44,45,46]), where the value of the maximum Lyapunov exponents is negative.
Figure 3.
Bifurcation diagram versus the parameter P of the D.T.H.N.N with incommensurate fractional V.O (10).
Figure 4.
Maximum Lyapunov exponents versus P of D.T.H.N.N with incommensurate fractional V.O (10).
3.3. Complexity
To analyse the complex behaviour of systems, the complexity [47] is used based on the inverse Fourier transform.
For a sequence , the algorithm of the complexity is given as follows:
- We calculate the discrete Fourier transform of the sequence as:
- The mean square value is given as:
- We set
- We define the inverse Fourier transform of as follows:Finally, the formula of the complexity is defined as:
The plot of complexity is shown in Figure 5, and we can observe that the value of the complexity of the proposed system (10) increases when the parameter P passes through the range [0.56, 0.61], which confirms that the proposed system is chaotic in this range, so the algorithm measures the complexity effectively.
Figure 5.
The complexity versus P of the D.T.H.N.N with incommensurate V.O (10).
3.4. The 0-1 Test Method for Chaos
Another method that can be used to test chaos of the proposed D.T.H.N.N with incommensurate fractional V.O is a "0–1 test", which was first presented by Gottwald and Melbourne [48] to detect the existence of chaos from a time series.
Firstly, we consider a time series and c a random constant in the interval . Then, we define two translation variables as follows:
In addition, we present the formula of the mean square displacement:
Finally, the asymptotic growth rate is defined by:
Now, in order to determine the presence of chaos, we need the plot of the asymptotic growth rate and the plot of and in the plane. When K is closer to 1 and the trajectories of and are Brownian, the map is chaotic, whereas, when K is closer to 0 and the trajectories of and are bounded, the map is regular.
Figure 6 depicts the 0–1 test versus P of the D.T.H.N.N with an incommensurate fractional variable order (10). One can observe that, when , the value of the growth rate K is closer to 1, which indicates the presence of chaos, while the value of the growth rate K is closer to 0 for the rest of values of the system parameter P, which proves that the proposed system (10) is quasi-periodic.
Figure 6.
The 0-1 test versus P of the D.T.H.N.N with incommensurate fractional V.O (10).
The plots are shown in Figure 7 for different values of the parameter P with the same initial conditions used previously. In particular, when and , the trajectories of and are bounded, and the system (10) is quasi-periodic. When and the trajectories of and are Brownian and the system (10) is chaotic, which is extremely similar to the results obtained in Figure 6.
Figure 7.
The plot of p versus q for the D.T.H.N.N with incommensurate fractional V.O (10) for different values of the system parameter P.
We observe that the results of the 0-1 test agree well with the results obtained in bifurcation and the largest Lyapunov exponents’ diagrams and the complexity algorithm.
4. Conclusions and Future Research Directions
Based on the discrete time Hopfield neural network with incommensurate fractional order, this research has presented a Caputo-difference form of the discrete time Hopfield neural network with an incommensurate fractional variable-order. Phase-plot portraits, bifurcation and maximum Lyapunov exponents diagrams have shown the complexity of the dynamics of the proposed model. In addition, the 0-1 test and complexity algorithm have been employed to prove and confirm the presence of chaos in a small interval. The obtained results give us insight into the behavior of the discrete time Hopfield neural network system when using fractional variable order.
The future research directions that will depend on the results obtained in this work are in two directions: the first is theoretical and the second is practical. The theoretical aspect lies in the formulation of discrete time neural networks with strong and appropriate fractional operators, whether from an analytical or numerical point of view, while the practical aspect lies in the actual application of this type of network, especially in encryption and secure communications; the authors also aim to find electrical circuits that represent this type of network, due to the dynamic property of these neural networks proven to be suitable for these types of applications.
Author Contributions
Formal analysis, R.C.K., A.O., M.A.H. and G.G.; Investigation, A.O. and M.A.H.; Methodology, A.O. and G.G.; Software, R.C.K.; Supervision, A.O. and M.A.H.; Validation, A.O. and G.G.; Writing—original draft, R.C.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available on request from the references.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Kocarev, L.; Szczepanski, J.; Amigo, J.M.; Tomovski, I. Discrete Chaos—I: Theory. IEEE Trans. Circuits Syst. I Regul. Pap. 2006, 53, 1300–1309. [Google Scholar] [CrossRef] [Scilit]
- Li, C.; Song, Y.; Wang, F.; Liang, Z.; Zhu, B. Chaotic path planner of autonomous mobile robots based on the standard map for surveillance missions. Math. Prob. Eng. 2015, 2015, 263964. [Google Scholar] [CrossRef] [Scilit]
- Papadimitriou, S.; Bezerianosa, A.; Bountis, T.; Pavlides, G. Secure communication protocols with discrete nonlinear chaotic maps. J. Syst. Archit. 2001, 47, 61–72. [Google Scholar] [CrossRef] [Scilit]
- Kwok, H.S.; Tang, W.K.S.; Man, K.F. Online secure chatting system using discrete chaotic map. Int. J. Bifurcat. Chaos 2004, 14, 285–292. [Google Scholar] [CrossRef] [Scilit]
- Banerjee, S.; Kurth, J. Chaos and cryptography: A new dimension in secure communications. Eur. Phys. J. Spec. Top. 2014, 223, 1441–1445. [Google Scholar] [CrossRef] [Scilit]
- Fataf, N.A.A.; Mukherjee, S.; Said, M.R.M.; Rauf, U.F.A.; Hina, A.D.; Banerjee, S. Synchronization between two discrete chaotic systems for secure communications. Int. Conf. Comms. Elec. (ICCE) 2016, 477–481. [Google Scholar] [CrossRef] [Scilit]
- Hénon, M. A two-dimensional mapping with a strange attractor. Commun. Math. Phys. 1976, 50, 69–77. [Google Scholar] [CrossRef] [Scilit]
- Lozi, R. Un atracteur étrange du type attracteur de Hénon. J. Phys. Colloq. 1978, 39, 9–10. [Google Scholar] [CrossRef] [Scilit]
- Zeraoulia, E.; Sprott, J.C. The discrete hyperchaotic double scroll. Int. J. Bifurc. Chaos. 2009, 19, 1023–1027. [Google Scholar] [CrossRef] [Scilit]
- Hitzl, D.L.; Zele, F. An exploration of the Hénon quadratic map. Phys. D Nonlinear Phenom. 1985, 14, 305–326. [Google Scholar] [CrossRef] [Scilit]
- Baier, G.; Sahle, S. Design of hyperchaotic flows. Phys. Rev. E 1995, 51, 2712–2714. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yan, Z. (complete or anticipated) synchronization backstepping scheme in a class of discrete–time chaotic (hyperchaotic) systems: A symbolic–numeric computation approach. Chaos 2006, 16, 1930727. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ouannas, A.; Bendoukha, S.; Khennaoui, A.A.; Grassi, G.; Wang, X.; Pham, V.T. Chaos synchronization of fractional-order discrete-time systems with different dimensions using two scaling matrices. Open Phys. J. 2019, 17, 942–949. [Google Scholar] [CrossRef] [Scilit]
- Podlubny, I. Fractional Differential Equations: An Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications; Elsevier: Amsterdam, The Netherlands, 1999; ISBN 9780080531984. [Google Scholar]
- Ostalczyk, P. Discrete Fractional Calculus: Applications in Control and Image Processing; World Scientific: Singapore, 2015. [Google Scholar] [CrossRef] [Scilit]
- Atici, F.M.; Eloe, P. Discrete fractional calculus with the nabla operator. Electron. J. Qual. Theory Differ. Equ. 2009, 2009, 1–12. [Google Scholar] [CrossRef] [Scilit]
- Diaz, J.B.; Osler, T.J. Differences of fractional order. Math. Comput. 1974, 28, 185–202. [Google Scholar] [CrossRef] [Scilit]
- Wu, G.C.; Baleanu, D. Discrete fractional logistic map and its chaos. Nonlinear Dyn. 2014, 75, 283–287. [Google Scholar] [CrossRef] [Scilit]
- Khennaoui, A.A.; Ouannas, A.; Bendoukha, S.; Grassi, G.; Wang, X.; Pham, V.T.; Alsaadi, F.E. Chaos, control, and synchronization in some fractional-order difference equations. Adv. Differ. Equ. 2019, 2019, 412. [Google Scholar] [CrossRef] [Scilit]
- Khennaoui, A.A.; Ouannas, A.; Bendoukha, S.; Grassi, G.; Lozi, R.P.; Pham, V.T. On Fractional Order Discrete Time Systems: Chaos, Stabilization and Synchronization. Chaos Solit. Fractals 2019, 119, 150–162. [Google Scholar] [CrossRef] [Scilit]
- Ouannas, A.; Khennaoui, A.A.; Odibat, Z.; Pham, V.T.; Grassi, G. On the dynamics, control and synchronization of fractional-order Ikeda map. Chaos Solit. Fractals 2019, 123, 108–115. [Google Scholar] [CrossRef] [Scilit]
- Ouannas, A.; Khennaoui, A.A.; Momani, S.; Grassi, G.; Pham, V.T.; El-Khazali, R.; Vo Hoang, D. A Quadratic Fractional Map without Equilibria: Bifurcation, 0-1 Test, Complexity, Entropy, and Control. Int. J. Electron. 2020, 9, 748. [Google Scholar] [CrossRef] [Scilit]
- Ouannas, A.; Almatroud, O.A.; Khennaoui, A.A.; Al-sawalha, M.M.; Baleanu, D.; Huynh, V.V.; Pham, V.T. Bifurcations, Hidden Chaos and Control in Fractional Maps. Symmetry 2020, 12, 879. [Google Scholar] [CrossRef] [Scilit]
- Hadjabi, F.; Ouannas, A.; Shawagfeh, N.; Khennaoui, A.A.; Grassi, G. On Two-Dimensional Fractional Chaotic Maps with Symmetries. Symmetry 2020, 12, 756. [Google Scholar] [CrossRef] [Scilit]
- Abdeljawad, T. On Riemann and Caputo fractional differences. Comput. Math. Appl. 2011, 62, 1602–1611. [Google Scholar] [CrossRef] [Scilit]
- Wang, H.; Yu, Y.; Wen, G. Stability analysis of fractional-order Hopfield neural networks with time delays. Neural Netw. 2014, 55, 98–109. [Google Scholar] [CrossRef] [Scilit]
- Lazarević, M. Stability and stabilization of fractional order time delay systems. Sci. Tech. Rev. 2011, 61, 31–45. [Google Scholar]
- Chen, L.; Chai, Y.; Wu, R.; Ma, T.; Zhai, H. Dynamic analysis of a class of fractional-order neural networks with delay. Neurocomputing 2013, 111, 190–194. [Google Scholar] [CrossRef] [Scilit]
- Liu, H.; Li, S.; Wang, H.; Huo, Y.; Luo, J. Adaptive synchronization for a class of uncertain fractional-order neural networks. Entropy 2015, 17, 7185–7200. [Google Scholar] [CrossRef] [Scilit]
- Xi, Y.; Yu, Y.; Zhang, S.; Hai, X. Finite-time robust control of uncertain fractional-order Hopfield neural networks via sliding mode control. Chin. Phys. B 2018, 27, 010202. [Google Scholar] [CrossRef] [Scilit]
- Zhang, S.; Yu, Y.; Yu, J. LMI conditions for global stability of fractional-order neural networks. IEEE Trans. Neural Netw. Learn. Syst. 2016, 28, 2423–2433. [Google Scholar] [CrossRef] [Scilit]
- Roohi, M.; Zhang, C.; Chen, Y. Adaptive model-free synchronization of different fractional-order neural networks with an application in cryptography. Nonlinear Dyn. 2020, 100, 3979–4001. [Google Scholar] [CrossRef] [Scilit]
- Chen, L.; Chai, Y.; Wu, R.; Yang, J. Stability and stabilization of a class of nonlinear fractional-order systems with Caputo derivative. IEEE Trans. Circuits Syst. II 2012, 59, 602–606. [Google Scholar] [CrossRef] [Scilit]
- Ahn, H.S.; Chen, Y. Necessary and sufficient stability condition of fractional-order interval linear systems. Automatica 2008, 44, 2985–2988. [Google Scholar] [CrossRef] [Scilit]
- Farges, C.; Moze, M.; Sabatier, J. Pseudo state feedback stabilization of commensurate fractional order systems. In Proceedings of the 2009 European Control Conference (ECC), Budapest, Hungary, 23–26 August 2009; pp. 3395–3400. [Google Scholar] [CrossRef] [Scilit]
- Utkin, V.I. Sliding mode control in discrete-time and difference systems. Var. Struct. Lyapunov Control 1994, 193, 87–107. [Google Scholar] [CrossRef] [Scilit]
- Slotine, J.J.; Li, W. Adaptive strategies in constrained manipulation. In Proceedings of the 1987 IEEE International Conference on Robotics and Automation, Raleigh, NC, USA, 31 March–3 April 1987; pp. 595–601. [Google Scholar] [CrossRef] [Scilit]
- Ouannas, A.; Khenaoui, A.A.; Almatroud, A.O.; Gasri, A.; Al-Sawalha, M.M.; Jahanshahi, H. Coexisting Behaviors of Asymmetric Attractors in New Fractional Discrete-Time Neural Network with Variable Order and Short Memory Effect: Chaos, Complexity and Multistability. in press.
- Kaslik, E.; Racdulescu, I.R. Dynamics of complex-valued fractional-order neural networks. Neural Netw. 2017, 89, 39–49. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Abbes, A.; Ouannas, A.; Shawagfeh, N.; Khennaoui, A.A. Incommensurate Fractional Discrete Neural Network: Chaos and complexity. Eur. Phys. J. Plus 2022, 137, 235. [Google Scholar] [CrossRef] [Scilit]
- Kaslik, E.; Sivasundaram, S. Nonlinear dynamics and chaos in fractional-order neural networks. Neural Netw. 2012, 32, 245–256. [Google Scholar] [CrossRef] [Scilit]
- Chen, F.; Luo, X.; Zhou, Y. Existence results for nonlinear fractional difference equation. Adv. Differ. Equation 2011, 2011, 713201. [Google Scholar] [CrossRef] [Scilit]
- Wu, G.C.; Baleanu, D. Jacobian matrix algorithm for Lyapunov exponents of the discrete fractional maps. Commun. Nonlinear Sci. Numer. Simul. 2015, 22, 95–100. [Google Scholar] [CrossRef] [Scilit]
- Tavazoei, M.S.; Haeri, M. A proof for non existence of periodic solutions in time invariant fractional order systems. Automatica 2009, 45, 1886–1890. [Google Scholar] [CrossRef] [Scilit]
- Tavazoei, M.S. A note on fractional-order derivatives of periodic functions. Automatica 2010, 46, 945–948. [Google Scholar] [CrossRef] [Scilit]
- Zhang, X. Relationship Between Integer Order Systems and Fractional Order Systems and Its Two Applications. IEEE/CAA J. Autom. Sin. 2018, 5, 639–643. [Google Scholar] [CrossRef] [Scilit]
- Ran, J. Discrete chaos in a novel two-dimensional fractional chaotic map. Adv. Differ. Equation 2018, 2018, 294. [Google Scholar] [CrossRef] [Scilit]
- Gottwald, G.A.; Melbourne, I. A new test for chaos in deterministic systems. Proc. Math. Phys. Eng. Sci. 2004, 460, 603–611. [Google Scholar] [CrossRef] [Scilit]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).






