Stability Analysis of Cohen–Grossberg Neural Networks with Random Impulses

Abstract

The Cohen and Grossberg neural networks model is studied in the case when the neurons are subject to a certain impulsive state displacement at random exponentially-distributed moments. These types of impulses significantly change the behavior of the solutions from a deterministic one to a stochastic process. We examine the stability of the equilibrium of the model. Some sufficient conditions for the mean-square exponential stability and mean exponential stability of the equilibrium of general neural networks are obtained in the case of the time-varying potential (or voltage) of the cells, with time-dependent amplification functions and behaved functions, as well as time-varying strengths of connectivity between cells and variable external bias or input from outside the network to the units. These sufficient conditions are explicitly expressed in terms of the parameters of the system, and hence, they are easily verifiable. The theory relies on a modification of the direct Lyapunov method. We illustrate our theory on a particular nonlinear neural network.

1. Introduction

Artificial neural networks are important technical tools for solving a variety of problems in various scientific disciplines. Cohen and Grossberg [1] introduced and studied in 1983 a new model of neural networks. This model was extensively studied and applied in many different fields such as associative memory, signal processing and optimization problems. Several authors generalized this model [2] by including delays [3,4], impulses at fixed points [5,6] and discontinuous activation functions [7]. Furthermore, a stochastic generalization of this model was studied in [8]. The included impulses model the presence of the noise in artificial neural networks. Note that in some cases in the artificial neural network, the chaos improves the noise (see, for example, [9]).

To the best of our knowledge, there is only one published paper studying neural networks with impulses at random times [10]. However, in [10], random variables are incorrectly mixed with deterministic variables; for example $I_{[{\xi }_k,{\xi }_{k+1})}\left(t\right)$ for the random variables ${\xi }_k,{\xi }_{k+1}$ is not a deterministic index function (it is a stochastic process), and it has an expected value labeled by E, which has to be taken into account on page 13 of [10]; in addition, in [10], one has to be careful since the expected value of a product of random variables is equal to the product of expected values only for independent random variables. We define the generalization of Cohen and Grossberg neural network with impulses at random times, briefly giving an explanation of the solutions being stochastic processes, and we study stability properties. Note that a brief overview of randomness in neural networks and some methods for their investigations are given in [11] where the models are stochastic ones. Impulsive perturbation is a common phenomenon in real-world systems, so it is also important to consider impulsive systems. Note that the stability of deterministic models with impulses for neural networks was studied in [12,13,14,15,16,17,18]. However, the occurrence of impulses at random times needs to be considered in real-world systems. The stability problem for the differential equation with impulses at random times was studied in [19,20,21]. In this paper, we study the general case of the time-varying potential (or voltage) of the cells, with the time-dependent amplification functions and behaved functions, as well as time-varying strengths of connectivity between cells and variable external bias or input from outside the network to the units. The study is based on an application of the Lyapunov method. Using Lyapunov functions, some stability sufficient criteria are provided and illustrated with examples.

2. System Description

We consider the model proposed by Cohen and Grossberg [1] in the case when the neurons are subject to a certain impulsive state displacement at random moments.

Let $T_0\ge 0$ be a fixed point and the probability space ($\mathsf{\Omega },\mathcal{F},P$) be given. Let a sequence of independent exponentially-distributed random variables ${\left\{{\tau }_k\right\}}_{k=1}^{\infty }$ with the same parameter $\lambda >0$ defined on the sample space $\mathsf{\Omega }$ be given. Define the sequence of random variables ${\left\{{\xi }_k\right\}}_{k=0}^{\infty }$ by:

$${\xi }_k=T_0+\sum _{i=1}^k{\tau }_i,k=0,1,2,\dots .$$

(1)

The random variable ${\tau }_k$ measures the waiting time of the k-th impulse after the $(k-1)$-th impulse occurs, and the random variable ${\xi }_k$ denotes the length of time until k impulses occur for $t\ge T_0$.

Remark 1.

The random variable $\mathsf{\Xi }={\sum }_{i=1}^k{\tau }_i$ is Erlang distributed, and it has a pdf $f_{\mathsf{\Xi }}\left(t\right)=\lambda e^{-\lambda t}\frac{{\left(\lambda t\right)}^{k-1}}{(k-1)!}$ and a cdf $F\left(t\right)=P(\mathsf{\Xi }<t)=1-e^{-\lambda t}{\sum }_{j=0}^{k-1}\frac{{\left(\lambda t\right)}^j}{j!}$.

Consider the general model of the Cohen–Grossberg neural networks with impulses occurring at random times (RINN):

$$\begin{array}{c}{x}_i^{\prime }\left(t\right)=-a_i\left(x_i\left(t\right)\right)\left(b\left(x_i\left(t\right)\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)f_j\left(x_j\left(t\right)\right)+I_i\left(t\right)\right)\hfill \\ \mathrm{for}t\ge T_0,{\xi }_k<t<{\xi }_{k+1},k=0,1,\dots ,i=1,2,\dots n,\hfill \\ x_i({\xi }_k+0)={\mathsf{\Phi }}_{k,i}\left(x_i({\xi }_k-0)\right)\mathrm{for}k=1,2,\dots ,\hfill \\ x_i\left(T_0\right)=x_i^0,\hfill \end{array}$$

(2)

where n corresponds to the number of units in a neural network; $x_i\left(t\right)$ denotes the potential (or voltage) of cell i at time t, $x\left(t\right)=(x_1\left(t\right),x_2\left(t\right),\dots ,x_n\left(t\right))\in {\mathbb{R}}^n$, $f_j\left(x_j\left(t\right)\right)$ denotes the activation functions of the neurons at time t and represents the response of the j-th neuron to its membrane potential and $f\left(x\right)=(f_1\left(x_1\right),f_2\left(x_2\right),\dots ,f_n\left(x_n\right))$. Now, $a_i(.)>0$ represents an amplification function; $b_i(.)$ represents an appropriately behaved function; the $n\times n$ connection matrix $C\left(t\right)=\left(c_{ij}\left(t\right)\right)$ denotes the strengths of connectivity between cells at time t; and if the output from neuron j excites (resp., inhibits) neuron i, then $c_{ij}\left(t\right)\ge 0$ (resp., $c_{ij}\left(t\right)\le 0$), and the functions $I_i\left(t\right)$, $I\left(t\right)=(I_1\left(t\right),I_2\left(t\right),\dots ,I_n\left(t\right))\in {\mathbb{R}}^n$ correspond to the external bias or input from outside the network to the unit i at time t.

We list some assumptions, which will be used in the main results:

(H1) For all $i=1,2,\dots ,n$, the functions $a_i\in C(\mathbb{R},(0,\infty ))$, and there exist constants $A_i,B_i>0$ such that $0<A_i\le a_i\left(u\right)\le B_i$ for $u\in \mathbb{R}$.

(H2) There exist positive numbers $M_{i,j},i,j=1,2,\dots ,n$ such that $|c_{i,j}\left(t\right)|\le M_{i,j}$ for $t\ge 0$.

Remark 2.

In the case when the strengths of connectivity between cells are constants, then Assumption (H2) is satisfied.

For the activation functions, we assume:

(H3) The neuron activation functions are Lipschitz, i.e., there exist positive numbers $L_i,i=1,2,\dots ,n,$ such that $|f_i\left(u\right)-f_i\left(v\right)|\le L_i|u-v|$ for $u,v\in \mathbb{R}$.

Remark 3.

Note that the activation functions satisfying Condition (H3) are more general than the usual sigmoid activation functions.

2.1. Description of the Solutions of Model (2)

Consider the sequence of points ${\left\{t_k\right\}}_{k=1}^{\infty }$ where the point $t_k$ is an arbitrary value of the corresponding random variable ${\tau }_k,k=1,2,\dots$. Define the increasing sequence of points ${\left\{T_k\right\}}_{k=1}^{\infty }$ by:

$$T_k=T_0+\sum _{i=1}^k{t}_k.$$

(3)

Note that $T_k$ are values of the random variables ${\xi }_k,k=1,2,\dots$.

Consider the corresponding RINN (2) initial value problem for the system of differential equations with fixed points of impulses ${\left\{T_k\right\}}_{k=1}^{\infty }$ (INN):

$$\begin{array}{c}{x}_i^{\prime }\left(t\right)=-a_i\left(x_i\left(t\right)\right)\left(b\left(x_i\left(t\right)\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)f_j\left(x_j\left(t\right)\right)+I_i\left(t\right)\right)\hfill \\ \mathrm{for}t\ge T_0,t\ne T_k,k=0,1,\dots ,i=1,2,\dots n,\hfill \\ x_i(T_k+0)={\mathsf{\Phi }}_{k,i}\left(x_i(T_k-0)\right)\mathrm{for}k=1,2,\dots ,\hfill \\ x_i\left(T_0\right)=x_i^0.\hfill \end{array}$$

(4)

The solution of the differential equation with fixed moments of impulses (4) depends not only on the initial point $(T_0,x^0)$, but on the moments of impulses $T_k,k=1,2,\dots$, i.e., the solution depends on the chosen arbitrary values $t_k$ of the random variables ${\tau }_k,k=1,2,\dots$. We denote the solution of the initial value problem (4) by $x(t;T_0,x^0,\left\{T_k\right\})$. We will assume that:

$$x(T_k;T_0,x^0,\left\{T_k\right\})=\underset{t\to T_k-0}{\lim }x(t;T_0,x^0,\left\{T_k\right\})\mathrm{for} \mathrm{any}k=1,2,\dots .$$

(5)

Remark 4.

Note that the limit (5) is well defined since $T_k,k=1,2\dots ,$ are points from $\mathbb{R}$. This is different than ${\lim }_{t\to {\xi }_k-0}x\left(t\right)$ because ${\xi }_k$ is a random variable (see its incorrect use by the authors in [10]).

The set of all solutions $x(t;T_0,x^0,\left\{T_k\right\})$ of the initial value problem for the impulsive fractional differential Equation (4) for any values $t_k$ of the random variables ${\tau }_k,k=1,2,\dots$ generates a stochastic process with state space ${\mathbb{R}}^n$. We denote it by $x(t;T_0,x^0,\left\{{\tau }_k\right\})$, and we will say that it is a solution of RINN (2).

Remark 5.

Note that $x(t;T_0,x^0,\left\{T_k\right\})$ is a deterministic function, but $x(t;T_0,x^0,\left\{{\tau }_k\right\})$ is a stochastic process.

Definition 1.

For any given values $t_k$ of the random variables ${\tau }_k$, $k=1,2,3,\dots$, respectively, the solution $x(t;T_0,x^0,\left\{T_k\right\})$ of the corresponding initial value problem (IVP) for the INN (4) is called a sample path solution of the IVP for RINN (2).

Definition 2.

A stochastic process $x(t;T_0,x^0,\left\{{\tau }_k\right\})$ with an uncountable state space ${\mathbb{R}}^n$ is said to be a solution of the IVP for the system of RINN (2) if for any values $t_k$ of the random variables ${\tau }_k,k=1,2,\dots$, the corresponding function $x(t;T_0,x^0,\left\{T_k\right\})$ is a sample path solution of the IVP for RINN (2).

2.2. Equilibrium of Model (2)

We define an equilibrium of the model (2) assuming Condition (H1) is satisfied:

Definition 3.

A vector $x^{\ast }\in {\mathbb{R}}^n,x^{\ast }=(x_1^{\ast },x_2^{\ast },\dots ,x_n^{\ast })$ is an equilibrium point of RINN (2), if the equalities:

$$0=b\left(x_i^{\ast }\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)f_j\left(x_i^{\ast }\right)+I_i\left(t\right)fori=1,2,\dots ,n$$

(6)

and

$$x_i^{\ast }={\mathsf{\Phi }}_{k,i}\left(x_i^{\ast }\right)fort\ge 0,k=1,2,\dots ,i=1,2,\dots ,n$$

(7)

hold.

We assume the following:

(H4) Let RINN (2) have an equilibrium vector $x^{\ast }\in {\mathbb{R}}^n$.

If Assumption (H4) is satisfied, then we can shift the equilibrium point $x^{\ast }$ of System (2) to the origin. The transformation $y\left(t\right)=x\left(t\right)-x^{\ast }$ is used to put System (2) in the following form:

$$\begin{array}{c}{y}_i^{\prime }\left(t\right)=-p_i\left(y_i\left(t\right)\right)\left(q\left(y_i\left(t\right)\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)F_j\left(y_j\left(t\right)\right)\right)\hfill \\ \mathrm{for}t\ge T_0,{\xi }_k<t<{\xi }_{k+1},k=0,1,\dots ,i=1,2,\dots n,\hfill \\ y_i({\xi }_k+0)={\varphi }_{k,i}\left(y({\xi }_k-0)\right)\mathrm{for}k=1,2,\dots ,\hfill \\ y_i\left(T_0\right)=y_i^0,\hfill \end{array}$$

(8)

where $p_i\left(u\right)=a_i(u+x_i^{\ast })$, $q_i\left(u\right)=b_i(u+x_i^{\ast })-b_i\left(x_i^{\ast }\right)$, $F_j\left(u\right)=f_j(u+x_j^{\ast })-f_j(x_j^{\ast }),j=1,2,\dots ,n$ and ${\varphi }_{k,i}\left(u\right)={\mathsf{\Phi }}_{k,i}(u+x_i^{\ast })-{\mathsf{\Phi }}_{k,i}\left(x_i^{\ast }\right),i=1,2,\dots ,n,k=1,2,\dots ,$ $y_i^0=x_i^0-x_i^{\ast }$.

Remark 6.

If Assumption (H3) is fulfilled, then the function F in RINN (8) satisfies $|F_j\left(u\right)|\le L_j\left|u\right|,j=1,2,\dots ,n,$ for $u\in \mathbb{R}$.

Note that if the point $x^{\ast }\in {\mathbb{R}}^n$ is an equilibrium of RINN (2), then the point $y^{\ast }=0$ is an equilibrium of RINN (8). This allows us to study the stability properties of the zero equilibrium of RINN (8).

3. Some Stability Results for Differential Equations with Impulses at Random Times

Consider the general type of initial value problem (IVP) for a system of nonlinear random impulsive differential equations (RIDE):

$$\begin{array}{c}{x}^{\prime }\left(t\right)=g(t,x\left(t\right))\mathrm{for}t\ge T_0,{\xi }_k<t<{\xi }_{k+1},\hfill \\ x({\xi }_k+0)={\mathsf{\Psi }}_k\left(x({\xi }_k-0)\right)\mathrm{for}k=1,2,\dots ,\hfill \\ x\left(T_0\right)=x^0;\hfill \end{array}$$

(9)

with $x^0\in {\mathbb{R}}^n$, random variables ${\xi }_k,k=1,2,\dots$ are defined by (1), $g\in C([T_0,\infty )\times {\mathbb{R}}^n,{\mathbb{R}}^n)$ and ${\mathsf{\Psi }}_k:{\mathbb{R}}^n\to {\mathbb{R}}^n$.

Definition 4.

Let $p>0$. Then, the trivial solution ($x^0=0$) of RIDE (9) is said to be p-moment exponentially stable if for any initial point $(T_0,y^0)\in {\mathbb{R}}_{+}\times {\mathbb{R}}^n$, there exist constants $\alpha ,\mu >0$ such that $E[\parallel y(t;T_0,y^0,\left\{{\tau }_k\right)\}{)\parallel }^p]<\alpha \parallel y^0{\parallel }^p{e}^{-\mu (t-T_0)}$ for all $t>T_0$, where $y(t;T_0,x^0,\left\{{\tau }_k\right)\}$ is the solution of the IVP for RIDE (9).

Definition 5.

Let $p>0$. Then, the equilibrium $x^{\ast }$ of RINN (2) is said to be p-moment exponentially stable if for any initial point $(T_0,x^0)\in {\mathbb{R}}_{+}\times {\mathbb{R}}^n$, there exist constants $\alpha ,\mu >0$ such that $E[\parallel x(t;T_0,x^0,\left\{{\tau }_k\right)\})-x^{\ast }{\parallel }^p]<\alpha \parallel x^0-x^{\ast }{\parallel }^p{e}^{-\mu (t-T_0)}$ for all $t>T_0$, where $x(t;T_0,x^0,\left\{{\tau }_k\right)\}$ is the solution of the IVP for RINN (2).

Remark 7.

We note that the two-moment exponential stability for stochastic equations is known as the mean square exponential stability, and in the case of $p=1$, it is called mean exponential stability.

Note that the p-moment exponential stability of RIDE (9) was studied in [20] by an application of Lyapunov functions from the class $\mathsf{\Lambda }(J,\Delta )$, $J\subset {\mathbb{R}}_{+}$, $\Delta \subset {\mathbb{R}}^n,0\in \Delta$ with:

$$\begin{array}{cc}\hfill \mathsf{\Lambda }(J,\Delta )& =\{V(t,x)\in C(J\times \Delta ,{\mathbb{R}}_{+}):V(t,0)\equiv 0,\hfill \\ \hfill & V(t,x)\mathrm{is} \mathrm{locally} \mathrm{Lipschitzian} \mathrm{with} \mathrm{respect} \mathrm{to} \mathrm{x}\}.\hfill \end{array}$$

We will use the Dini derivative of the Lyapunov function $V(t,x)\in \mathsf{\Lambda }(J,\Delta )$ given by:

$$\begin{array}{c}{}_{\left(9\right)}{D}_{+}V(t,x)=\underset{h\to 0^{+}}{\lim \sup }\frac{1}{h}\left\{V(t,x)-V(t-h,x-hg(t,x\left)\right)\right\}\hfill \\ \mathrm{for}t\in J,x\in \Delta .\hfill \end{array}$$

(10)

Now, we will give a sufficient condition result:

Theorem 1 

([20]). Let the following conditions be satisfied:

1. 

For $t\ge 0:$ $g(t,0)\equiv 0$ and ${\mathsf{\Psi }}_k\left(0\right)=0,k=1,2,\dots$ and for any initial values $(T_0,x^0)$, the corresponding IVP for the ordinary differential equation $x^{\prime }\left(t\right)=g(t,x\left(t\right))$ has a unique solution.

2. 

The function $V\in \mathsf{\Lambda }([T_0,\infty ),{\mathbb{R}}^n)$, and there exist positive constants $a,b$ such that:

(i) 

${a\parallel x\parallel }^p\le V(t,x)\le {b\parallel x\parallel }^p$ for $t\ge T_0,x\in {\mathbb{R}}^n;$

(ii) 

there exists a function $m\in C({\mathbb{R}}_{+},{\mathbb{R}}_{+}):{\inf }_{t\ge 0}m\left(t\right)=L\ge 0$, and the inequality:

$${}_{\left(9\right)}{D}_{+}V(t,x)\le -m\left(t\right)V(t,x),fort\ge 0,x\in {\mathbb{R}}^n$$

holds;

(iii) 

for any $k=1,2,\dots$, there exist constants $w_k:0\le w_k<1+\frac{L}{\lambda }$ for $t\ge 0$ such that:

$$V(t,I_k(t,x))\le w_{k}V(t,x)fort\ge 0,x\in {\mathbb{R}}^n.$$

(11)

Then, the trivial solution of RIDE (9) is p-moment exponentially stable.

4. Stability Analysis of Neural Networks with Random Impulses

We will introduce the following assumptions:

(H5) For $i=1,2,\dots ,n$, the functions $b_i\in C(\mathbb{R},\mathbb{R})$, and there exist constants ${\beta }_i>0$ such that $u\left(b_i(u+x_i^{\ast })-b_i\left(x_i^{\ast }\right)\right)\ge {\beta }_i{u}^2$ for any $u\in \mathbb{R}$ where $x^{\ast }\in {\mathbb{R}}^n,x^{\ast }=(x_1^{\ast },x_2^{\ast },\dots ,x_n^{\ast }),$ is the equilibrium from Condition (H4).

Remark 8.

If Condition (H5) is satisfied, then the inequality $uq\left(u\right)\ge {\beta }_i{u}^2,u\in \mathbb{R}$ holds for RINN (8).

(H6) The inequality:

$$\begin{array}{cc}\hfill \nu =& 2\underset{i=\overline{1,n}}{\min }{A}_i{\beta }_i-\underset{i=\overline{1,n}}{\max }{B}_i\left(\underset{i=\overline{1,n}}{\max }\sum _{j=1}^n{M}_{ij}{L}_j+(\sum _{i=1}^n\underset{j=\overline{1,n}}{\max }{M}_{ij}{L}_j)\right)>0\hfill \end{array}$$

(12)

holds.

(H7) For any $k=1,2,\dots$, there exists positive number $K_k<1+\frac{\nu }{\lambda }$ such that the inequalities:

$$\sum _{i=1}^n{\left({\mathsf{\Phi }}_{k,i}\left(x_i\right)-{\mathsf{\Phi }}_{k,i}\left(x_i^{\ast }\right)\right)}^2\le K_k\sum _{i=1}^n{(x_i-x_i^{\ast })}^2,x_i\in \mathbb{R},i=1,2,\dots ,n,$$

hold where $x^{\ast }\in {\mathbb{R}}^n,x^{\ast }=(x_1^{\ast },x_2^{\ast },\dots ,x_n^{\ast }),$ is the equilibrium from Condition (H4).

Remark 9.

If Assumption (H7) is fulfilled, then the impulsive functions ${\varphi }_k,k=1,2,\dots$ in RINN (8) satisfy the inequalities ${\sum }_{i=1}^n{\varphi }_{k,i}^2\left(u_i\right)\le K_k{\sum }_{i=1}^n{u}_i^2$.

Theorem 2.

Let Assumptions (H1)–(H7) be satisfied. Then, the equilibrium point $x^{\ast }$ of RINN (2) is mean square exponentially stable.

Proof. 

Consider the quadratic Lyapunov function $V(t,x)=x^{T}x$, $x\in {\mathbb{R}}^n$. From Remarks 6, 8 and inequality $2\left|uv\right|\le u^2+v^2$, we get:

$$\begin{array}{c}{}_{\left(8\right)}{D}_{+}V(t,y)\le 2\sum _{i=1}^n{y}_i\left(-p_i\left(y_i\right)(q\left(y_i\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)F_j\left(y_j\right))\right)\hfill \\ =-2\sum _{i=1}^n{y}_i{p}_i\left(y_i\right)q\left(y_i\right)+2\sum _{i=1}^n{y}_i{p}_i\left(y_i\right)\sum _{j=1}^n{c}_{ij}\left(t\right)F_j\left(y_j\right)\hfill \\ \le -2\sum _{i=1}^n{A}_i{\beta }_i{y}_i^2+2\sum _{i=1}^n|y_i|B_i\sum _{j=1}^n{M}_{ij}{L}_j\left|y_j\right|\hfill \\ \le -2\sum _{i=1}^n{A}_i{\beta }_i{y}_i^2+\sum _{i=1}^n{B}_i\sum _{j=1}^n{M}_{ij}{L}_j(y_i^2+y_j^2)\hfill \\ \le -2\sum _{i=1}^n{A}_i{\beta }_i{y}_i^2+\sum _{i=1}^n{B}_i{y}_i^2\sum _{j=1}^n{M}_{ij}{L}_j+\sum _{i=1}^n{B}_i\sum _{j=1}^n{M}_{ij}{L}_j{y}_j^2\hfill \\ \le -2\underset{i=\overline{1,n}}{\min }{A}_i{\beta }_i\sum _{i=1}^n{y}_i^2\hfill \\ +\underset{i=\overline{1,n}}{\max }{B}_i\left(\underset{i=\overline{1,n}}{\max }\sum _{j=1}^n{M}_{ij}{L}_j+(\sum _{i=1}^n\underset{j=\overline{1,n}}{\max }{M}_{ij}{L}_j)\right)\sum _{i=1}^n{y}_i^2\hfill \\ =-\nu \sum _{i=1}^n{y}_i^2.\hfill \end{array}$$

(13)

where the positive constant $\nu$ is defined by (12). Therefore, Condition 2(ii) of Theorem 1 is satisfied. Furthermore, from (H7), it follows that Condition 2(iii) of Theorem 1 is satisfied.

From Theorem 1, the zero solution of the system (9) is mean square exponentially stable, and therefore, the equilibrium point $x^{\ast }$ of RINN (2) is mean square exponentially stable. ☐

Example 1.

Let $n=3$, $t_0=0.1,$ and the random variables ${\tau }_k,k=1,2,\dots$ are exponentially distributed with $\lambda =1$. Consider the following special case of RINN (2):

$$\begin{array}{c}{x}_i^{\prime }\left(t\right)=-a_i\left(x_i\left(t\right)\right)\left(2x_i\left(t\right)+\sum _{j=1}^3{c}_{ij}\left(t\right)f_j\left(x_j\left(t\right)\right)-\pi \right)\hfill \\ fort\ge 0{\xi }_k<t<{\xi }_{k+1},i=1,2,3,\hfill \\ x_i({\xi }_k+0)={\mathsf{\Phi }}_{k,i}\left(x_i({\xi }_k-0)\right)fork=1,2,\dots ,\hfill \\ x_i\left(0.1\right)=x_i^0,\hfill \end{array}$$

(14)

with $a_i\left(u\right)=2+\frac{\left|u\right|}{1+\left|u\right|}\in [2,3),i=1,2,3$, $f_i\left(u\right)={\alpha }_i\cos \left(u\right),{\alpha }_1=0.1,{\alpha }_2=0.01,{\alpha }_2=2$, ${\mathsf{\Phi }}_{k,i}\left(u\right)=u\sin k+(1-\sin k)0.5\pi$, and $C=c_{ij}\left(t\right)$ is given by:

$$C\left(t\right)=\left(\begin{array}{ccc}-0.1\sin t& 0.4& 0.3\\ -\frac{t^2}{5t^2+1}& 0.3& \frac{t}{5t+1}\\ \frac{t}{10t+1}& -0.2\cos t& -0.1\sin t\end{array}\right).$$

(15)

The point $x^{\ast }=(0.5\pi ,0.5\pi ,0.5\pi )$ is the equilibrium point of RINN (14), i.e., Condition (H4) is satisfied. Now, Assumption (H1) is satisfied with $A_i=2,B_i=3,i=1,2,3$. In addition, Assumption (H5) is satisfied with ${\beta }_i=2,i=1,2,3$.

Furthermore, $|c_{ij}|\le M_{ij},i,j=1,2,3,t\ge 0$ where $M=\left\{M_{ij}\right\},$ is given by:

$$M=\left(\begin{array}{ccc}0.1& 0.4& 0.3\\ 0.2& 0.3& 0.2\\ 0.1& 0.2& 0.1\end{array}\right).$$

(16)

Therefore, Assumption (H2) is satisfied. Note that Assumption (H3) is satisfied with Lipschitz constants $L_1=0.1,L_2=0.01,L_3=2$.

Then, the constant $\nu$ defined by (12) is $\nu =8-3\left(1.814\right)=2.558>0$. Next, Assumption (H7) is fulfilled with $K_k=1$ because:

$$\begin{array}{c}\sum _{i=1}^3{\left({\mathsf{\Phi }}_{k,i}\left(x_i\right)-{\mathsf{\Phi }}_{k,i}\left(x_i^{\ast }\right)\right)}^2=\sum _{i=1}^3{\left(x_i\sin k+(1-\sin k)0.5\pi -0.5\pi \right)}^2\hfill \\ =\sum _{i=1}^3{\left((x_i-0.5\pi )\sin k\right)}^2\le \sum _{i=1}^3{\left(x_i-0.5\pi \right)}^2,k=1,2,\dots .\hfill \end{array}$$

(17)

Therefore, according to Theorem 1, the equilibrium of RINN (14) is mean square exponentially stable.

Consider the system (14) without any kind of impulses. The equilibrium $x^{\ast }=(0.5\pi ,0.5\pi ,0.5\pi )$ is asymptotically stable (see Figure 1 and Figure 2). Therefore, an appropriate perturbation of the neural networks by impulses at random times can keep the stability properties of the equilibrium.

Figure 1. Example 1. Graph of the solution of the system ODE corresponding to (14) with $x_1^0=1,x_2^0=2,x_3^0=1.4$.

Figure 2. Example 1. Graph of the solution of the system ODE corresponding to (14) with $x_1^0=-0.1,x_2^0=0.2,x_3^0=-0.4$.

Remark 10.

Note that Condition (H7) is weaker than Condition (3.6) in Theorem 3.2 [16], and as a special case of Theorem 2, we obtain weaker conditions for exponential stability of the Cohen and Grossberg model without any type of impulses. For example, if we consider (14) according to Condition (3.6) [16], the inequality $\delta ={2\parallel M\parallel }_2\frac{3}{4}=1.0374<1$ is not satisfied, and Theorem 3.2 [16] does not give us any result about stability (compare with Example 1).

Now, consider the following assumption:

(H8) The inequality:

$$\begin{array}{c}\hfill \nu =\underset{i=\overline{1,n}}{\min }{\gamma }_i-\sum _{i=1}^n\underset{j=\overline{1,n}}{\max }{M}_{ij}>0\end{array}$$

(18)

holds.

Theorem 3.

Let Assumptions (H1)–(H5), (H7) and (H8) be satisfied. Then, the equilibrium point $x^{\ast }$ of RINN (2) is mean exponentially stable.

Proof. 

For any $u\in {\mathbb{R}}^n$, we define $V\left(u\right)={\sum }_{i=1}^n{\int }_0^{u_i}\frac{sign\left(s\right)}{a_i\left(s\right)}ds$. Then:

$$V\left(u\right)\le \sum _{i=1}^n{\int }_0^{u_i}\frac{sign\left(s\right)}{A_i}ds=\sum _{i=1}^n\frac{1}{A_i}|u_i|\le A\parallel u\parallel$$

and:

$$V\left(u\right)\ge \sum _{i=1}^n{\int }_0^{u_i}\frac{sign\left(s\right)}{B_i}ds=\sum _{i=1}^n\frac{1}{B_i}|u_i|\ge B\parallel u\parallel$$

where $A={\max }_{i=\overline{1,n}}\frac{1}{A_i}$, $B={\min }_{i=\overline{1,n}}\frac{1}{B_i}$.

Then, for $t\ge 0$ and $y\in {\mathbb{R}}^n$ according to Remarks 6 and 8, we obtain:

$$\begin{array}{c}{}_{\left(8\right)}{D}_{+}V\left(y\right)\le \sum _{i=1}^n-sgn\left(y_i\right)\left(q\left(y_i\right)-\sum _{j=1}^n{c}_{ij}\left(t\right)F_j\left(y_j\right)\right)\hfill \\ \le \sum _{i=1}^n\left(-{\beta }_i|y_i|+\sum _{j=1}^n{M}_{ij}|F_j\left(y_j\right)|\right)\le \sum _{i=1}^n\left(-{\beta }_i|y_i|+\sum _{j=1}^n{M}_{ij}\left|y_j\right|\right)\hfill \\ =-\sum _{i=1}^n{\beta }_i|y_i|+\sum _{i=1}^n\sum _{j=1}^n{M}_{ij}|y_j|\le -\underset{i=\overline{1,n}}{\min }{\beta }_i\sum _{i=1}^n|y_i|+\left(\sum _{i=1}^n\underset{j=\overline{1,n}}{\max }{M}_{ij}\right)\sum _{j=1}^n\left|y_j\right|\hfill \\ \le -\nu \sum _{i=1}^n\left|y_i\right|\le -\frac{\nu }{B}V\left(u\right).\hfill \end{array}$$

(19)

Furthermore, from (H7) and Remark 9, it follows that Condition 2(iii) of Theorem 1 is satisfied. From Theorem 1, we have that Theorem 3 is true. ☐

Example 2.

Let $n=3$, $t_0=0.1$, and the random variables ${\tau }_k,k=1,2,\dots$ are exponentially distributed with $\lambda =1$. Consider the following special case of RINN (2):

$$\begin{array}{c}{x}_i^{\prime }\left(t\right)=-a_i\left(x_i\left(t\right)\right)\left(2x_i\left(t\right)+\sum _{j=1}^3{c}_{ij}\left(t\right)f_j\left(x_j\left(t\right)\right)-1\right)\hfill \\ fort\ge 0{\xi }_k<t<{\xi }_{k+1},i=1,2,3\hfill \\ x_i({\xi }_k+0)={\mathsf{\Phi }}_{k,i}\left(x_i({\xi }_k-0)\right)fork=1,2,\dots \hfill \\ x_i\left(0.1\right)=x_i^0,\hfill \end{array}$$

(20)

with $a_i\left(u\right)=2+\frac{\left|u\right|}{1+\left|u\right|}\in [2,3),i=1,2,3$, $f_i\left(u\right)=log\left(\frac{u}{1-u}\right)$, ${\mathsf{\Phi }}_{k,i}\left(u\right)=u\sin k+(1-\sin k)0.5$, and $C=c_{ij}\left(t\right)$ is given by (15).

The point $x^{\ast }=(0.5,0.5,0.5)$ is the equilibrium point of RINN (20), i.e., Condition (H4) is satisfied. Now, Assumption (H5) is satisfied with ${\beta }_i=2,i=1,2,3$.

Furthermore, $|c_{ij}|\le M_{ij},i,j=1,2,3,t\ge 0$ where $M=\left\{M_{ij}\right\},$ is given by (16). Therefore, Assumption (H2) is satisfied. Then, the inequality ${\min }_{i=\overline{1,n}}{\beta }_i=2>{\sum }_{i=1}^3{\max }_{j=\overline{1,3}}{M}_{ij}=0.4+0.3+0.2=0.9$ holds.

According to Theorem 3, the equilibrium of (20) is mean exponentially stable.

Consider the system (20) without any kind of impulses. The equilibrium $x^{\ast }=(0.5,0.5,0.5)$ is asymptotically stable (see Figure 3 and Figure 4). Therefore, an appropriate perturbation of the neural networks by impulses at random times can keep the stability properties of the equilibrium.

Figure 3. Example 2. Graph of the solution of the system ODE corresponding to (20) with $x_1^0=0.55,x_2^0=0.8,x_3^0=0.1$.

Figure 4. Example 2. Graph of the solution of the system ODE corresponding to (20) with $x_1^0=0.4,x_2^0=0.3,x_3^0=0.1$.

5. Conclusions

In this paper, we study stability properties of the equilibrium point of a generalization of the Cohen–Grossberg model of neural networks in the case when:

-

the potential (or voltage) of any cell is perturbed instantaneously at random moments, i.e., the neural network is modeled by a deterministic differential equation with impulses at random times. This presence of randomness in the differential equation totally changes the behavior of the solutions (they are not deterministic functions, but stochastic processes).

-

the random moments of the impulsive state displacements of neurons are exponentially distributed.

-

the connection matrix $C=\left(c_{ij}\right)$ is not a constant matrix which is usually the case in the literature (it is a matrix depending on time since the strengths of connectivity between cells could be changed in time).

-

the external bias or input from outside the network to any unit is not a constant (it is variable in time).

-

sufficient conditions for mean-square exponential stability and for mean exponential stability of the equilibrium are obtained.