Abstract
Motivated by important applications to the analysis of complex noise-induced phenomena, we consider a problem of the constructive description of randomly forced equilibria for nonlinear systems with multiplicative noise. Using the apparatus of the first approximation systems, we construct an approximation of mean square deviations that explicitly takes into account the presence of multiplicative noises, depending on the current system state. A spectral criterion of existence and exponential stability of the stationary second moments for the solution of the first approximation system is presented. For mean square deviation, we derive an expansion in powers of the small parameter of noise intensity. Based on this theory, we derive a new, more accurate approximation of mean square deviations in a general nonlinear system with multiplicative noises. This approximation is compared with the widely used approximation based on the stochastic sensitivity technique. The general mathematical results are illustrated with examples of the model of climate dynamics and the van der Pol oscillator with hard excitement.
MSC:
37H10; 37H20
1. Introduction
Currently, nonlinear stochastic phenomena such as noise-induced transitions [1,2,3], stochastic excitement [4,5,6,7], noise-induced crisis [8,9], stochastic bifurcations [10,11,12], noise-induced chaos [13,14,15], and stochastic and coherence resonances [16,17,18,19] are being actively studied in various fields of the natural sciences. One of the key mechanisms of such effects is associated with the transition of random trajectories through separatrices detaching basins of coexisting attractors.
In the analysis of such stochastic phenomena, the Monte Carlo method using direct numerical simulation is frequently used [20]. However, in the detailed parametric analysis, this numerical method is extremely time consuming and labor intensive. It is known that a full mathematical description of probability density functions is given by the Kolmogorov–Fokker–Planck Equation [21]. However, even in a two-dimensional case, a direct solution of this equation faces serious mathematical difficulties. In these circumstances, asymptotics and approximations are very useful. Here, asymptotics based on the quasipotential are of particular interest [22,23]. Nowadays, a new geometrical method of confidence domains is used for the approximation of probabilistic distributions. This approach allows one not only to describe the dispersion of random states near the deterministic attractor but also to estimate the critical values of the intensity of random disturbances that generate noise-induced transitions [24,25].
The main idea of this approach is as follows. As the noise intensity increases, the size of the confidence domain increases. The critical value of the noise intensity is found from the condition of the intersection of the confidence domain and the separatrix. The key parameter that determines the configuration of the confidence domain is the stochastic sensitivity of the attractor [26]. Initially, the stochastic sensitivity technique was introduced in connection with the approximation [27] of a quasipotential [22] in the vicinity of an attractor. Currently, this technique has been developed for regular and chaotic attractors of both continuous and discrete systems (see, e.g., [28,29]). The stochastic sensitivity technique and the associated confidence domains method are effectively used in the analysis of nonlinear stochastic phenomena [30,31] and control problems [32,33].
Using the stochastic sensitivity technique, an approximation of the mean square deviations of random states of a stochastic system from the deterministic attractor is constructed. Although formally this technique is applicable to both the case of additive and parametric noise, in the case of parametric noise, the error in the corresponding approximations may be such that the prediction made on the basis of this approximation may turn out to be incorrect.
This paper is devoted to the problem of the approximation of probabilistic distributions of random states around stable equilibria of stochastic differential Ito’s equations with general multiplicative noise. The main contribution of this paper is that we construct an approximation of mean square deviations that explicitly takes into account the impact of multiplicative noises. This more accurate approximation is compared with the previously used approximation based on the stochastic sensitivity technique. The constructive abilities of these general mathematical results are illustrated with examples. For a linear one-dimensional model, we compare two approximations of mean square deviations and derive an explicit formula for the relative error. For a two-dimensional nonlinear climate model, explicit formulas for matrices of mean square deviations are found and compared with the results of a direct numerical simulation. Using a model of a van der Pol oscillator with hard excitement, we show how a new, more accurate approximation makes it possible to predict the occurrence of large-amplitude stochastic oscillations.
2. Mean Square Analysis of Stochastic Equilibria
Consider a nonlinear autonomous system of ordinary differential equations
where x is an n-dimensional vector and is a sufficiently smooth n-vector function. It is assumed that the system (1) has an exponentially stable equilibrium .
Definition 1.
Along with the deterministic system (1), let us consider the stochastic Ito system
where are sufficiently smooth n-vector functions and are scalar standard independent Wiener processes. The functions model the dependence of multiplicative disturbances on the system state. It is worth noting that multiplicative noises are widely studied in systems of different nature, e.g., climate models, ecological systems, biological systems, robotics, financial systems, etc.
Solutions of the stochastic system (2), leaving the deterministic equilibrium under the influence of random disturbances, form some probability distribution. It is assumed that the probabilistic distribution of the states of the system (2) stabilizes. The corresponding stable stationary distribution density satisfies the Fokker–Planck–Kolmogorov Equation [21,22]. It is known that in general cases, it is very difficult to directly use this equation to describe probability distributions, even for two-dimensional systems. Here, the apparatus of the first approximation systems is useful.
2.1. First Approximation System and Its Mean Square Analysis
Let us consider the deviation of the random state x of the system (2) from the exponentially stable equilibrium of the system (1). The dynamics of the variable z are governed by the following first approximation linear system:
where
In our mean square analysis of the system (3) solutions, we will use first (m) and second (M) moments: , . The dynamics of these deterministic characteristics are described by the following equations:
To find an approximation of the dispersion of stationary distributed random states of the nonlinear stochastic system (2) around the deterministic equilibrium , we will use the stationary solutions of the system (4), (5).
Due to the exponential stability of the equilibrium , it holds that , where are eigenvalues of the matrix F. In these circumstances, the system (4) has a unique stationary stable solution . Substituting into (5), we obtain
So, the matrix of the stationary solution of Equation (6) satisfies the following algebraic equation:
Let us consider a deviation where is a solution of Equation (6). For the function , one obtains the homogeneous equation
The matrix is the matrix of second moments for solutions of linear homogeneous stochastic equation
Thus, the question about stability of the stationary solution of Equation (6) is reduced to the equivalent question about the exponential mean square stability of the trivial solution of the stochastic system (9).
Definition 2.
Let us consider the matrix and operators
Rewrite Equations (6)–(8) as follows:
Note that the existence of the operator follows from the condition .
Basic theoretical connections are presented in the following theorem.
Theorem 1.
The following statements are equivalent:
The statements of this theorem were proven or follow from more general results presented in [34,35,36].
Remark 1.
In the one-dimensional case (), we have
and the condition has an explicit parametric representation
In this case, for the mean square variance of random states around the equilibrium , the following estimation can be written
2.2. Asymptotics for the Case of Weak Noise: Stochastic Sensitivity of the Equilibrium
Consider the stochastic system with weak noises as follows:
Here, is a scalar small parameter of the intensity of random disturbances. For this system, Equation (11) for the covariance matrix M of the equilibrium has the form
Let us study the dependence of the solution of this equation on the parameter . Let be the solution to the equation
Then For , one can write the following decomposition:
For small , it holds that
As a result, for the matrix function we obtain the expansion in powers of the small parameter, as follows:
In this series, the matrix plays an important role in the asymptotic analysis of the dispersion of random states around the equilibrium. Because of , this matrix characterizes the stochastic sensitivity of the equilibrium [26] to the impact of weak noise. Thus, in the first approximation, we have
where W is a solution of the following equation
If the noise in the system (14) does not depend on the state, then and the first approximation coincides with the exact value In general, using W as an approximation for , one obtains an underestimation of the covariance of random states. Indeed, since the operator is positive [37], the inequality is valid.
In a one-dimensional case, the stochastic sensitivity of the equilibrium for the system (14) is given by the formula
3. Examples
Let us consider how these theoretical results can be applied to the approximation of mean square deviation of random states from the equilibrium in some stochastic systems.
Example 1.
Consider a simple one-dimensional stochastic system
where and are non-negative parameters, ε is the intensity of random disturbances, are uncorrelated scalar Wiener processes. The parameters and specify the weights of additive and multiplicative disturbances, accordingly.
For , the corresponding deterministic system (with ) has an exponentially stable equilibrium Second moments of deviations of solutions from the equilibrium satisfy the equation
This equation has a stationary solution
Following the decomposition (17), for weak noise, has the following asymptotics:
where W characterizes the stochastic sensitivity of the equilibrium . Here, W satisfies (see (19)) the equation:
Using W, one can write the first approximation for the function :
Formally, the approximation is defined for any while the approximated function is defined only for In absence of multiplicative noise ), the values and M are identical. At , they can essentially differ.
This difference is clearly seen in Figure 1 where plots of the functions M (solid line) and (dashed line) are shown versus parameter a. Note that the approximation is always less than M (this fact was shown above for the general case). Moreover, in the interval where the approximation gives finite values, the original function is not defined at all: the second moments tend to infinity. In the interval , the approximation error monotonically increases and tends to infinity as it approaches the bifurcation value . For the relative error, an explicit representation can be written as follows:
Let us continue the comparison of these two methods for estimating the dispersion of random states around the equilibrium using the two-dimensional systems as examples.
Figure 1.
Stationary second moments M (solid line) and approximation (dashed) versus parameter a.
Example 2.
Consider a stochastic version of the two-dimensional model [38] of climate dynamics:
Here, the variable x describes the marine ice latitude, y stands for the ocean temperature. In model (21), and characterize intensities of the additive and multiplicative noises, respectively, are scalar standard independent Wiener processes, and ε is the small parameter. The deterministic system (21) (with therein) has the equilibrium . For this equilibrium, the Jacobi matrix is
The equilibrium is exponentially stable if and
As it follows from the theory presented above, the covariance matrix of random states of the stochastic climate model (21) near the equilibrium satisfies Equation (15), where
For elements of the symmetric matrix M, the following system can be written as follows:
This system has an explicit solution, as follows:
The first approximation matrix from (18) for the model (21) has elements
The accuracy of the approximation M and can be seen in Figure 2. Here, for the fixed values , mean square deviations and (asterisks) were calculated via direct numerical simulation of solutions of the nonlinear stochastic model (21). Approximations and found from (22) are plotted here by solid lines, and approximations and found from (23) are plotted by dashed lines. As can be seen, and agree well with results of direct numerical simulations while and significantly underestimate and .
Figure 2.
Stochastic system (21) with . Here, mean square deviations (left) and (right) calculated via the direct numerical simulation of system (21) solutions for different are shown by asterisks. Approximations (left) and (right) are plotted by solid curves. Approximations (left) and (right) are plotted by dashed curves.
Example 3.
Consider the van der Pol model with hard excitation of self-oscillations, as follows:
Here, is the intensity of the additive noise, is the intensity of the multiplicative noise, and are scalar standard independent Wiener processes.
Let us fix . For this set of parameters, the deterministic system (24) with is bistable and exhibits the coexisting attractors: the stable equilibrium and stable limit cycle. Basins of these attractors are separated by the orbit of the unstable limit cycle. In Figure 3a and Figure 4a, the equilibrium is shown by a black filled circle, the stable cycle is plotted by a blue curve, and the unstable cycle (the separatrix) is shown by a red curve.
Figure 3.
Stochastic system (24) with : (a) random trajectory (green) of the solution starting at the equilibrium ; (b) time series.
Figure 4.
Stochastic system (24) with : (a) random trajectory (green) of the solution starting at the equilibrium ; (b) time series.
Let us consider the behavior of trajectories of the stochastic system (24) solutions starting at the equilibrium . Under the influence of weak random disturbances, trajectories leave the stable equilibrium and form a stationary probability distribution concentrated in a small neighborhood of the origin. These types of dynamics correspond to the unexcited mode of the oscillator (see Figure 3 for ).
As the noise intensity increases, random trajectories cross the separatrix (unstable limit cycle) and continue to oscillate near the stable cycle. This means a transition to the excitation mode (see Figure 3 for ).
For the analytical approximation of the dispersion of random states, we will use the theory presented above.
For system (24), the parameters of Equation (7) are as follow:
Now, we can write the matrix Equation (7) as the following system for the elements of the symmetric matrix M:
From this system, we have solution
Thus, the matrix M that defines mean square deviation of random states from the equilibrium is
Note that the asymptotic method of stochastic sensitivity gives for mean square deviation another approximation, as follows:
The difference in these approximations can lead to qualitative differences in the prediction of the results of the noise influence. Let us consider how these two estimations work in the context of the confidence domains method. For diagonal matrices, the equation of the confidence ellipse is written as
Here, P is fiducial probability.
Confidence ellipses are effectively used in predicting noise-induced transitions through the separatrix. Figure 5 shows two confidence ellipses constructed using the matrices M (larger ellipse) and (smaller ellipse) for the stochastic system (24) with The larger ellipse captures the basin of attraction of the limit cycle, which allows us to make a prediction about the generation of large-amplitude oscillations (excitation mode). The smaller ellipse is entirely contained in the basin of attraction of the stable equilibrium and therefore predicts the unexcited mode of the oscillator. As we see, an error in estimating the second moments can lead to qualitative errors in solving important prediction problems. Note that this prediction agrees well with the results of direct numerical simulations (compare Figure 3, Figure 4 and Figure 5).
Figure 5.
Confidence ellipses (dashed) and unstable cycle (red solid) for the system (24) with . The internal ellipse is constructed using the matrix , and the external ellipse is constructed using the matrix M. Here, fiducial probability .
4. Conclusions
This paper is devoted to the problem of approximating probability distributions of random states near the equilibrium of the stochastic system with multiplicative noise. The system of nonlinear stochastic differential Ito’s equations is used as a basic mathematical model. For a solution of the linear first approximation system, we present an algebraic criterion of existence and exponential stability of the stationary second moments. For mean square deviation, an expansion in powers of the small parameter of noise intensity is derived. Using this mathematical theory, we derive a new, more accurate approximation of mean square deviations in a general nonlinear system with multiplicative noises. This approximation is compared with the widely used approximation based on the stochastic sensitivity technique. The general mathematical results are applied to examples. For the climate model, explicit formulas for matrices of mean square deviations are derived and compared with the results of direct numerical simulation. For the van der Pol oscillator with hard excitement, it is shown that using the elaborated more accurate approximation, one can predict the onset of noise-induced generation of large-amplitude stochastic oscillations. This prediction agrees well with the results of direct numerical simulations. It is worth noting that extending the more accurate approximation obtained here for equilibrium to the more complex cases of limit cycles and chaotic attractors is an attractive challenge.
Funding
This work was supported by the Russian Science Foundation (N 24-11-00097).
Data Availability Statement
The data presented in this study are available on request from the corresponding author.
Conflicts of Interest
The author declares no conflict of interest.
References
- Horsthemke, W.; Lefever, R. Noise-Induced Transitions; Springer: Berlin, Germany, 1984; p. 338. [Google Scholar]
- Anishchenko, V.S.; Astakhov, V.V.; Neiman, A.B.; Vadivasova, T.E.; Schimansky-Geier, L. Nonlinear Dynamics of Chaotic and Stochastic Systems. Tutorial and Modern Development; Springer: Berlin/Heidelberg, Germany, 2007; p. 535. [Google Scholar]
- Ducimetiére, Y.M.; Boujo, E.; Gallaire, F. Noise-induced transitions past the onset of a steady symmetry-breaking bifurcation: The case of the sudden expansion. Phys. Rev. Fluids 2024, 9, 053905. [Google Scholar] [CrossRef]
- Lindner, B.; Garcia-Ojalvo, J.; Neiman, A.; Schimansky-Geier, L. Effects of noise in excitable systems. Phys. Rep. 2004, 392, 321–424. [Google Scholar] [CrossRef]
- Chen, Z.; Zhu, J. Non-differentiability of quasi-potential and non-smooth dynamics of optimal paths in the stochastic Morris-Lecar model: Type I and II excitability. Nonlinear Dyn. 2019, 96, 2293–2305. [Google Scholar] [CrossRef]
- Lima Dias Pinto, I.; Copelli, M. Oscillations and collective excitability in a model of stochastic neurons under excitatory and inhibitory coupling. Phys. Rev. E 2019, 100, 062416. [Google Scholar] [CrossRef] [PubMed]
- Ryashko, L. Analysis of excitement caused by colored noise in a thermokinetic model. Mathematics 2023, 11, 4676. [Google Scholar] [CrossRef]
- Anishchenko, V.S.; Khairulin, M.E. Effect of noise-induced crisis of attractor on characteristics of Poincaré recurrence. Tech. Phys. Lett. 2011, 37, 561–564. [Google Scholar] [CrossRef]
- Cisternas, J.; Descalzi, O. Intermittent explosions of dissipative solitons and noise-induced crisis. Phys. Rev. E 2013, 88, 022903. [Google Scholar] [CrossRef] [PubMed]
- Arnold, L. Random Dynamical Systems; Springer: Berlin, Germany, 1998; p. 600. [Google Scholar]
- Zakharova, A.; Kurths, J.; Vadivasova, T.; Koseska, A. Analysing dynamical behavior of cellular networks via stochastic bifurcations. PLoS ONE 2011, 6, e19696. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Jin, C.; Sun, Z.; Xu, W. A novel stochastic bifurcation and its discrimination. Commun. Nonlinear Sci. Numer. Simul. 2022, 110, 106364. [Google Scholar] [CrossRef]
- Gao, J.B.; Hwang, S.K.; Liu, J.M. When can noise induce chaos? Phys. Rev. Lett. 1999, 82, 1132–1135. [Google Scholar] [CrossRef]
- Lai, Y.C.; Tel, T. Transient Chaos. Complex Dynamics on Finite Time Scales; Springer: New York, NY, USA, 2011; p. 502. [Google Scholar]
- Agarwal, V.; Yorke, J.; Balachandran, B. Noise-induced chaotic-attractor escape route. Nonlinear Dyn. 2020, 102, 863–876. [Google Scholar] [CrossRef]
- Pikovsky, A.S.; Kurths, J. Coherence resonance in a noise-driven excitable system. Phys. Rev. Lett. 1997, 78, 775–778. [Google Scholar] [CrossRef]
- Schmid, G.; Hänggi, P. Intrinsic coherence resonance in excitable membrane patches. Math. Biosci. 2007, 207, 235–245. [Google Scholar] [CrossRef] [PubMed][Green Version]
- McDonnell, M.D.; Stocks, N.G.; Pearce, C.E.M.; Abbott, D. Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization; Cambridge University Press: Cambridge, UK, 2008; p. 446. [Google Scholar]
- Palabas, T.; Torres, J.J.; Perc, M.; Uzuntarla, M. Double stochastic resonance in neuronal dynamics due to astrocytes. Chaos Solitons Fractals 2023, 168, 113140. [Google Scholar] [CrossRef]
- Kloeden, P.E.; Platen, E. Numerical Solution of Stochastic Differential Equations; Springer: Berlin, Germany, 1992; p. 636. [Google Scholar]
- Risken, H. The Fokker–Planck Equation: Methods of Solution and Applications; Springer: Berlin, Germany, 1984. [Google Scholar]
- Freidlin, M.I.; Wentzell, A.D. Random Perturbations of Dynamical Systems; Springer: New York, NY, USA, 1984. [Google Scholar]
- Li, Y.; Xu, S.; Duan, J.; Liu, X.; Chu, Y. A machine learning method for computing quasi-potential of stochastic dynamical systems. Nonlinear Dyn. 2022, 109, 1877–1886. [Google Scholar] [CrossRef]
- Xu, C.; Yuan, S.; Zhang, T. Confidence domain in the stochastic competition chemostat model with feedback control. Appl. Math. J. Chin. Univ. 2018, 33, 379–389. [Google Scholar] [CrossRef]
- Ryashko, L. Sensitivity analysis of the noise-induced oscillatory multistability in Higgins model of glycolysis. Chaos 2018, 28, 033602. [Google Scholar] [CrossRef] [PubMed]
- Bashkirtseva, I. Stochastic sensitivity analysis: Theory and numerical algorithms. IOP Conf. Ser. Mater. Sci. Eng. 2017, 192, 012024. [Google Scholar] [CrossRef]
- Mil’shtein, G.; Ryashko, L. A first approximation of the quasipotential in problems of the stability of systems with random non-degenerate perturbations. J. Appl. Math. Mech. 1995, 59, 47–56. [Google Scholar] [CrossRef]
- Sun, Y.; Hong, L.; Jiang, J. Stochastic sensitivity analysis of nonautonomous nonlinear systems subjected to Poisson white noise. Chaos Solitons Fractals 2017, 104, 508–515. [Google Scholar] [CrossRef]
- Bashkirtseva, I.; Ryashko, L. Stochastic sensitivity analysis of chaotic attractors in 2D non-invertible maps. Chaos Solitons Fractals 2019, 126, 78–84. [Google Scholar] [CrossRef]
- Alexandrov, D.V.; Bashkirtseva, I.A.; Crucifix, M.; Ryashko, L.B. Nonlinear climate dynamics: From deterministic behaviour to stochastic excitability and chaos. Phys. Rep. 2021, 902, 1–60. [Google Scholar] [CrossRef]
- Garain, K.; Sarathi Mandal, P. Stochastic sensitivity analysis and early warning signals of critical transitions in a tri-stable prey-predator system with noise. Chaos 2022, 32, 033115. [Google Scholar] [CrossRef] [PubMed]
- Bashkirtseva, I.; Ryashko, L.; Chen, G. Stochastic sensitivity synthesis in nonlinear systems with incomplete information. J. Frankl. Inst. 2020, 357, 5187–5198. [Google Scholar] [CrossRef]
- Huang, M.; Yang, A.; Yuan, S.; Zhang, T. Stochastic sensitivity analysis and feedback control of noise-induced transitions in a predator-prey model with anti-predator behavior. Math. Biosci. Eng. 2023, 20, 4219–4242. [Google Scholar] [CrossRef] [PubMed]
- Ryashko, L. Stabilization of linear stochastic systems with state and control dependent perturbations. J. Appl. Math. Mech. 1981, 43, 655–663. [Google Scholar] [CrossRef]
- Mao, X. Exponential Stability of Stochastic Differential Equations; Marcel Dekker: New York, NY, USA, 1994; p. 307. [Google Scholar]
- Khasminskii, R. Stochastic Stability of Differential Equations; Springer: Berlin, Germany, 2012. [Google Scholar]
- Krasnosel’skij, M.A.; Lifshits, J.A.; Sobolev, A.V. Positive Linear Systems, the Method of Positive Operators; Heldermann Verlag: Berlin, Germany, 1989; p. 354. [Google Scholar]
- Saltzman, B.; Sutera, A.; Evenson, A. Structural stochastic stability of a simple auto-oscillatory climatic feedback system. J. Athmospheric Sci. 1981, 38, 494–503. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).