Abstract
In this paper, quantitative mean square exponential stability and stabilization of Itô-type linear stochastic Markovian jump systems with Brownian and Poisson noises are investigated. First, the definition of quantitative mean square exponential stability, which takes into account the transient and steady behaviors of the system, is presented. Second, the relationship between general finite-time mean square stability, finite-time stochastic stability, and quantitative mean square exponential stability is proposed. Subsequently, some sufficient conditions for the existence of state feedback and observer-based controllers are derived, and an algorithm is offered to solve the matrix inequalities resulting from quantitative mean square exponential stabilization. Finally, the effectiveness of the proposed results is illustrated with the numerical example and the practical example.
MSC:
37H30
1. Introduction
Exponential stability is a fundamental concept that has been discussed for a variety of system models, yielding considerable results. For instance, the authors of [1] dealt with the exponential stability of linear differential equations with impulsive effects. In [2], the issue of exponential stability of discrete-time impulsive systems was researched using the Razumikhin technique. Subsequently, the almost sure exponential stability was extended to nonlinear systems in [3]. In addition, other good results are available in [4,5,6,7,8]. However, in the current literature, the exponential stability has been analyzed mainly considering the steady-state behavior without considering the transient behavior. In fact, it is necessary for practical systems to have both stable performance and satisfactory transient characteristics. To deal with this problem, a new concept called quantitative mean square exponential stability (QMSES) for continuous-time stochastic systems is first proposed in [9], which considers both the transient behavior and steady performance of systems. On the basis of [9], the authors of [10] investigate this issue for discrete-time stochastic Markov jump systems (MJSs).
On the other hand, MJSs have attracted a great deal of attention in recent years. Essentially, MJSs are a class of dynamic hybrid system with multiple modes, which can be applied to manipulator systems [11], network control systems [12], motor systems [13], and so on. So far, a great number of achievements about MJSs have been obtained; see [14,15,16,17,18,19,20] and their references therein. As is well known, environment noise exists and cannot be neglected in many dynamical systems. Therefore, MJSs driven by Brownian motion or Poisson jumps have been developed gradually and achieved many related results. For example, in [21,22], the robust nonlinear control design problems driven by both external disturbances and Poisson noises were researched, respectively. Literature [23] discussed the problem of dissipative control for nonlinear systems with Wiener and Poisson noises. Later, finite-time annular domain stability was extended to such systems to be investigated by using differential Gronwall inequality approach in [24,25]. However, the above works do not include QMSES and quantitative mean square exponential stabilization (QMSE-stabilization) for continuous-time stochastic MJSs.
Inspired by the above discussion, both QMSES and QMSE-stabilization problems for Itô-type linear stochastic MJSs perturbed by Brownian and Poisson noises are investigated in this work. Owing to the fact that the model contains Poisson noise, it poses many challenges in terms of stability analysis and controller design. By applying the Itô–Levy formula, Gronwall’s inequality, the above challenges are overcome. The main contributions of this work can be summarized as follows: (i) Compared with the exponential mean square stability (EMSS) in [26], the QMSES not only focuses on the systematic steady-state behavior but also takes into account the systematic transient behavior, which is desired in the practical systems. (ii) In contrast to the reference [9], the system is not only suffering from the Wiener noises but also suffering from the discontinuous interferences, such as Poisson process, which is more prevalent in real systems. (iii) Some new stability criteria for QMSES, general finite-time mean square stability (GFTMSS) and finite-time stochastic stability (FTSS) are derived, and relationships between them are well established. (iv) Several new sufficient conditions for QMSE-stabilization are proposed. In addition, an algorithm is offered to find the relationship between the attenuation coefficient and attenuation rate .
The organization of in the rest of the paper is as follows. In Section 2, we present some preliminaries and definitions, which are used to prove the main results. In Section 3, QMSES is studied and the relevant criterion is obtained. In Section 4, we implement the QMSE-stabilization problem by designing the state feedback controller (SFC) and observer-based controller (OBC). In Section 5, we present an algorithm to solve the corresponding matrix inequilities. Furthermore, two examples are offered to show the validity of the results in Section 6. Finally, our conclusions are provided in the last section.
Notations: denotes the transpose of matrix A; indicates that A is a positive definite (positive semidefinite) matrix; denotes n-order unit matrix; represents the mathematical expectation; represents the largest eigenvalue (the smallest eigenvalue) of matrix A; The “w.r.t.” is short for “with respect to”.
2. Preliminaries
Consider the following Itô-type stochastic linear system described by
where , , and are state, measurement output, and control input, respectively. represents the initial state. and indicate one-dimensional Brownian motion and Poisson process defined on a complete probability space (,,, P) with a filter , respectively. The Poisson jump intensity of is . is a right-continuous Markov chain with transition rate matrix , taking values in the finite set . Furthermore, we assume that , and are independent of each other and transition probability is as follows:
where , is the transition rate from i to j with and . For , are constant matrices, denoted by , , , , , , , for simplicity.
Next, a new definition of QMSES for the system (1) is presented.
Definition 1 ([9]).
For given constants and , the system (1) with is said to be QMSE-stable w.r.t. (), if for all and any ,
Remark 1.
The definition of QMSES means the state trajectory of the system does not exceed the given upper bound . By definition 1, the system (1) has a satisfactory transient behavior when ψ is small and φ is large.
In the following, we will illustrate the superiority of QMSES. Compared with EMSS, QMSES considers both the transient behavior and steady performance of systems. A digital example is provided to demonstrate that EMSS probably does not ensure satisfactory transient as well as steady-state performances.
Example 1.
The two model parameters for the given system (1) are given below:
, , . According to the Euler–Maruyama method, in Figure 1, the red line shows the state trajectory curve of , and the green line shows 10 state trajectory curve of . It can be observed that the free system is EMSS, but it is not QMSES for given (ψ, φ), such as (4, 2), due to its poor transient performance. In other words, for the given , an EMS-stable system is not necessarily QMSE-stable w.r.t. .
Figure 1.
State trajectory curve of open-loop system (1).
Then, the definitions of GFTMSS and FTSS are provided.
Definition 2 ([9]).
For given constants and , the system (1) with is said to GFTMS-stable w.r.t. (), if for all and any ,
Definition 3 ([9]).
For given constants , , and , , the system (1) with is said to be FTS-stable w.r.t. (), if
Remark 2.
Definitions 1–3 all reflect the transient performance of the system (1). In other words, the state trajectory curve is controlled within the given upper bound on a given time period. In addition, according to the literature [9], the relationship between QMSES, GFTMSS, and FTSS is, when , as follows:
Remark 3.
For a given system (1), the sufficient conditions for QMSES, FTSS, and GFTMSS are presented, and the relationship of the stability criteria between FTSS, GFTMSS, and QMSES will be revealed in the following section.
With the basis of Definition 1, the QMSE-stabilization is defined below.
Definition 4.
The system (1) is said to be QMSE-stabilizable w.r.t (), if for given and , there exists a controller to make
QMSE-stable w.r.t. ().
For deriving the main results of this work, the below lemmas will be used:
Lemma 1 ([22]).
Let . Based on the following stochastic system
defining the infinitesimal operator as follows:
Lemma 2 ([27]).
(Gronwall inequality) Suppose is a non-negative function which satisfies the condition
for the given constants ; then, the below formula holds:
3. Quantitative Mean Square Exponential Stability
The stability criteria of QMSES, GFTMSS, and FTSS will be given in the following three theorems, respectively.
Theorem 1.
The system (1) () is QMSE-stable w.r.t. () if for the given scalars , , a positive scalar λ, there exists a group of symmetric matrices such that
hold.
Proof of Theorem 1.
For each , we define , where is the solution to be determined by solving (7) and (8). Applying Lemma 1 for , it follows
By first integrating from 0 to t and then taking mathematical expectation on the left and right sides of (10), we gain
Due to
Then, (11) implies
Next, the sufficient condition for the GFTMSS w.r.t. is provided.
Theorem 2.
The system (1) () is GFTMS-stable w.r.t. () if for the given , , there exists a group of symmetric matrices and a constant such that
hold.
Proof of Theorem 2.
For each , we define , where is the solution to be determined by solving (13) and (14). By using Lemma 1 for , we can obtain
By first integrating from 0 to t and then taking mathematical expectation on the left and right sides of (16), we can attain
From Lemma 2, we know
Due to
Based on (18), we obtain
In the next part, the sufficient conditions for FTSS will be presented.
Theorem 3.
The system (1) () is FTS-stable w.r.t. () if for given , , and a positive scalar λ, there exists a group of symmetric matrices and a constant such that
hold.
Proof of Theorem 3.
Remark 4.
From Theorems 1 and 2, we can see that (7) implies (13) when , that is, (7) and (8) mean (13) and (14), this indicates the system (1) is GFTMS-stable w.r.t. . From Theorems 2 and 3, we obtain (13) implies (20) when , that is, (13) and (14) mean (20) and (21), this shows the system (1) is FTS-stable w.r.t. ().
4. Quantitative Mean Square Exponential Stabilization
4.1. Stabilization via SFC
The purpose of this part is to consider the SFC to make the closed-loop system (5) to achieve QMSE-stabilization, where is the controller gain. When , is abbreviated to . In the following theorem, the sufficient conditions for QMSE-stabilization in SFC case will be presented.
Theorem 4.
The system (5) is QMSE-stable w.r.t. () if for given , , there exists a group of symmetric matrices , matrices , and positive constants such that
hold, where , , . In this case, .
4.2. Stabilization via OBC
In the previous part, the SFC has been considered to solve the QMSE-stabilization problem. However, the state of the system is always difficult to be measured in practical applications. Therefore, an OBC is proposed.
where and are estimated state and estimated gain, respectively. When , is abbreviated to . Set , the system (5) is transformed into
with
In the practical system, the smaller the estimation error , the better. We may assume that the error satisfies , for arbitrary .
Next, the sufficient conditions for QMSE-stabilization in OBC case will be provided.
Theorem 5.
The system (29) is QMSE-stable w.r.t. () if for given , , there exist two groups of positive definition matrices , and matrices , , and positive constants such that
hold, where , , . In this case, , .
Proof of Theorem 5.
Set and , where and are the solutions to be determined by solving (31) and (32). Then, we define . For each , we can attain
Applying Lemma 1 for , we can obtain
where , .
Letting , (31) implies
By first integrating from 0 to t and then taking mathematical expectation on the left and right sides of (35), we can attain
Due to
Then, (36) implies
5. Numerical Algorithm
In order to solve the matrix inequalities in Theorem 4, we propose an algorithm in this section. The same algorithm can be adopted for solving the inequalities in Theorem 5. The specific idea is to find feasible solutions satisfying the inequalities (23) and (24) by linear searching, starting from and . The detailed steps of the algorithm are provided in Algorithm 1.
| Algorithm 1 2-mode case |
|
6. Numerical Examples
In the following part, we provide the numerical calculation example and the practical application example to display the validity of the results, respectively.
6.1. Example 1
The two model parameters for the given system (1) are given below:
- when ,
- when ,
In addition, other parameters are , , and . In Figure 2, the red solid line shows the state trajectory curve of , and the green dashed line shows 10 state trajectory curve of . As you can see from Figure 2, the open-loop system (1) has poor transient performance. It is not QMSE-stable for the given (). Hence, it is essential to design the SFC and the OBC separately to achieve QMSE-stabilization.
Figure 2.
State trajectory curve of open-loop system (1).
Case 1. QMSE-stabilization via SFC
Setting , the relation curve between and is shown in Figure 3 by using Algorithm 1. From Figure 3, increases with increasing , and the maximum attenuation rate is when . According to Figure 3, take and to solve (23) and (24) in Theorem 4; then, we obtain
Figure 3.
Curve of vs. for SFC case.
Thus, the corresponding SFC can be obtained. Moreover, in Figure 4, the red line represents the state trajectory curve of , the green line represents 10 state trajectory curve of , and the blue line represents the curve of . As you can see from Figure 4, , i.e., the system (25) is QMSE-stabilizable w.r.t. .
Figure 4.
State trajectory curve of closed-loop system (25) for the SFC case.
Case 2. QMSE-Stabilization via OBC
We acquire the relation curve between and on the basis of Algorithm 1, which is shown in Figure 5. From Figure 5, increases with increasing , and the maximum attenuation rate, which is decay, is when .
Figure 5.
Curve of vs. for the OBC case.
,
Moreover, in Figure 6, the red line stands for the state trajectory curve of , the green line stands for 10 state trajectory curve of , and the blue line stands for the curve of for the OBC case. As you can see from Figure 6, , i.e., the system (29) is QMSE-stabilizable w.r.t. .
Figure 6.
State trajectory curve of closed-loop system (29) for the OBC case.
6.2. Example 2
A financial model example is provided to show the usefulness of the proposed approach. In general, financial markets suffer from various factors such as national policies, capital flowing, and investor expectations. Thus, the stochastic financial systems with disturbances are presented as follows in [24]:
where , , and are interest rate, investment demand, and price index, respectively. , , and are amount of savings, unit cost of investment, and elasticity of demand coefficient, respectively.
In addition, is the equilibrium point of the system. is a two-mode Markov chain with generator . System (38) with parameters as follows:
When , , , , , , ,
when , , , , , , ,
Other parameters are and . In Figure 7, the red solid line shows the state trajectory curve of , and the green dashed line shows 10 state trajectory curve of . As you can see from Figure 7, the system (38) has poor transient performance. It is not QMSE-stable for the given (). Hence, it is essential to design the SFC and the OBC separately to achieve QMSE-stabilization.
Figure 7.
State response curve of the open loop system.
Case 1. QMSE-stabilization via SFC
The relation curve between and is shown in Figure 8 using Algorithm 1. From Figure 8, remains the same with increasing , and the maximum attenuation rate is 10 when .
Figure 8.
Curve of vs. for SFC case.
Thus, the corresponding SFC can be obtained. Moreover, In Figure 9, the red line represents the state trajectory curve of , the green line represents 10 state trajectory curve of , and the blue line represents the curve of . As you can see from Figure 9, , i.e., the system (38) is QMSE-stabilizable w.r.t. .
Figure 9.
State response curve of closed-loop system for SFC case.
Case 2. QMSE-Stabilization via OBC
We acquire the relation curve between and on the basis of Algorithm 1, which is shown in Figure 10. From Figure 10, increases with increasing , and the maximum attenuation rate is when .
Figure 10.
Curve of vs. for the OBC case.
Moreover, in Figure 11, the red line denotes the state trajectory curve of , the green line denotes 10 state trajectory curve of , and the blue line denotes the curve of for the OBC case. As you can see from Figure 11, , i.e., the system (29) is QMSE-stabilizable w.r.t. .
Figure 11.
State response curve of closed-loop system for the OBC case.
7. Conclusions
An investigation of the QMSES and QMSE-stabilization of linear Itô stochastic MJSs with Brownian and Poisson noises has been presented. The relationships between QMSES, FTSS, and GFTMSS for such system have been established. By using a matrix transformation approach, SFC and OBC have been designed to make the corresponding closed-loop system to achieve QMSE-stabilization, respectively. In addition, the feasible solution curve of vs. has been shown by the linear search algorithm. In conclusion, the techniques used in this paper and some results may be applied in other control problems.
Author Contributions
Formal analysis, Z.Y., G.C. and T.S.; methodology, Z.Y., G.C. and T.S.; funding acquisition, Z.Y.; investigation, software, and writing—original draft preparation and editing, G.C., T.S., M.Z. and X.Z.; review and editing, Z.Y. All authors have read and agreed to the published version of the manuscript.
Funding
The research was funded by the National Natural Science Foundation of China (Grant Nos. 61877062 and 61977043).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Zhang, G.L.; Song, M.H.; Liu, M.Z. Exponential stability of the exact solutions and the numerical solutions for a class of linear impulsive delay differential equations. J. Comput. Appl. Math. 2015, 285, 32–44. [Google Scholar] [CrossRef] [Scilit]
- Cai, T.; Cheng, P. Exponential stability theorems for discrete-time impulsive stochastic systems with delayed impulses. J. Frankl. Inst. 2020, 357, 1253–1279. [Google Scholar] [CrossRef] [Scilit]
- Cheng, P.; Deng, F.; Yao, F. Almost sure exponential stability and stochastic stabilization of stochastic differential systems with impulsive effects. Nonlinear Anal. Hybrid Syst. 2018, 30, 106–117. [Google Scholar] [CrossRef] [Scilit]
- Abedi, F.; Leong, W.J.; Shahemabadi, A.R. Exponential stability of some interconnected stochastic control systems with non-trivial equilibria. Eur. J. Control 2021, 58, 174–182. [Google Scholar] [CrossRef] [Scilit]
- Zhang, D.; Yu, L. Exponential stability analysis for neutral switched systems with interval time-varying mixed delays and nonlinear perturbations. Nonlinear Anal. Hybrid Syst. 2012, 6, 774–786. [Google Scholar] [CrossRef] [Scilit]
- Socha, L.; Zhu, Q. Exponential stability with respect to part of the variables for a class of nonlinear stochastic systems with Markovian switchings. Math. Comput. Simul. 2019, 155, 2–14. [Google Scholar] [CrossRef] [Scilit]
- Nguyen Khoa, S.; Le, V.N. Exponential stability analysis for a class of switched nonlinear time-varying functional differential systems. Nonlinear Anal. Hybrid Syst. 2022, 44, 101177. [Google Scholar] [CrossRef] [Scilit]
- Tran, K.Q.; Nguyen, D.H. Exponential stability of impulsive stochastic differential equations with Markovian switching. Syst. Control Lett. 2022, 162, 105178. [Google Scholar] [CrossRef] [Scilit]
- Yan, Z.; Song, Y.; Park, J. Quantitative mean square exponential stability and stabilization of stochastic systems with Markovian switching. J. Frankl. Inst. 2018, 355, 3438–3454. [Google Scholar] [CrossRef] [Scilit]
- Yan, Z.; Zhang, W.; Park, J.; Liu, X. Quantitative exponential stability and stabilization of discrete-time Markov jump systems with multiplicative noises. IET Control Theory Appl. 2017, 11, 2886–2892. [Google Scholar] [CrossRef] [Scilit]
- Cao, Z.; Niu, Y. Finite-time sliding mode control of Markovian jump systems subject to actuator nonlinearities and its application to wheeled mobile manipulator. J. Frankl. Inst. 2018, 355, 7865–7894. [Google Scholar] [CrossRef] [Scilit]
- Zhai, D.; An, L.; Li, J.; Zhang, Q. Fault detection for stochastic parameter-varying Markovian jump systems with application to networked control systems. Appl. Math. Model. 2016, 40, 2368–2383. [Google Scholar] [CrossRef] [Scilit]
- Kim, S.H. H2 control of Markovian jump LPV systems with measurement noises: Application to a DC-motor device with voltage fluctuations. J. Frankl. Inst. 2017, 354, 1784–1800. [Google Scholar] [CrossRef] [Scilit]
- Yan, Z.; Song, Y.; Liu, X. Finite-time stability and stabilization for Itô-type stochastic Markovian jump systems with generally uncertain transition rates. Appl. Math. Comput. 2018, 321, 512–525. [Google Scholar] [CrossRef] [Scilit]
- Guo, Y. Stabilization of positive Markov jump systems. J. Frankl. Inst. 2016, 353, 3428–3440. [Google Scholar] [CrossRef] [Scilit]
- Song, B.; Wu, Z.; Park, J. Filtering for stochastic systems driven by Poisson processes. Int. J. Control 2015, 88, 2–10. [Google Scholar] [CrossRef] [Scilit]
- Lin, X.; Zhang, R. H∞ control for stochastic systems with Poisson jumps. J. Syst. Sci. Complex. 2011, 24, 683–700. [Google Scholar] [CrossRef] [Scilit]
- Guo, Y.; Feng, J. Stabilization of stochastic delayed networks with Markovian switching via intermittent control: An averaging technique. Neural Comput. Appl. 2022, 34, 4487–4499. [Google Scholar] [CrossRef] [Scilit]
- Wu, Z.; Su, H.; Chu, J. H∞ filtering for singular Markovian jump systems with time delay. Int. J. Robust Nonlinear Control 2010, 20, 939–957. [Google Scholar] [CrossRef] [Scilit]
- Sun, T.; Su, H.; Wu, Z. State feedback control for discrete-time Markovian jump systems with random communication time delay. Asian J. Control 2014, 16, 296–302. [Google Scholar] [CrossRef] [Scilit]
- Chen, W.; Chen, B. Robust stabilization design for nonlinear stochastic system with Poisson noise via fuzzy interpolation method. Fuzzy Sets Syst. 2013, 217, 41–61. [Google Scholar] [CrossRef] [Scilit]
- Chen, B.; Wu, C. Robust scheduling filter design for a class of nonlinear stochastic poisson signal systems. IEEE Trans. Signal Process. 2015, 63, 6245–6257. [Google Scholar] [CrossRef] [Scilit]
- Lin, Z.; Liu, J.; Niu, Y. Dissipative control of non-linear stochastic systems with Poisson jumps and Markovian switchings. IET Control Theory Appl. 2012, 6, 2367–2374. [Google Scholar] [CrossRef] [Scilit]
- Yan, Z.; Zhou, X.; Ji, D. Finite-time annular domain stability and stabilisation of Itô-type stochastic time-varying systems with Wiener and Poisson noises. Int. J. Control 2021, 1–18. [Google Scholar] [CrossRef] [Scilit]
- Zhong, S.; Zhang, W.; Yan, Z. Finite-time annular domain stability and stabilization for stochastic Markovian switching systems driven by Wiener and Poisson noises. Int. J. Robust Nonlinear Control 2020, 31, 2290–2304. [Google Scholar] [CrossRef] [Scilit]
- Chen, G.; Sun, J.; Chen, J. Mean square exponential stabilization of sampled-data Markovian jump systems. Int. J. Robust Nonlinear Control 2018, 28, 5876–5894. [Google Scholar] [CrossRef] [Scilit]
- Yan, Z.; Zhang, G.; Zhang, W. Finite-time stability and stabilization of linear Itô stochastic systems with state and control-dependent noise. Asian J. Control 2013, 15, 270–281. [Google Scholar] [CrossRef] [Scilit]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).










