A New Intelligent Dynamic Control Method for a Class of Stochastic Nonlinear Systems

: This paper presents a new method for a comprehensive stabilization and backstepping control system design for a class of stochastic nonlinear systems. These types of systems are so abundant in practice that the control system designer must assume that random noise with a deﬁnite probability distribution affects the dynamics and observations of state variables. Stochastic control is intended to determine the time course of control variables so that the control target is achievable even with minimal cost. Since the mathematical equations of stochastic nonlinear systems are not always constant, not every model-based controller can be accurate. Therefore, in this paper, a type-3 fuzzy neural network is used to estimate the parameters of the backstepping control method. In the simulation, the proposed method is compared with the Type-1 fuzzy and RBFN methods. Results clearly show that the proposed method has a very good performance and can be used for any system in this class.


Introduction
The essence of most real and physical systems is nonlinear. This nonlinear dynamic behaviour complicates control systems, especially when hysteresis phenomena are taken into account [1][2][3]. In recent years, nonlinear systems have received a lot of attention and many efforts have been made to stabilize them. One of the root causes of instability in systems is related to their nonlinear nature (dynamics), to which the designer of the control system must pay special attention [4][5][6][7][8]. Hence, innovative techniques in [9] are proposed to achieve a systematic design procedure for these highly nonlinear systems, including the backstepping design method. Due to the increasing complexity of the problem, these systems are classified into the following three classes of systems: strict feedback systems, pure feedback systems, and block strict feedback systems. In [10], using the backstepping method, and in combination with the radial basis function neural network (RBFN), a creative controller was designed for strict feedback nonlinear stochastic systems with unknown dynamics. There is a so-called "explosion of complexity", which complicates the design and simulation by increasing the system rank. A very creative technique called dynamic surface control (DSC) is suggested in [11], which can prevent disturbing phenomena. Numerous studies [7][8][9][10][11] use this technique instead of using the backstepping design method, in order to prevent the occurrence of the phenomenon of an "explosion of complexity", and they have proposed some methods to stabilize different forms of nonlinear systems. Some of these studies will be reviewed in the following. In [12]. with the development of a dynamic level control method using Gaussian networks, a controller for non-linear toxins in the form of strict feedback with desired indeterminacy is presented. In [13], the problem of adaptive tracking control for a class of indeterminate strict single input-single output with unknown path and control perturbations is investigated, and the DSC design method is used to solve the "explosion of complexity" problem. In [14], a creative controller is presented based on a combination of the dynamic surface control and adaptive fuzzy sliding mode control method for a MEMS gyroscope. In [15], the dynamic surface control, considering the saturation, is presented for the problem of safe entry into the spacecraft terminal based on the spacecraft's relative motion model and the potential to prevent the collision of the sphere. Occurrence of failure in control systems can lead to catastrophic accidents. Therefore, many efforts have been made to prevent the occurrence of such accidents, and to deal with adverse effects on control systems. Malfunctions may occur in various parts of a control system, from the attack of sensors, actuators, controllers, communication lines, and so on. Among the topics of interest to researchers in recent years is the occurrence of malfunctions in control system cells. Actuator failure means changing the characteristic of the actuator from a linear state to a variety of nonlinear states, including the actuator's physical performance, its jamming, the dead-zone phenomenon, the residual phenomenon in the actuator, and so on. In the following, studies will be reviewed that have examined the occurrence of each of these types of defects in the actuators. In [16], DSC has been used to avoid the "explosion of complexity" phenomenon in a conventional backstepping method, and then, by introducing the Lyapunov integral function, they provide a controller for pure feedback nonlinear systems with a dead-zone area. In [17], the occurrence of variable failures in nonlinear systems has been investigated. They proposed an adaptive synchronization sliding mode technique to solve the problems caused by uncertain system parameters, actuator failure, and perturbations. In [18], the problem of adaptive control for stochastic nonlinear systems with time delay and a dead-zone is investigated. In the aforementioned paper, they used an adaptive control scheme based on neural networks, DSC, and a minimum learning parameters algorithm. In order to reduce the complexity of the calculations, a creative controller has also been proposed to eliminate the adverse effect of time delay from the Lyapunov-Krasovskii function [19]. In [20], the adaptive tracking control technique has been investigated for a more general class of systems with stochastic nonlinear time delay and with a dead area at input.
In [21], by combining the adaptive neural network and backstepping technologies, a method for controlling a class of stochastic nonlinear systems that can consider uncertainty and work in the operational situation of the system is proposed. Additionally, via the combination of these two technologies, a control method for a class of strict-feedback stochastic nonlinear systems is presented in [22]. In this method, the input disturbances are also considered. In [23], a comparative adaptive neural controller has been used to design a decentralized H∞ controller. Each of the subsystems of this proposed design are designed using the backstepping and Lyapanov methods. Recently, type-2 and-3 fuzzy systems have played a huge role in controlling the system and, as such, are proposed for a class of uncertain nonlinear systems. [24].
The innovations of this article are as follows: 1-Using the combination of a type-3 fuzzy neural network and a backstepping control method for the first time. 2-Applying actuator failure to stochastic nonlinear system in a new way. 3-Ensuring the stability of the control system analytically.
The structure of the article is such that the problem is explained first. Then, the specifications of type-3 fuzzy neural network are presented. The proposed control system is described in detail below. In the simulation section, the performance of the control system is evaluated. Finally. in the conclusion section, all of the research results are expressed.

Statement of the Problem
Consider a nonlinear stochastic strict feedback system: where ψ is the standard two-dimensional external motions defined on the probability space (Ω, F, P) with Ω as the sample space, F as a filtration, P as a criterion Probability, and smoothly unknown functions such as below: where It should be noted that in (1), u is the control input or the output of the actuator, which can be exposed to many nonlinear variations, including residuals in the actuator. In conducting this research, and in each step of the stability analysis procedure, a series of definitions, concepts, and lemma will be used, which will be briefly explained as we continue. Consider the following stochastic system: where x is vector of system state. The following factions are locally Lipchitz functions; f : R n × R + → R n , h : R n × R + → R n×r , f (0, t), h(0, t) = 0, ∀t ≥ 0 (5) Definition 1. For each function as follows: Related to relation (4), the differential actuator L is defined as: The last term of (7) is called an Ito correction. The second order derivative ∂ 2 v ∂x 2 is the main challenge for the control system designer and the difference between stochastic and deterministic systems is determined in this phrase. Lemma 1. Consider a stochastic system (4), and assume that f (x, t) and h(x, t) in their arguments C 1 , f (0, t), and h(0, t) are uniformly bounded in t. In the following functions: And there are the constants a 0 > 0, b 0 ≥ 0 such that: Then the system (4) is bounded in probability. Lemma 2. An inequality will also be widely used during the design of the controller and to prove its stability, hence, it is first described as an inequality.
Optimal determination of values p and q is very important. Trial and error methods are commonly used in articles. In this paper, for the first time, we calculate these parameters online using a fuzzy system. This is one of the valuable innovations of this paper.

Lemma 3.
For each continuous function: with always positive functions There is Executor actuator: analytically, suppose C m [0, t E ] is a space of uniform continuous fragment functions. For an input v(t), where v(t) ∈ C m [0, t E ], the executable actuator is: where, and, Therefore, there is a fraction in interval [0, t E ], such that the function v(t) on each of the sub-intervals [t i , t i+1 ] is uniform.
Prandtl-Ishlinskii (PI) Waste: It is a nonlinear condition as follows: (17) In which u(t) is the output of the actuator, v(t) the input signal to the actuator. p(r) is the density function, and is a constant that depends on the density function p(r).

Type-3 Fuzzy Neural Network
In this section, the type-3 fuzzy neural network structure ( Figure 1) and calculations are presented. The membership degree of type-3 fuzzy sets is calculated as follows: where, h = 1, . . . , n, j = 1, 2, c S j where, h = 1,...,n, j = 1,2, The calculation of upper rule firing at h α are as follows: The firing of upper rule at αh, are as follows: Equations (29)-(36) are formulations of the upper and lower slices of the lower firing rules. The calculation of upper rule firing at α h are as follows: The firing of upper rule at α h , are as follows: Equations (29)-(36) are formulations of the upper and lower slices of the lower firing rules.
The type-reduction procedure from a type-3 fuzzy to a type-2 one, are computed as follows ( Figure 2):ŷ where, R is the number of rules (here R = 5), and θ l and θ l are the parameters of the lower and upper of the l-th rule.
Mathematics 2022, 10, x FOR PEER REVIEW The type-reduction procedure from a type-3 fuzzy to a type-2 one, are compu follows ( Figure 2):  The type-reduction procedure from type-2 fuzzy to type-1 one is as follows: The output ŷ is computed as: The type-reduction procedure from type-2 fuzzy to type-1 one is as follows: The outputŷ is computed as:ŷ =ŷ +ŷ

(40)
The type-3 fuzzy neural network parametric learning process can be seen in Appendix A.

Controller Design
As presented in the literature review, an approach for the stabilization of stochastic nonlinear systems is presented in the form of strict feedback, which is based on the back- stepping design technique and neural networks. The present method is an extension of the method proposed in [5]. The differences between our work and the aforementioned work are as follows: replacing the backstepping design method by using the dynamic surface control (DSC) design, and the use of a type-3 fuzzy system instead of a radial base function neural network (RBFN). Numerous articles have proven the ability and accuracy of type-3 fuzzy systems compared to other computational intelligence tools. Finally, the proposed design method will be used to investigate the occurrence of PI waste in the actuator. This method is based on a multi-step recursive design algorithm that will be described below. Consider the strict feedback stochastic nonlinear system (17), then for each i step, an error surface (S i ), as follows: where S i is the i-th error surface, x i is the i-th state, and z i is the i-th desired state for the system. The proposed design procedure consists of n sequential step calculations. A virtual control input x i+1 for each step is defined as follows: where k i and a i are the design parameters (calculated by a type-3 fuzzy system), and ζ i (z i ) are the type-3 fuzzy membership functions in the first layer of the type-3 fuzzy neural network. An estimation of θ is shown byθ. The virtual control input is passed through a low-pass filter in order to obtain the desired value of the next step mode.
In (21), i+1 is design parameter (calculated by type-3 fuzzy system). The i-th filter error is as follows: The derivative of (22) is as follows: where B i (.) and G i (.) are smooth and continuous functions, with maximums of M i and N i , respectively. The adaptation law to update the parameters of the type-3 fuzzy neural network is as follows:θ The block diagram of the proposed control system is shown in Figure 3. As shown in Figure 3, the dynamic surface control (DSC) is the main controller that needs to be configured. In previous studies that have been carried out, the parameters of this controller were usually calculated by trial and error or with prior knowledge, but in this article, we use the type-3 fuzzy neural network to calculate the aforementioned parameters. Online tunning of control system parameters is very important, especially in systems with high nonlinearity dynamics or stochastic systems, such as in [25,26]. Mathematics 2022, 10, x FOR PEER REVIEW 8 of 16 As shown in Figure 3, the dynamic surface control (DSC) is the main controller that needs to be configured. In previous studies that have been carried out, the parameters of this controller were usually calculated by trial and error or with prior knowledge, but in this article, we use the type-3 fuzzy neural network to calculate the aforementioned parameters. Online tunning of control system parameters is very important, especially in systems with high nonlinearity dynamics or stochastic systems, such as in [25,26].

Simulations
In this section, to show the efficiency of the proposed method, two stochastic nonlinear dynamic systems will be controlled and the results will be depicted. where and are the states of the system, is the input of the system (control signal), and is the system's output. Figure 4 shows the simulation result of Example 1 and the performance of the proposed control system (dynamic surface control with a type-3 fuzzy neural network) for the convergence of both system states. The control signal generated by the proposed control system for the convergence of the states in Figure 4 is shown in Figure 5.

Simulations
In this section, to show the efficiency of the proposed method, two stochastic nonlinear dynamic systems will be controlled and the results will be depicted.

Example 1.
Consider the following second-order stochastic nonlinear system.
where x 1 and x 2 are the states of the system, u is the input of the system (control signal), and y is the system's output. Figure 4 shows the simulation result of Example 1 and the performance of the proposed control system (dynamic surface control with a type-3 fuzzy neural network) for the convergence of both system states.  Figure 3, the dynamic surface control (DSC) is the main controller that needs to be configured. In previous studies that have been carried out, the parameters of this controller were usually calculated by trial and error or with prior knowledge, but in this article, we use the type-3 fuzzy neural network to calculate the aforementioned parameters. Online tunning of control system parameters is very important, especially in systems with high nonlinearity dynamics or stochastic systems, such as in [25,26].

Simulations
In this section, to show the efficiency of the proposed method, two stochastic nonlinear dynamic systems will be controlled and the results will be depicted. where and are the states of the system, is the input of the system (control signal), and is the system's output. Figure 4 shows the simulation result of Example 1 and the performance of the proposed control system (dynamic surface control with a type-3 fuzzy neural network) for the convergence of both system states. The control signal generated by the proposed control system for the convergence of the states in Figure 4 is shown in Figure 5. The control signal generated by the proposed control system for the convergence of the states in Figure 4 is shown in Figure 5.
For further evaluation and analysis, the proposed control method is compared with the other two methods. In this scenario, the system output is supposed to rise from 0 to 5 after 1 s. One method is a dynamic surface control based on type-1 fuzzy system, and the other is based on radial basis function neural network. Figure 6 shows the result of this comparison. For further evaluation and analysis, the proposed control method is compared with the other two methods. In this scenario, the system output is supposed to rise from 0 to 5 after 1 s. One method is a dynamic surface control based on type-1 fuzzy system, and the other is based on radial basis function neural network. Figure 6 shows the result of this comparison. The control signals generated by all three controllers in Figure 6 are shown in Figure  7.
It can be seen from Figures 4-7 that the proposed control system has a good performance and has been able to manage the states (output) of the controlled system in less than 1 s. Additionally, comparison with the other two controllers (type-1 fuzzy and RBFN) shows the high speed and accuracy of the type-3 fuzzy. It can be seen from Figure  7 that the control cost (control signal peak) in the type-3 fuzzy is much lower than the other cases. In the following, a more complex system (48) is introduced, and the performance of the control system for this system (Example 2) is challenged.   For further evaluation and analysis, the proposed control method is compared with the other two methods. In this scenario, the system output is supposed to rise from 0 to 5 after 1 s. One method is a dynamic surface control based on type-1 fuzzy system, and the other is based on radial basis function neural network. Figure 6 shows the result of this comparison. Figure 6. Comparison of dynamic surface control performance based on the type-3 fuzzy system, type-1 fuzzy system, and RBFN.
The control signals generated by all three controllers in Figure 6 are shown in Figure  7.
It can be seen from Figures 4-7 that the proposed control system has a good performance and has been able to manage the states (output) of the controlled system in less than 1 s. Additionally, comparison with the other two controllers (type-1 fuzzy and RBFN) shows the high speed and accuracy of the type-3 fuzzy. It can be seen from Figure  7 that the control cost (control signal peak) in the type-3 fuzzy is much lower than the other cases. In the following, a more complex system (48) is introduced, and the performance of the control system for this system (Example 2) is challenged.  The control signals generated by all three controllers in Figure 6 are shown in Figure 7. For further evaluation and analysis, the proposed control method is compared with the other two methods. In this scenario, the system output is supposed to rise from 0 to 5 after 1 s. One method is a dynamic surface control based on type-1 fuzzy system, and the other is based on radial basis function neural network. Figure 6 shows the result of this comparison. Figure 6. Comparison of dynamic surface control performance based on the type-3 fuzzy system, type-1 fuzzy system, and RBFN.
The control signals generated by all three controllers in Figure 6 are shown in Figure  7.
It can be seen from Figures 4-7 that the proposed control system has a good performance and has been able to manage the states (output) of the controlled system in less than 1 s. Additionally, comparison with the other two controllers (type-1 fuzzy and RBFN) shows the high speed and accuracy of the type-3 fuzzy. It can be seen from Figure  7 that the control cost (control signal peak) in the type-3 fuzzy is much lower than the other cases. In the following, a more complex system (48) is introduced, and the performance of the control system for this system (Example 2) is challenged.  It can be seen from Figures 4-7 that the proposed control system has a good performance and has been able to manage the states (output) of the controlled system in less than 1 s. Additionally, comparison with the other two controllers (type-1 fuzzy and RBFN) shows the high speed and accuracy of the type-3 fuzzy. It can be seen from Figure 7 that the control cost (control signal peak) in the type-3 fuzzy is much lower than the other cases. In the following, a more complex system (48) is introduced, and the performance of the control system for this system (Example 2) is challenged.

Example 2.
Consider the following third-order stochastic nonlinear system.
where x 1 and x 2 are the states of the system, u is the input of the system (control signal), and y is the system's output. This system (48) has three states, and the proposed control system has been able to converge all of them very well (Figure 8).

Example 2:
Consider the following third-order stochastic nonlinear system. where and are the states of the system, is the input of the system (control signal), and is the system's output. This system (48) has three states, and the proposed control system has been able to converge all of them very well (Figure 8). Figure 8. The control signal generated by the proposed control system is shown in Figure 9.
As shown in Figure 9, the control signal converges the system in less than 1.5 s. As in Example 1, here the performance of the proposed control system is compared with the other two methods, and the results are shown in Figure 10.   where and are the states of the system, is the input of the system (control signal), and is the system's output. This system (48) has three states, and the proposed control system has been able to converge all of them very well (Figure 8). Figure 8. The control signal generated by the proposed control system is shown in Figure 9.
As shown in Figure 9, the control signal converges the system in less than 1.5 s. As in Example 1, here the performance of the proposed control system is compared with the other two methods, and the results are shown in Figure 10.   As shown in Figure 9, the control signal converges the system in less than 1.5 s. As in Example 1, here the performance of the proposed control system is compared with the other two methods, and the results are shown in Figure 10. where and are the states of the system, is the input of the system (control signal), and is the system's output. This system (48) has three states, and the proposed control system has been able to converge all of them very well (Figure 8). Figure 8. The control signal generated by the proposed control system is shown in Figure 9.
As shown in Figure 9, the control signal converges the system in less than 1.5 s. As in Example 1, here the performance of the proposed control system is compared with the other two methods, and the results are shown in Figure 10.   It is seen in Figure 10 that the proposed control method (DSC based on a type-3 fuzzy system) manages and controls the system (48) in less than 0.5 s, while the RBFN-based method takes more than 1 s. The control signal of all three controllers for the aforementioned operation is shown in Figure 12.
As can be seen from Figures 8-12, the proposed control method has been able to handle a nonlinear and complex random system (48) well and control it in less than 1 s. Figure 10 shows that the DSC based on the type-3 fuzzy system touches the desired value for the first time in less than 0.1 s, and that the overshoot percentage is less than 6%. Additionally, Figure 11 shows a close view of Figure 10 when the step is applied. Figure 12, which shows the control signal of all three controllers, clearly shows the fast response of the proposed method with the lowest control cost. The swirling domain of the proposed controller control signal is much lower than the RBFN DSC and type-1 fuzzy DSC methods, and its response is about 0.6 s faster than other two mentioned methods.
fuzzy system) manages and controls the system (48) in less than 0.5 s, while the RBFN-based method takes more than 1 s. The control signal of all three controllers for the aforementioned operation is shown in Figure 12.
As can be seen from Figures 8-12, the proposed control method has been able to handle a nonlinear and complex random system (48) well and control it in less than 1 s. Figure 10 shows that the DSC based on the type-3 fuzzy system touches the desired value for the first time in less than 0.1 s, and that the overshoot percentage is less than 6%. Additionally, Figure 11 shows a close view of Figure 10 when the step is applied. Figure  12, which shows the control signal of all three controllers, clearly shows the fast response of the proposed method with the lowest control cost. The swirling domain of the proposed controller control signal is much lower than the RBFN DSC and type-1 fuzzy DSC methods, and its response is about 0.6 s faster than other two mentioned methods. Figure 11. A closer view of Figure 10.

Conclusions
In this paper, an innovative control method for stochastic nonlinear systems is presented. In this method, for the first time, a new type-3 fuzzy system in the framework of neural networks (commonly called a type-3 fuzzy neural network) was used to adjust the dynamic surface control method. The class of stochastic nonlinear systems was considered as strict feedback with Prandtl-Ishlinskii (PI) waste, which includes a wide range of real-world systems. The proposed control system was set up to detect changes in less than 1 s, and to generate the appropriate signal immediately. To evaluate the proposed method, two common and widely used systems are simulated, and the results show the high efficiency and accuracy of the proposed control system. Additionally, to compare with other methods, two methods (a type-1 fuzzy system and RBFN) were compared fuzzy system) manages and controls the system (48) in less than 0.5 s, while the RBFN-based method takes more than 1 s. The control signal of all three controllers for the aforementioned operation is shown in Figure 12.
As can be seen from Figures 8-12, the proposed control method has been able to handle a nonlinear and complex random system (48) well and control it in less than 1 s. Figure 10 shows that the DSC based on the type-3 fuzzy system touches the desired value for the first time in less than 0.1 s, and that the overshoot percentage is less than 6%. Additionally, Figure 11 shows a close view of Figure 10 when the step is applied. Figure  12, which shows the control signal of all three controllers, clearly shows the fast response of the proposed method with the lowest control cost. The swirling domain of the proposed controller control signal is much lower than the RBFN DSC and type-1 fuzzy DSC methods, and its response is about 0.6 s faster than other two mentioned methods. Figure 11. A closer view of Figure 10.

Conclusions
In this paper, an innovative control method for stochastic nonlinear systems is presented. In this method, for the first time, a new type-3 fuzzy system in the framework of neural networks (commonly called a type-3 fuzzy neural network) was used to adjust the dynamic surface control method. The class of stochastic nonlinear systems was considered as strict feedback with Prandtl-Ishlinskii (PI) waste, which includes a wide range of real-world systems. The proposed control system was set up to detect changes in less than 1 s, and to generate the appropriate signal immediately. To evaluate the proposed method, two common and widely used systems are simulated, and the results show the high efficiency and accuracy of the proposed control system. Additionally, to compare with other methods, two methods (a type-1 fuzzy system and RBFN) were compared

Conclusions
In this paper, an innovative control method for stochastic nonlinear systems is presented. In this method, for the first time, a new type-3 fuzzy system in the framework of neural networks (commonly called a type-3 fuzzy neural network) was used to adjust the dynamic surface control method. The class of stochastic nonlinear systems was considered as strict feedback with Prandtl-Ishlinskii (PI) waste, which includes a wide range of real-world systems. The proposed control system was set up to detect changes in less than 1 s, and to generate the appropriate signal immediately. To evaluate the proposed method, two common and widely used systems are simulated, and the results show the high efficiency and accuracy of the proposed control system. Additionally, to compare with other methods, two methods (a type-1 fuzzy system and RBFN) were compared with the proposed method, which testifies to the superiority of the proposed method both in terms of speed and accuracy and in terms of minimum control cost (minimum overshoot).   continue functions maximum u input of the system (control signal) y system's output π corresponding covariance matrices for θ