3.1. Input Data Analysis and Pre-Processing
To test the developed NFA modified closed onboard HTE ACS, including a controller, compensator, emulator, and observer unit, implemented in the six-layer NFN AFNN form, a computational experiment was carried out, for which a personal computer with a processor was used, i.e., AMD Ryzen 5 5600, 32 KB L3 cache, Zen 3 architecture, six cores, 12 threads, 3.5 GHz, RAM—32 GB DDR-4.
The data used to train the neural network include the HTE thermodynamic characteristics collected during flights, such as gas-generator rotor r.p.m.
nTC, free turbine rotor speed
nFT, and gas temperature in front of the compressor turbine
. The developed NFA modified closed onboard HTE ACS initial data were obtained from experimental research conducted on the TV3-117 engine (
Table 1) [
26,
27,
45,
46,
47].
The input data (the training set) pre-processing is given in [
26,
27,
45,
46,
47]. As part of the input data preliminary processing, it was proven that the training set is homogeneous according to the Fisher–Pearson [
48] and Fisher–Snedecor [
49] criteria, whose values were 3.588 and 1.28, respectively. The obtained values of these statistical criteria are less than their critical values (22.362 and 3.44, respectively), with 13 free powers and a 0.01 significance level. According to [
26,
27,
45,
46,
47], a control sample (67%) and a test sample (33%) were separated from the training sample (
Table 2), and this representativeness was confirmed by cluster analysis [
50,
51] using the
k-means method, during which the input data values were divided into eight classes and the metric distance between them was calculated as
, in which
μj are the initial centroids and
is the Euclidean distance between
xi and
μj (
Figure 5). In this case, the
μj values are recalculated as
, which is the number of objects in the
j-th cluster. Calculations of
Ci and
μj continued until changes in the cluster distribution became negligible.
Similar research was conducted, during which the following were separated from the training sample (
Table 2) and identified: a control sample (60%) and a test sample (40%); a control sample (50%) and a test sample (50%); a control sample (70%) and a test sample (30%). The obtained metric distance values with such combinations are 1.75…3.38 times greater than with the control sample (67%) and a test sample (33%). This indicates the optimal choice of control and test sample size.
Thus, the training sample elements’ preprocessing results made it possible to form the optimal training, control, and test sample sizes (
Table 2).
3.2. The Six-Layer NFN AFNN Training Results
In the NFN AFNN training process with the proposed algorithm (64)–(68), the values of the accuracy (Accuracy) (
Figure 6) and loss (Loss) (
Figure 7) functions were estimated for the training and validation samples; the blue curve indicates training results on the training set, and the orange curve indicates validation results on the control set.
The accuracy metric reflects the model effectiveness in determining the neuro-fuzzy HTE ACS parameters, showing the percentage of correctly calculated parameters. In turn, the loss function demonstrates the degree to which the model’s predictions deviate from the actual values, which helps optimize the training process by reducing this loss. By analyzing the resulting diagrams of the accuracy (Accuracy) (
Figure 6) and loss (Loss) (
Figure 7) functions during the training process, conclusions are drawn about how effectively the model is trained, and measures are taken to improve its performance.
According to
Figure 6, almost maximum accuracy has been achieved, and according to
Figure 7, the loss value does not exceed 0.025, which indicates the model’s high training efficiency on available data and its ability to accurately generalize to new data.
It is worth noting that for a bell-shaped membership function with 60 iterations, the value of the accuracy metric reaches 0.9998 (99.98%), and the value of the loss function does not exceed 0.0002 (0.2%), which indicates the high efficiency and accuracy of the AFNN network when using the bell-shaped function accessories. The results obtained indicate the successful training of the neuro-fuzzy AFNN network, with good convergence and minimal error, which emphasizes the importance of correct membership function choice in the design process of a neuro-fuzzy HTE ACS. At the same time, the loss values in both samples do not exceed 0.025 (or 2.5%), which indicates a low level of error in determining the neuro-fuzzy HTE ACS parameters. Such results indicate the successful training of the AFNN network with the proposed algorithm and its ability to provide the neuro-fuzzy HTE ACS accurate parameters with a high degree of confidence.
Determining confidence in the context of machine learning and neural network models typically involves assessing likelihood or the model’s confidence in its predictions. Depending on the type of model (e.g., classification or regression), the confidence degree can be expressed differently [
52]. This work uses a method for assessing the AFNN network’s confidence which consists of using maximum probability. For classification problems, a softmax function is often used to determine the membership probabilities in each class. After model training, having received the prediction
for input data
x, we can obtain the probability
belonging to the
k-th class using softmax:
where
is the model outputs vector before applying softmax for input
x,
is the vector
k-th element, and
K is the class number.
Figure 8 shows a diagram of the maximum probability (Max Probability Estimation) for the AFNN network “degree of confidence”, which shows how the AFNN network confidence in obtaining the neuro-fuzzy HTE ACS parameters is distributed: (a) is the
nTC parameter, (b) is the
nFT parameter, and (c) is the
parameter.
Table 3 presents the comparative analysis results of the accuracy metric and the loss function calculations when using various membership functions in the AFNN network training process using the proposed algorithm (64)–(68).
In the process of training the NFN AFNN, similarly to [
28,
29], the bell-shaped membership function (
Table 4) parameters were updated using an adaptive training rate according to the expressions:
where
ηt is the current adaptive training rate at the
t-th step.
The quality of the bell-shaped function parameters calculating
and
according to (74) using the adaptive training rate in comparison with the expressions
,
, applied in [
28], was estimated by the values of RMSE (square root of root mean square error), MAE (mean absolute error), and MAPE (average absolute percentage error):
where
n is the number of obtained values
and
,
and
are actual values of
i-th parameters
and
, and
and
are the calculated NFN (AFNN in this work, ANFIS in [
28])values of
i-th parameters
and
.
Table 5 shows the calculated RMSE, MAE, and MAPE value results for the bell-shaped membership function parameters
and
.
Table 4 shows that for
the RMSE value is 0.0524, MAE is 0.0537, and MAPE is 5.0011% when applying (74). At the same time, the RMSE value is 0.0765, MAE is 0.0816, and MAPE is 7.6516% when applying the expressions from [
28],
,
. Similarly, for
RMSE is 0.0521, MAE is 0.0536, and MAPE is 5.0008%, and when using expressions from [
28], RMSE is 0.0761, MAE is 0.0815, and MAPE is 7.6512%. Thus, the results obtained indicate a decrease in the RMSE, MAE, and MAPE values for the bell-shaped membership function parameters
and
by 1.46, 1.52, and 1.53, respectively, when applying (74), adaptive speed training, compared with [
28].
Thus, the work experimentally confirmed the feasibility of an adaptive training rate for introducing the NFN AFNN.
The obtained results of bell-shaped function parameters
and
made it possible to graphically represent the bell-shaped membership function appearance.
Figure 9a shows the bell-shaped membership function appearance before training the AFNN NFN using the initial parameters
and
, and
Figure 9b shows the same after training the NFN AFNN with refined parameters
and
. The refinement of parameters
and
of the bell-shaped membership function is justified by “fine-tuning” the fuzzy model of the research object, an NFA modified closed onboard HTE ACS. After parameter optimization, the bell-shaped membership function underwent changes, resulting in a more accurate fit to system data. These changes improved control quality by adapting the function to the controlled object (HTE) specifics.
3.3. Computational Experiment Results
During the next phase of the computational test, the neuro-fuzzy HTE ACS parameters, which are based on a six-layer neuro-fuzzy AFNN network, were directly determined. As a result of modeling changes in the HTE thermogas-dynamic characteristics according to the training sample data (
Table 1) at various moments of model time (from 0 to 5 s), the conclusions are shown in
Figure 10, where (a) means the change in
nTC, (b) means the change in
, and (c) means
nFT. The orange curve represents experimental data on TDP recorded on board a helicopter, while the blue curve shows the model values of these parameters after correction using a reconfigured helicopter TE ACS [
28], and the black curve shows the model values of these parameters after correction using the proposed neuro-fuzzy HTE ACS (
Figure 2).
To confirm the obtained curves’ adequacy as a result of modeling, the study used the determination coefficient R2 as a statistical criterion for comparing the curves. This criterion evaluates the degree of agreement between model (blue curve and black curve) and experimental data (orange curve); a value close to 1 indicates a good fit of model data.
The percentage deviation from the experimental curve can be calculated as the ratio of the difference between the model curve values and the experimental curve to the experimental curve value, multiplied by 100%, according to the expression:
where
xi is the
i-th point on the model curves (blue curve and black curve), and
is the
i-th point on the experimental curve (orange curve).
To calculate the determination coefficient
R2, 50 points were taken on the model and experimental curves with a uniform step of 0.1 s. The determination coefficient for the blue curve obtained using a reconfigured HTE ACS [
28] was 0.916, and for the black curve obtained using the proposed neuro-fuzzy HTE ACS (
Figure 2)—0.982. Thus, the value of the determination coefficient for the proposed neuro-fuzzy HTE ACS (
Figure 2) is 1.07 times higher than the value of the determination coefficient for the reconfigured HTE ACS [
28], which indicates better adequacy and accuracy of the proposed HTE ACS.
The change in residuals after regulation
ε(
t) =
x1(
t) +
x2(
t) +
x3(
t) −
y(
t) remains within the HTE TDP permissible deviation, not exceeding 0.004. These parameter dynamics, shown in
Figure 11 after regulating
ε(
t), demonstrate the control stability, where the
ε(
t) value tends to zero.
At the computational experiment’s next stage, the fuel consumption parameter
GT was determined (in absolute units) for various control types (
Figure 12, where the blue curve shows the reference value of fuel consumption
GT (step action) and the orange curve shows the fuel consumption
GT real value), while, similarly to [
28], it was assumed that the fuel consumption parameter
GT reference signal has a rectangular pulse form, that is, a step change in the required fuel consumption
GT.
From the presented transient control process analysis diagram (
Figure 12), it is clear that the control quality (measured by the duration of the transient process and the maximum deviation of the controlled value) when using traditional (
Figure 12a), fuzzy (
Figure 12b), and neuro-fuzzy (
Figure 12c) control types are approximately the same. At the same time, when using neuro-fuzzy control using the proposed neuro-fuzzy HTE ACS (
Figure 12d), the transient process duration and the controlled value
GT maximum deviation are reduced by an average of 15…20% compared with the above-presented control types. The role of a compensator in neuro-fuzzy control lies in its ability to effectively compensate for uncertainties and disturbances in the ACS. The compensator predicts and corrects the influence of external factors, which allows the system to respond faster and more accurately to changing conditions, which ultimately led to an improvement in the control quality, with a reduction in the duration of the transient process and a reduction in the controlled value
GT by 15…20% maximum deviation.
At the computational experiment’s next stage, detailed research on the fuel consumption
GT parameter transition process section is carried out—from 20 to 100 s (
Figure 12), where the orange curve is the fuel consumption
GT real value, the black curve shows the transition process for precise control (traditional ACS), the blue curve shows the transition process for fuzzy control, the red curve shows the transition process for neuro-fuzzy control using a reconfigured ACS [
28], and the green curve shows the transition process for neuro-fuzzy control using the proposed neuro-fuzzy HTE ACS.
To achieve the ACS stable operation, as well as to fulfill the transient processes’ specified quality indicators, according to [
28,
53,
54,
55], the synthesized system parameters’ quantities under consideration of dependence are studied:
where
q1,…,
qi are the quality indicators of the transient processes under consideration; {
ki}, {
τi}, {
Ti} are the variable system parameter (gain factors, time constants, etc.) sets;
f1(•), …,
fi(•) are the functions expressing the system quality indicators’ dependence on the synthesized controllers parameters.
If we take overshoot and subsystem regulation time as the main indicators of system quality, then the system of Equation (79) takes the form:
where
σ1,…,
σi is the overshoot, and
treg1,…,
treg_i is the subsystems transient processes regulation time.
To determine the subsystems transient processes regulation time according to the transient process diagram (
Figure 13), at the initial stage the establishment moment is determined, which indicates the time moment when the output quantity (controlled quantity) approximately stabilizes in the vicinity of the steady-state value. Next is the first point on the diagram (
t1), at which the controlled value enters the vicinity of the steady value and remains in this vicinity further. Next is the last point on the diagram (
t2), at which the controlled value leaves the steady value’s vicinity and no longer returns to this vicinity. The regulation time
treg is defined as the difference between
t2 and
t1, that is:
Table 6 presents the transient process control time calculation results. As can be seen from
Table 6, use of the proposed neuro-fuzzy helicopter TE ACS (
Figure 2) made it possible to reduce the fuel consumption parameter
GT transient process time by 15.0 times compared with the traditional ACS (precise control) use, by 17.5 times compared with the fuzzy ACS (fuzzy control) use, and 11.25 times compared with the neuro-fuzzy reconfigured ACS [
28] use.
The role of the compensator, controller, and emulator in reducing transient control time is to effectively control the system while compensating for disturbances, adapting to changing conditions, and accurately emulating the desired behavior. The compensator in the proposed neuro-fuzzy HTE ACS (
Figure 2) allows us to quickly adjust actions to minimize the external factors’ impact, and the controller is able to adapt to changes, providing stable and accurate control. The emulator provides modeling of the system-required behavior, and together these can significantly reduce the time to achieve a transient process steady state compared to traditional control methods.
At the computational experiment’s next stage, using the transition process diagram (
Figure 13), the following quality indicators for ACS were determined:
Overshoot (overload) is the controlled value (fuel consumption parameter
GT) maximum excess relative to its steady value during the transition to a new state, determined according to the expression:
where
GTmax is the controlled variable (fuel consumption parameter
GT) maximum value during the transition process, and
GTst is the steady-state value (target value).
The steady-state value (stationary deviation) is defined as the difference between the controlled variable (the target value of the fuel consumption parameter
GT) steady-state value and its value after the transient process completion. This indicator allows us to evaluate the system deviation degree from the desired state after stabilization and is calculated according to the expression:
where
GT(
t) is the controlled variable (fuel consumption parameter
GT) value at some point in time
t after the transition process completion.
The transient process time is defined as the time during which the controlled value (fuel consumption parameter
GT) reaches a certain percentage deviation from the steady-state value after a regime violation. The time of the transient process is measured from the moment the control action begins to change until the moment when the controlled value (system output) approaches the steady-state value, and is calculated as:
where
t1 is the point in time when the controlled variable (fuel consumption parameter
GT) first reaches or enters a given vicinity (
p, %) of the steady-state value
GTst, and
t2 is the point in time when the controlled variable (fuel consumption parameter
GT) returns to the same neighborhood and is close to the steady-state value after the transition.
Table 7 presents the calculated values for overregulation (overload), steady-state value (stationary deviation), and the transition process time for precise control, fuzzy control, neuro-fuzzy control using a reconfigured ACS [
28], and neuro-fuzzy control using the proposed neuro-fuzzy HTE ACS.
Table 7 shows that the use of the proposed neuro-fuzzy helicopter TE ACS (
Figure 2) made it possible to achieve an improvement in the fuel consumption parameter
GT control quality compared with clear control, fuzzy control, and neuro-fuzzy control using a reconfigured ACS [
28], in terms of overshoot indicators (overload), steady-state value (stationary deviation), and transient process time by 1.45…7.77 times. At the same time, the compensator in the proposed neuro-fuzzy HTE ACS (
Figure 2) plays a role in taking into account and compensating for disturbances and uncertainties, which helps reduce overshoot and steady-state deviation. The controller provides adaptive control, optimizing parameters in real time and ensuring fast and accurate response to changes. The emulator simulates the system desired behavior, which helps improve control efficiency and achieve better-quality indicators compared to more traditional control methods. These elements together allow the proposed neuro-fuzzy HTE ACS (
Figure 2) to achieve significant improvements in overshoot, steady-state deviation, and transient process time compared to other control types.
At the computational experiment’s final stage, the proposed neuro-fuzzy HTE ACS stability is determined (
Figure 2) using the transition process diagram (
Figure 12, red curve). The use of a stability criterion, such as the Lyapunov method, allows one to assess the dynamic system stability and identify the conditions under which the system remains stable over time. To use the Lyapunov method, according to the transition process (
Figure 13) diagram, the Lyapunov function
V(
x) is determined, where
x is the system state vector, which must be positive definite and continuous. Next, the derivative of the Lyapunov function with respect to time
for the system is calculated using the system dynamics equation. That is, for a system with a differential equation
,
The system is considered asymptotically stable if derivative (85) is negative definite (or not positive definite) in some region x.
According to
Figure 13, the approximated curve corresponding to the fuel consumption parameter
GT transient process for the proposed neuro-fuzzy HTE ACS (
Figure 2) has the form:
It is known that the Lyapunov function
V(
t) must be positive definite. Therefore, the work proposes the use of the Lyapunov function
V(
t) =
t2, which is positive for all
t ≠ 0. To calculate the time derivative of the Lyapunov function
, we use the system dynamic equation
(86). The derivative of the Lyapunov function with respect to time is calculated as:
For the chosen Lyapunov function,
V(
t) =
t2 . Then
The system will be asymptotically stable if is negative definite (or not positive definite). To do this, we investigated the behavior of this expression for different t values:
At t = 0 .
For large positive t (for example, t > 1.22): the leading term –0.0934 · t4 dominates and .
At t < 0, the leading term –0.0934 · t4 also dominates and .
Therefore, when analyzing the Lyapunov function derivative, we see that for all t values (except t = 0), the polynomial dominates the leading term, which makes negative definite. Thus, we can conclude that the system is asymptotically stable.
Based on the proposed neuro-fuzzy HTE (
Figure 2) stability analysis results, using the Lyapunov method, it was established that the system is asymptotically stable. The derivative of the Lyapunov function with respect to time
for a given system is negative definite, with the exception of the moment of time
t = 0. At the moment
t = 0, the Lyapunov function derivative with respect to time
, which means that the system is in an equilibrium state. In this state, if the system is not subject to external disturbances or the initial conditions do not throw it out of equilibrium, then it will remain in this state. It is important to note that
indicates a point where the system does not change its state, which is a sign of stability. However, to confirm asymptotic stability, it is necessary that, near this state,
be negatively defined, which is confirmed in this case for all values of
t except
t = 0. Thus, at the slightest deviation from the equilibrium point, the system will return to it, which ensures its stability over time.