In this study, we combine the apparatus of Markov processes with similarity theory and criterion-based modeling to construct an integral quality index for ACS performance. Applying matrix polynomials to the transition rate matrix enables the derivation of normalized similarity criteria, while the subsequent application of geometric programming provides the means to evaluate relative quality variations without the explicit search for global optima. The objective of the article is to develop a methodology for forming an integral performance indicator and to demonstrate its applicability to ACS modernization decision making.
1.2. Similarity-Based Markov Process Modeling
Markov processes form the foundation of the proposed approach, enabling the formalization of the multistate behavior of automated control systems (ACS) in terms of transitions between states with associated intensities. Due to the memoryless property of Markov chains, the system can be represented by a compact generator matrix Q, which ensures mathematical rigor, the possibility of analytical solutions, and the applicability of numerical methods to complex structures. This representation makes it possible not only to determine the probabilities of the system being in nominal, degraded, or failed states but also to integrate additional quality criteria based on the similarity indices (πi), dual functionals (d*(p*)), and integral measures (S).
The potential applications of similarity-based modeling are multidimensional. First, it provides the basis for real-time diagnostics and maintenance decision making: transition intensities can be updated dynamically from telemetry and event streams, enabling the timely detection of degradations. Second, it supports the evaluation of modernization effectiveness in energy and industrial automation systems: by comparing relative variations in quality functionals, the most feasible modernization scenarios can be identified without exhaustive enumeration. Third, in the context of Smart Grids, Markov modeling enables adequate representation of complex failures and degradations in decentralized architectures, including the integration of renewable energy sources and storage systems.
A particularly important aspect is its application to the cyber-resilience of ACS. Degraded states of communications and sensing subsystems may result from both technical faults and external cyber attacks. To address this, the model incorporates additional transitions that capture such events, thereby allowing not only the monitoring of hardware reliability but also the formation of comprehensive resilience assessments against cyber threats.
Future development of the model may proceed in several directions. First, integrating semi-Markov processes (SMP) would allow for the representation of arbitrary sojourn-time distributions, bringing the model closer to real-life degradation and maintenance dynamics. Second, combining Markov decision processes (MDP) with reinforcement learning methods establishes a foundation for optimizing operational and maintenance strategies under cost, risk, and reliability criteria. Third, the application of multi-objective optimization and geometric programming opens pathways toward balanced policies that simultaneously minimize risk and cost while maintaining target readiness levels.
Thus, Markov process modeling in the ACS context emerges not only as an analytical tool but also as a conceptual foundation for developing adaptive, self-learning, and cyber-resilient control systems that meet the contemporary challenges of digitalization, decentralization, and energy transition.
The classical Kolmogorov system of equations is expressed as
where p(t) is the row vector of state probabilities, and Q is the generator matrix of the continuous-time Markov chain (CTMC).
Thus, as is well known, a Markov process is described by a system of differential equations [
3]:
where
p is the vector of state probabilities of the system under study;
ν is the matrix of transition probability densities between states; and m is the number of possible states of the system (see
Figure 1).
Analyzing the system of Equation (1), it is rather difficult to directly derive criteria that would fully satisfy the requirements. However, it can be employed to construct a similarity-based model, in which the properties, parameters, and variable values are proportional to the corresponding properties, parameters, and variables of the original system [
6].
For steady-state conditions of the system
can be rewritten as
where the elements of the matrix
are constant values representing algebraic sums of the transition intensities from state i to state j, and n denotes the number of outgoing transitions from the operational state 1 (see
Figure 1).
In a more general form, Equation (2) is written as
where p is the stationary distribution, and the matrix
ν from (1) is augmented by a row of m ones to enforce normalization.
To establish similarity, we construct a polynomial of the transition matrix
ν., analogous to the representation of any analytic function f(x) as a convergent polynomial expansion of a scalar variable x [
7]:
The function of a matrix
can likewise be expressed as a matrix polynomial, formally obtained by replacing the scalar variable x with the matrix X.
If an interpolation polynomial is employed, the transition matrix ν\nuν in Equation (3) can be transformed into a matrix polynomial [
7]. In this study, the transition to the matrix polynomial through the interpolation of the exponential
is carried out without explicit introduction of the time parameter t or spectral analysis of the generator matrix Q.
Generator matrix Q, by definition, has dimension 1/time, because its elements λij are intensities transitions;
All degrees Qj, which are included in the polynomial representation, store an agreed upon dimension, namely (1/time)j;
Function , which approximates the exponential reflection exp (Q), is dimensionless, because matrix e^{Qt} specifies matrix probabilities transitions and has the sum of the elements in the rows equal to one;
After normalization in expression (6), where all elements are divided by , obtained indices similarities become dimensionless and the condition guarantees their interpretation as agreed normalized weight coefficients.
As a result, coefficients aj and corresponding polynomial terms are derived, from which normalized similarity criteria πi are constructed under the imposed normalization condition . It should be emphasized, however, that in the present formulation it is not proven that the obtained quantities are dimensionless, invariant, or physically interpretable. From the standpoint of classical similarity theory, explicit construction of П-groups with dimensional consistency and independence checks would be required, which is not demonstrated in the proposed framework.
Reference to spectral Q representation:
The argument that everything and functions Q are given by polynomial interpolation, has an appearance as follows:
That is, keep property zero sum rows if
. It should be taken into account the clarification that the polynomial construction (5) approximates the exponent for which this property is proven.
This allows to formally justify statement about “non-violation of the characteristics of the i-generator matrices”.
If the minimal polynomial (in this case, the characteristic polynomial
) consists only of linear factors
, it is sufficient to evaluate the function
at the characteristic points
. In this case, the system of equations for the coefficients of the interpolation polynomial takes the form
or, the matrix form
By solving this system with respect to the coefficients
, we obtain a polynomial of the form
By applying this transformation, all properties and consequences of similarity theory can be utilized, since it does not violate the fundamental characteristics of the generator matrix. Specifically, it is based on the spectral representation of Q and preserves the normalization condition (row sums equal zero and diagonal entries are negative) [
6]. To derive the system of similarity criteria, we divide both the left- and right-hand sides of Equation (5) by
f(ν):
where
,
is the similarity criteria, defined through integral analogs.
Taking into account the introduced notation for the similarity criteria, Equation (6) can be rewritten as
where π
i represent the normalized similarity indices, each reflecting the relative contribution of the corresponding polynomial term.
Short spectral analysis matrix Q, showing that for the representation
any function
, in particular the one that used in (5)–(7), acquires the appearance
and therefore are normalized. The indices π
i depend only on the spectrum Λ, and not on the choice of basis. In addition, what normalization (6) will provide is
That is, π
i are normalized, dimensionless indices of the weight contribution of polynomial components, which reflect the structure of Markov chain transitions, are consistent with eigenvalues, and ensure invariance due to normalization.
In Equations (6) and (7), the values of the similarity criteria
πi are normalized. They represent the relative contribution of each term in Equation (5). This is equivalent to the probability of the system being in the i-th state within
f(ν), which characterizes the system as a whole. Analogously, in Equation (7), the probabilities of the system states p
i obtained in Equation (1) are also normalized. This analogy allows the application of the principles of the criterion-based method, enabling the transition from solving the system of Equation (2) to analyzing system performance through criterion-based dependencies, with the optimal control state adopted as the baseline [
6]. To achieve this, it is necessary to construct a criterion-based model of the Markov process.
Therefore, Equations (5)–(7) in the presented form should be interpreted primarily as a heuristic approach to normalization and ranking, rather than as a rigorous result of similarity theory. To strengthen the mathematical soundness of the formulation, it would be appropriate to complement the exposition with the spectral analysis of the generator matrix Q and explicit proofs of the invariance of the obtained similarity criteria.
1.3. Criterion-Based Model of the Markov Process
In practice, when the modernization problem of ACS is inherently multi-scenario and predominantly optimization-oriented, the obtained relation (7), which establishes similarity between Markov processes, is of limited applicability. In multi-scenario tasks, the evaluation of alternatives is typically carried out relative to a baseline scenario, which is characterized by a set of parameter values
fb,
x1b,
x2b, …,
xnb. These baseline parameters, similar to Equation (5), are linked by the condition
where
fb is the functional value of the baseline configuration, and
xjb denotes the baseline parameter values associated with the criterion model.
The similarity criteria for this case take the form
where x
jb is the baseline parameter values.
If we now divide both sides of Equation (5) term by
fb, and substitute into the right-hand side the baseline value
fb obtained from (8), we obtain the following criterion relation:
where a
j ≥ 0 and all variables are strictly positive.
We obtain the following criterion relation:
where
and
(all coefficients are non-negative, and the variables are positive).
This criterion model makes it possible to evaluate the relative changes in the functional quality index of an automated control system (ACS) when the parameters xj deviate from their baseline values xjb, including deviations from the optimal configuration. The advantage of this formulation is that it provides a sensitivity assessment of the optimal solutions with respect to parameter variations without the explicit need to compute global optima. As a result, the model can also serve as a basis for defining the relative criterion of ACS performance quality, which can subsequently be analyzed using the apparatus of geometric programming
The criterion model (9) makes it possible to determine the relative variations in f when the parameters x
j deviate from their baseline values, including deviations from the optimal configuration. In other words, relation (9) enables the sensitivity analysis of optimal solutions with respect to structural or parametric changes in ACS. Although such an assessment is relative in nature, its advantage lies in the fact that it can be obtained without explicitly determining the optimal parameter values of the system. The criterion model may also be employed to determine the relative value of the ACS performance quality criterion. For this purpose, the apparatus of geometric programming can be applied [
8,
9,
10].
1.4. Criterion of ACS Functional Quality
In geometric programming, the search for optimal solutions is based on the principle of duality, whereby the primal minimization problem is transformed into the corresponding maximization problem of the dual function [
8]. In our case, the dual function corresponding to the Markov process model takes the form
where
are the dual variables, interpreted as the probabilities of the system in a given state, both initially and after modernization.
It should be noted that model (9) essentially corresponds to the formulation of a geometric programming (GP) problem, where the baseline scenario serves as the normalization configuration, while the quantities marked with an asterisk represent relative parameter deviations. Although the explicit primal and dual formulations of GP are not presented in the exposition, it is important to recognize that (9) is consistent with the standard form of posynomial minimization under feasibility constraints. Consequently, the introduced dependencies preserve the properties of geometric convexity, which ensures both the existence and uniqueness of the optimum.
The dual function d
∗(p), presented in (10), is interpreted as a compact representation of the Lagrangian of the GP dual problem under the constraint p∈
, ∑
ip
i = 1. This implies that the feasible region of vector p is defined by the standard conditions of geometric programming, and therefore d
∗(p) constitutes a valid representation of the dual functional. The subsequent integration used to derive the integral performance criterion S
i is based on this feasible set and fully complies with the methodological requirements of geometric programming [
9,
10,
11,
12,
13,
14].
Normalized indice similarities πi pass directly in the criteria-balanced post-synonymous model (9), i.e., they determine contribution-relevant members in calculations’ target criterion.
After inclusion in the double function geometric programming (10), πi pass into the space variables pi, which are strictly defined in GP theory (requirements .
The permissible area of double GP problems is invariant to similar transformations and choice of basis; therefore, after normalization πi automatically acquires strict mathematical interpretations and property invariance.
Thus, even if the initial formation of π
i is based on an approximation matrix representation, its subsequent inclusion in the GP formalism translates the model into a fully defined, strictly mathematical area, which eliminates the mentioned theoretical weakness [
15].
Thus, Equations (9) and (10) are fully consistent with the classical foundations of GP and can be regarded as a generalized criterion, where the formal representation is complemented by convexity properties and a well-defined, feasible domain.
According to the derived performance evaluation model, the actual operational state of the system can be assessed relative to its initial configuration.
Figure 2 illustrates the corresponding dependencies. The shaded area represents the integral performance criterion, which characterizes the generalized functional readiness of the system to accomplish the prescribed tasks. The larger the area of the integral criterion, the higher the reliability and operational efficiency of the system.
Using the obtained results, the performance quality criterion can be determined. The integral performance criterion of the system is defined as the area S
i, which is bounded by the curve
and the straight line
:
The value of corresponds to the boundary of the control system performance, beyond which the system is either incapable of performing its functions or executes them with an accuracy that does not satisfy the requirements for achieving the desired output effect.
The larger the value of the quality criterion, the higher the functional readiness of the system. Moreover, by analyzing the values of S
i amid variations in the independent dual variables (i.e., the probabilities of the system being in operational states), one can derive conclusions regarding the strategy of further system development or the prospects for designing new systems [
9,
10,
11,
12,
13,
14,
16].
Figure 3 presents the architecture of the diagnostic–performance module integrated into the automated control system (ACS). The primary source of information is the telemetry database, which accumulates parameters from energy infrastructure objects [
16]. These data are transmitted to the KMC/similarity engine, which implements continuous-time Markov chains (CTMC) for modeling system states and assessing their similarity [
17,
18].
The computational cost of the proposed diagnostic module is primarily determined by the evaluation of the matrix polynomial f(Q). Updating the generator matrix requires O(m
2), while polynomial evaluation based on (5)–(7) has complexity O(k m
3), where k is the small, fixed degree of interpolation (typically k ≤ 5). The subsequent criterion evaluation (9) and computation of the dual GP function (10) add only O(k m) and O(m log(m)), respectively. Therefore, the overall complexity of one diagnostic cycle is O(m
3). Empirical tests (Python/NumPy, Version: NumPy 2.3.0. Released: 7 June 2025, BLAS acceleration) show that full computation requires <1 ms for m = 3–5 and ~5–6 ms for m = 10, which fully satisfies the real-time constraints of ACS/SCADA environments. The architecture in
Figure 3 supports asynchronous updates, and the system can run at frequencies up to 1–10 Hz, ensuring efficient integration with Smart Grid operational platforms [
9,
10,
19].
Subsequent processing is carried out in the criterion calculator, which generates normalized reliability and availability indicators. The quality evaluator integrates the results to construct the integral performance criterion of the ACS. Based on this criterion, the GP optimizer (geometric programming method) performs ranking and selection of optimal modernization strategies.
The computation results are transferred to external systems: SCADA/Smart Grid platforms, where real-time control actions are implemented, and the CMMS (Computerized Maintenance Management System), which provides maintenance planning. Such an architecture enables the integration of diagnostic algorithms into the production environment, thereby ensuring automated decision support within complex energy networks [
9,
10,
11,
12,
13,
14].
1.6. Energy Loss Calculation
We considered states S
1/S
2/S
3 with productivity of 100%, 80%, and 0%, respectively. Therefore, S(t) = D(t) [1⋅P(S
1) + 0.8⋅P(S
2) + 0⋅P(S
3)], and the difference D(t) − S(t) is integrated over time into the cumulative ENS (Energy Not Supplied) in the graph. This explains why during load disturbances (increased transitions from S
1→S
2, S
2→S
3), ENS increases most rapidly, as shown in
Figure 8.
As seen in
Figure 8, the total ENS (over 12 h) is primarily formed during the 240–300 min interval; the ENS during the disturbance accounts for approximately 12.5% of the total. After the overload is removed, the growth of ENS nearly halts, indicating the temporal localization of the losses.
Table 2 and
Table 3 show the summary metrics by interval and the estimated event frequency (averaged over runs)
Let us show the sensitivity of the ENS to the amplitude of the disturbance, in
Figure 9.
As shown in
Figure 9, the dependence of ENS on the disturbance amplitude exhibits a “knee” nearly 1.05× nominal: for 1.00× → ENS ≈ 7.674 MWh; 1.05 → ENS ≈ 10.491 MWh; 1.10 → ENS ≈ 10.445 MWh; and 1.20 → ENS ≈ 10.836 MWh. After exceeding 105%, the curve becomes significantly steeper due to the activation of increased transition intensities.
According to the calculations, abrupt load changes significantly increase the probability of transitions to degraded and failure states, as evidenced by the drop in availability A(t) and the concentration of energy losses (ENS) during the disturbance period. Controlled load reduction and limiting the amplitude to <105% of the nominal significantly reduce ENS. It is recommended to implement policies for pre-emptive load reduction, fast AR (automatic reconnection)/AFC (Automatic Frequency Control) schemes, and prioritization of recovery after periods of high disturbance.
The theoretical derivation of the similarity criteria π
i relies on the steady-state form of the CTMC to define the normalization properties and the structural characteristics of the generator matrix Q. In operational settings, however, the system is non-stationary and λ
ij(t) vary with load. In this case, the model employs a quasi-stationary approach: at each time step the instantaneous generator matrix Q(t) is substituted into the polynomial f(Q), and the normalized criteria π
i(t) and performance indicators are computed for that moment. Since load variations occur on a slower time scale than the analytical cycle, the instantaneous evaluation remains accurate and fully consistent with the mathematical framework established in
Section 2.
The quality performance criterion model based on Markov processes has been applied to distributed automated control systems for Smart Grid, where quality is presented as a Markov reward J = π·r, with π being the stationary (or quasi-stationary) state distribution, and r being the weight/utilization vector. The practical readiness indicator, A(t)= P(S1,t) + w2·P(S2,t), is consistent with SLO/SLA.
The non-homogeneity of the modes is reflected in the time-dependent intensities λ
ij(t), which increase upon exceeding the power threshold (~105% of nominal) and high rates of change (≥5%/min). This raises the probabilities of transitions S
1→S
2 and S
2→S
3. The model parameters are identified from operational logs (MLE:
ij = N
ij/T
i) with the construction of confidence intervals and regular re-estimation in sliding windows, suitable for online monitoring. Uncertainty and confidence are assessed through posterior simulations (gamma models), providing intervals for A and derivative metrics, thus enhancing the reliability of management decisions (maintenance, switching, and load limitation) [
20].
The data pipeline “OPC UA/REST → TimescaleDB/PostgreSQL → analytical service” supports real-time operation with end-to-end latency of 20–40 ms, while the analytical cycle (CTMC update, similarity indices, criterion computation, GP optimization) requires 1–6 ms, well within the typical SCADA/Smart Grid limits of 100–200 ms. Transition intensities λij are re-estimated from operational logs using a sliding time window, whose size depends on the dynamism of the node: 5–15 min (updated every 1–5 min) for nominal conditions and 1–3 min (updated every 20–60 s) during dynamic disturbances or overloads. This ensures statistically stable MLE estimates while maintaining rapid adaptation. The selected window sizes guarantee sufficient event counts for reliable estimation (≥30–50 nominal/degraded transitions, ≥5–10 failure transitions) and provides a practical guideline for real-world Smart Grid implementations.
Sensitivity analysis shows that the greatest impact on readiness during disturbances is exerted by λ12 and λ23 (degradation → failure); these should be limited by controlled load strategies and accelerated recovery.
Therefore, engineering actions should focus on minimizing ENS and stabilizing A(t), limiting disturbance amplitude to <105% of nominal, limiting the gradients of power change, applying preventive isolation/redistribution, and prioritizing recovery from S2 to S1.
The model is actively integrated into the ACS/SCADA system. It is embedded into OPC UA/REST → TimescaleDB/PostgreSQL → analytical service (π, A, ENS) → Grafana/SCADA-HMI, ensuring continuous quality assessment and automated threshold triggers. Moreover, this approach can be extended to multi-component nodes, it supports weights for degradation classes, and it has been expanded to semi-Markov models for long-tail durations.
When transition intensities depend on load, the generator matrix becomes time dependent, Q(t). The similarity criteria are then evaluated using a quasi-stationary approximation, where the instantaneous matrix Q(t) is substituted into the polynomial representation f(Q(t)) = ∑a
jQ(t)
j, yielding time-dependent normalized criteria π
i(t). This approximation is valid when the analytical cycle Δt is much smaller than the characteristic time of load variation. In Smart Grid applications Δt = 1–6 ms, while load dynamics occur over seconds to minutes, ensuring the time scale separation:
Thus, the steady-state theoretical constructs serve as normalization and structural foundations, while real-time operation is handled through a sequence of instantaneous evaluations of Q(t), enabling accurate diagnostics during dynamic disturbances.
Thus, the Markov process-based quality performance criterion model is a practically applicable tool for operational management and strategic planning: it transforms failure/recovery dynamics into transparent metrics (readiness, ENS) and provides verified foundations for decision making in load disturbance modes.