3. The Proposed Method
According to the analysis in the previous section, solving
is extremely hard due to the extremely complex constraints, and the increase in
and
leads to an NP-hard problem. As shown in
Figure 3, first, a multipart graph model is established, and the generation of the diagnosis strategy is described as a recursive process of
calls, from faults subsets to an entire set. The recursive function consists of a deterministic combination and a nondeterministic elimination. Based on this model,
is transformed into a FEVP for the elimination. As the elimination is only a part of the recursive function and has no constraints, the difficulty of solving this FEVP is much lower, and it is less affected by
and
.
This FEVP is relatively simple and different from typical common extremum problems [
36]. The objective function is recursive and there is no analytical requirement for the unknown function. Therefore, an ENI structure is proposed to solve the optimal elimination function, which includes three parts: a score function, retention, and criterion. The score function is used to grade each element in the set to be eliminated based on their features. Retention refers to retaining elements with higher scores based on a ratio matrix
. The criterion
refers to the condition in which elimination is needed.
and
are estimated by the multipartite graph model. A neural network
is used to fit the score function, and the optimal
are trained through an intelligent algorithm. Unlike in general optimization problems, the decision variables of the ENI are the parameters of the neural network and do not participate directly in the calculation of the fitness function. In addition, since
is used only to fit the score function and an intelligent algorithm is used only to optimize
and
, they are not limited to a specific intelligent algorithm [
37] or a neural network structure [
38]. For different
, the generation methods of their diagnosis strategies are consistent, so a converged
can be trained through a sufficient
, and the obtained
can be applied to another
.
3.1. The Multipartite Graph Model
A multipartite graph model is established and it includes and two actions .
represents a fault subset of
with a size
, satisfying
. The reasonability criterion sequence
is a vector of
with dimensions
, whose j-th element satisfies
where
refers to the irrelevant term. If
satisfies
,
can be isolated from
through a finite number of tests;
is reasonable and may become part of the optimal diagnosis strategy, denoted by
.
According to
, all
s are reasonable and satisfy
.
refers to the sum of prior probabilities of all faults in
, namely,
.
represents the minimum cost required to isolate all elements in
, specifically,
and
.
refers to the set composed of all
. Specifically,
,
and
.
is eliminated to
after
is generated,
is eliminated to
after
is generated, and
is ultimately eliminated, where
represents the result of
being eliminated for the U-th time. The family of sets
is defined as
.
represents a combination action, which refers to the process in which
combines all elements in
and
,
and
, …,
and
(taking
as an odd number) and generate
. If
and
are disjoint fault subsets and
meets
then
exists, and
and
constitute a coupling of
. The cost of this coupling is
If the cost of this coupling is the least among all couplings, there is an edge between
and
and an edge between
and
; then,
. Considering
as a vertex in a graph,
is a vertex set and
constitute an
-partite graph [
30]. As shown in
Figure 4, edges and couplings exist only in different partite graphs. So
is a certain process selecting edges from all couplings according to
and
; that is,
represents an elimination action, which refers to the process that eliminates all sets of
and obtains a new family of sets
. Due to the uncertainty of the elimination method,
is an uncertain process, that is,
refers to the number of edges directing to
and satisfies:
refers to the number of couplings directing to
and indicates the number of combinations constituting
is the total number of couplings directing to
.
and
refer to the number of edges and couplings of
directing to
. The reduced
in
Figure 1 is taken as an example. As shown in
Figure 5,
can be composed of three combinations. Since the reasonability criterion sequence of
is
there is no
for
to meet
, so
does not satisfy
.
has only two couplings:
and
.
are 2.66 and 2.39 according to
, so there is an edge between
and
and an edge between
and
.
is used to represent the set consisting of all
that belong to the optimum diagnosis strategy. If
can be expanded by a test, its subsets are denoted as
.
where
refers to the expected number of
generated by expanding
, specifically,
.
is expanded into two subsets each time, so
. Generally,
is independent, so
Then, fault expansion can be represented in polynomial form by
; if
is expanded by
tests,
where
where
refers to all the combinations that meet
and
. Completely isolating
into
requires at most
iterations. For different
and
, each
is independent,
Therefore, the expected number of
can be estimated as
. Taking an example of
, the estimation values of
are shown in
Table 1. According to the above analysis, it can be inferred that
is extremely small, so the vast majority of
s do not participate in constructing the optimal diagnosis strategy. By eliminating these
properly and reasonably, many redundant operations can be reduced while minimizing the cost of the generated diagnosis strategy.
3.2. Transformation to an FEVP
As shown in
Figure 6, based on
and
, the generation of a diagnosis strategy is equated to a state transition process whose transition action includes combination and elimination.
has two states,
, where
indicates that the elements belonging to the optimum diagnosis strategy of
have not been mistakenly eliminated, namely,
, and
are the opposite state to
.
also has two states:
, where
represents
and
is the opposite state to
.
is the state transition matrix of the four states, where
refers to the probability of
transferring to
. The state can only transfer between
and
, so
. Based on the deterministic combination, if the elements in
are mistakenly eliminated, the father node
of
cannot be generated. Therefore,
and
and
and
are two probabilities affected by
According to
, the optimal solution cannot be obtained once the state transfers to
or
. The ideal
meets
and can eliminate all the redundant
s and retain all the elements of
, making the calculation speed extremely fast and
optimal. Therefore, the generation of a diagnosis strategy can be described as a recursive process of
calls, and the original optimization problem
is transformed into an FEVP:
The objective function of is recursive and the unknown function is a nondeterministic elimination. Because the elimination is only a part of the objective function and has no constraints, is easier to solve.
3.3. ENI Structure
An ENI structure is proposed to determine the optimal
, as shown in
Figure 7,
is described by
and
. When the elimination criterion
is in effect, all
s of
are scored according to
and those with higher scores are retained, with a retention ratio
, that is:
A neural network is used to fit the score function of
. The input features are the knowledge of
and
, including
and the prediction cost of
(obtained through the greedy algorithm based on an entropy heuristic function [
18]). The fitness value
of the current score function can be obtained based on the multipartite graph model. Initially,
and
are random, so the score function is unreasonable and leads to a high
. Then,
and
are optimized continuously by the update method based on an intelligent algorithm. Finally, a score function that can generate a lower
is trained. For different
, the generation methods of their fault subsets according to
and the calculations of their fitness values according to
are consistent, so
trained on one
can be transferred to another
to continue training until
converges. A sufficient number of
matrices are used for training, and the well-trained
, i.e., the optimized
, can be applied to other
.
It should be noted that are not trained by standard gradient descent, because the fitness function of ENI is not differentiable with respect to ANN parameters. After outputs the scores of all , the following ranking, retention, elimination, and multipartite-graph reconstruction are all discrete operations. As a result, the mapping from to is nonanalytic and nondifferentiable, so backpropagation cannot be directly applied. Therefore, is used to fit the scoring function, while intelligent algorithms are adopted for parameter optimization under the final diagnosis-cost objective.
To avoid ambiguity, the input of the ANN is not the raw dependency matrix itself. Instead, for each candidate fault subset to be evaluated during elimination, a fixed-length feature vector is constructed from aggregated statistical features derived from the current subset and its diagnostic context. Therefore, the input dimension of the ANN remains constant and is fully decoupled from the system scale . In other words, the ANN does not learn a direct mapping from a variable-sized matrix to an elimination decision; rather, it learns a mapping from a scale-invariant statistical representation of a candidate subset to its elimination score. This provides the mathematical basis for the transferability of the ENI structure across different problem sizes.
3.4. Training and Convergence of
For any
and
, the statistics and operation methods of the features are consistent when
is eliminated; therefore,
uses the same neural network
. The
training process is stated in Algorithm 1.
| Algorithm 1 The training process |
| 1 | Select any intelligent algorithm and neural network structure. |
| 2 | Set the number of particles and the number of iterations as and . |
| 3 | Initialize and , where and represent the weight of the neural network for the -th particle. Randomly generate one . |
| 4 | for do |
| 5 | | Update and using intelligent algorithms. |
| 6 | | for do |
| 7 | | | Use to calculate of based on and . |
| 8 | | end |
| 9 | | Update and using the intelligent algorithms based on of all particles. Record the smallest in this iteration as . |
| 10 | end |
If
, this indicates that training on this
did not improve
or
. If this situation occurs continuously on ten
, then
and
have converged, and
3.5. Estimation of
To quantify the proportion of elimination, the retention ratio
(an upper triangular matrix) is defined, where
represents that the proportion of elimination is
when eliminating
. Ideally, the final retention of
is
. Considering the errors caused by the estimation and fitting function, the actual retention is
times that of
; that is,
The value of
is discussed in Experiment 1. If no elimination is implemented, the probability of taking each value for
of any
is:
According to
and
, if
exists and all the non
terms of
are the same as
, then
cannot meet the reasonability criterion. Therefore, the scale of
without elimination (
) can be estimated as follows:
According to
, the number of couplings
generated by
or
is estimated as follows:
where
refers to the probability that
and
are disjointed and
refers to the probability that
. If the elimination is implemented,
is separated into
and
, and the probability that both are reasonable is
.
and
, respectively, have
and
combinations. If all the separating forms of
are unreasonable, then
is unreasonable. Thus,
can be estimated as the product of combination type
and the probability of reasonability.
Corresponding to
, the number of couplings
generated by
or
is estimated as follows:
To minimize the change in combination type caused by elimination, the proportion of the combination form of
and
must remain unchanged; that is, for
,
where
is a constant. According to
,
and
,
Therefore, is any feasible solution that satisfies and .
3.6. Determination of
Eliminating
can reduce the time required for diagnosis strategy generation based on the multipartite graph model. However, the steps required for
, including calculating the statistics of the features, scoring each
by
and sorting, increase the operation time. It is necessary to analyze whether eliminating
would be beneficial for improving operation efficiency after
is generated. According to
,
, so the time needed to generate
is:
where
refers to the time required to generate a coupling. If elimination is not executed,
. If elimination is executed,
.
is the difference between the two results calculated based on
and refers to the temporal benefit of elimination.
is used to indicate the time needed to eliminate
, which is proportional to the number of all fault subsets contained in
:
where
refers to the time required for
to be scored by a neural network and sorted.
is related to
and obtained through Monte Carlo simulation, as shown in
Table 2.
Therefore, the criterion for eliminating the virus was . If the criterion loses efficacy after is generated, then . After is generated, the number of sets to be generated is reduced, so . Moreover, as the number of generated sets increases, . Thus, , and each fault set will no longer be eliminated after the criterion loses efficacy.
3.7. Computational Complexity Analysis
To provide a more rigorous quantitative comparison, the computational complexity of the proposed method is analyzed from the two actions in the multipartite graph model, namely, combination
and elimination
. Let
denote the total number of candidate subsets involved when generating the (k)-th layer. In the combination stage, all candidate couplings between
and
must be checked according to
, and their costs must be evaluated according to
. Therefore, the complexity of
at layer
is
After
is generated, the elimination action
computes the features of all subsets in
, scores them by ANN, and sorts them for retention. If the forward complexity of ANN is denoted by
, then the complexity of
at layer
is
Accordingly, the total complexity of one strategy-generation process is
If no elimination is performed, i.e., all subsets are retained, then
, and the dominant term degenerates to
Therefore, the main contribution of ENI is to reduce to , so that the dominant coupling-enumeration term is significantly compressed in subsequent layers. Although introduces additional scoring and sorting overhead, this extra cost is much smaller than the reduction in redundant couplings for large-scale systems.
4. Experiments
To verify the effectiveness of the proposed method, we use a sufficient
of different sizes as the training set until
converges, and the trained
are applied to three experiments. Experiment 1 simulates the impact of
. Experiment 2 compared the results of the proposed method with those of existing algorithms at different scales. The performances of different combinations of neural network structures and intelligent algorithms on the ENI are also discussed. Experiment 3 selected two typical complex circuit systems as real cases (a control moment gyro system [
20] and a two-channel multiple-input multiple-output (MIMO) terminal system).
Four comparative algorithms are selected, and their parameters are adjusted to the best values. The population size and number of iterations of the QGA [
20] and HPSO [
22] are 200 and 200, respectively, and both of their mutation rates are less than 5%. The third and fourth algorithms selected are the Growing [
26] and Hybrid [
28] algorithms, respectively. The
used in Experiments 1 and 2 were randomly generated according to
, with
and
following a uniform distribution from 0 to 2 and a normalized uniform distribution from 0 to 1. The software used for the experiments was MATLAB2022b in Windows 11, and the processor used was an AMD R9 CPU @ 2.50 GHz.
4.1. Sensitivity Analysis
The cost of the generated strategy is related to and when applying the trained to test samples.
When is small, there may be errors in the estimation of , resulting in unreasonable elimination of , and the reserved fault set cannot be used to generate . When gradually increases to a certain value to meet , a better test cost can be generated (denoted as cost convergence). If continues to increase, the additional retained does not participate in constructing the optimal diagnosis strategy, meaning that remains almost unchanged and that the cost remains largely unchanged.
In addition to , another practical parameter is introduced in the implementation of the baseline GA strategy generator, namely the proportional factor , which controls the optimization budget by setting the iteration number and population size as . Since the system scale increases with , using instead of directly assigning fixed values to and provides a normalized way to compare different scales under comparable computational intensity.
For sensitivity analysis of
, 10 samples for each scale range from
to
are randomly generated. Then, the number of converged samples among 10 random samples is counted, and the average computation time is recorded for different
s. The results are shown in
Figure 8 and
Figure 9.
For sensitivity analysis of
, 10 samples for each scale range from
to
are randomly generated. The average cost was calculated over 10 randomly generated samples. Then, for each fixed system scale, the value of
at which the cost tended to converge as
varied was identified, and the corresponding convergence point was marked in black. And the average computation time is recorded for different
s. The results are shown in
Figure 10 and
Figure 11.
The larger the system scale is, the larger its corresponding . Due to the randomness of intelligent algorithms, there is a small deviation between the trained and the ideal , which increases the difficulty of retaining . Therefore, a greater is required to converge, and the computation time also increases.
When is too small, the search space cannot be explored sufficiently, and the generated diagnosis strategy is likely to have a relatively high cost. As increases, the search becomes more adequate, and the diagnosis cost decreases accordingly. However, when exceeds a certain range, the improvement in cost becomes marginal. In the experiments, it was observed that when is around 0.5, the cost tends to become nearly stable for most scales.
4.2. Performance Differences of Algorithms at Different Scales
Ten samples at each scale are generated and the average computation time and expected cost of the proposed method with those of existing algorithms are compared. To analyze the impact of the neural network and intelligence algorithm on the ENI, three neural network structures are selected: a multilayer perceptron (MLP) with one or two hidden layers and a long short-term memory (LSTM) network. Three intelligent algorithms are selected: particle swarm optimization (PSO), the genetic algorithm (GA), and the cuckoo bird algorithm (CS).
is set based on the results of Experiment 1 while considering both computation time and convergence. The experimental results for the 9 ENIs and comparative algorithms are shown in
Table 3 and
Table 4, where the cost of PSO_MLP1 is given in units of “1”.
Due to the long computation time, Hybrid is almost impossible to carry out on a scale greater than . In terms of cost, the proposed method and Hybrid method yield lower costs at all scales, and our method outperforms the other methods. At 80 × 80, the test cost is only 69.4% of the Growing algorithm. In terms of time, the Growing algorithm has the shortest time, and the proposed method is shorter than the QGA, HPSO, and Hybrid algorithms at small to medium scales. As the scale increases, the computation time of the proposed method can reach 97 s at , which is shorter than that of the Hybrid. However, since the diagnosis strategy is generated during the design phase and does not have real-time requirements, 97 s is acceptable. In addition, any neural network structure has the ability to fit the score function theoretically, and its parameters are optimized by intelligent algorithms; thus, the optimization ability of these ENIs is the same. The complex structure will expand the optimized decision space, so MLP2 and LSTM will slightly increase the computational time, but the costs are almost the same.
To clarify the robustness of the proposed ENI structure, three aspects should be emphasized. First, ENI does not operate directly on the raw dependency matrix . Instead, it learns a scoring function from fixed-dimensional aggregated features extracted from the current candidate fault subset. Therefore, the input dimension of the network is decoupled from the system scale , and the statistical meaning of the input remains consistent across different problem sizes. This scale-decoupled representation improves the stability when it is transferred across different dependency matrices. Second, the role of ENI is not to generate a complete diagnosis strategy directly, but to rank candidate fault subsets. As a result, ENI mainly needs to preserve a reliable relative ordering among candidate subsets, rather than predict an exact physical quantity, which reduces the sensitivity of the final strategy cost to fluctuations in network architecture and initialization. Third, the neural network and the intelligent algorithm play different roles in ENI: the former approximates the scoring function, whereas the latter searches for favorable parameters under a non-differentiable objective. This separation makes the ENI framework compatible with different neural-network structures and different intelligent algorithms.
The hyperparameter selection is also not arbitrary, but consistent with the functional decomposition of ENI. For the neural network, the input is a low-dimensional statistical feature vector, and the task is to learn a coarse-grained priority score for candidate subsets. Therefore, a shallow MLP is already expressive enough for this purpose. More complex architectures enlarge the parameter space, but do not necessarily improve the final diagnosis cost, while they do increase the training and inference overhead. For the intelligent algorithm, the population size and the number of iterations should balance search sufficiency and offline computational burden: too small a setting leads to insufficient exploration, whereas too large a setting yields marginal performance gain at the cost of substantially increased computation time.
4.3. Real-Case Verification
The first case is a control moment gyro system [
20], which is an important execution structure for controlling spacecraft flight attributes. This system consists of 28 different tests and 36 failure states (reduced
), and all the test costs are 1. Under the premise of ensuring a 100% fault isolation rate, a diagnostic strategy with minimal cost needs to be designed for the system. Based on Experiments 1 and 2, PSO_MLP1 is selected with
and
. The computation time and cost of each algorithm are shown in
Table 5.
A two-channel MIMO circuit is selected as the second real case, as shown in
Figure 12. This is the signal transmission and reception frontend module of a complex radar. Under the premise of ensuring a 100% fault isolation rate, a diagnosis strategy is required to isolate faults as quickly as possible. This system consists of 45 modules and 11 test points. Based on theoretical analysis and knowledge, all 73 faults of the system were identified by analyzing the possible fault modes of each module and their impact on system function. And 50 tests have been determined that can be used to detect all fault signals, as shown in the
Appendix A.
Tests are performed by injecting signals at one test point (or two test points) and detecting the output at another test point. There are three methods for injecting faults, including plugging and unplugging jumper caps, rotating and sliding rheostats, and circuit simulation. The outputs before and after fault injection are compared to obtain
. An example is shown in
Figure 13. We inject fault
and carry out
; a decrease in the signal-to-noise ratio from 60 dB to 10 dB is detected while carrying out the symmetry test
. The signal-to-noise ratio is kept at 60 dB, so
. Information on the faults and tests, the system schematic diagram, and
are provided in the
Appendix A.
Based on Experiments 1 and 2, PSO_MLP1 is selected with
and
. The computation time and cost of each algorithm are shown in
Table 6.
Consistent with the simulation results, the cost of PSO_MLP1 outperforms that of the other algorithms in two real cases, and it yields more significant advantages in the second case
, which has a larger scale (only 63.9% of the Growing algorithm). The computation time of PSO_MLP1 is shorter than that of the QGA, HPSO, and Hybrid. And this advantage is not significant in the large system of the second case. Although the Growing algorithm has a shorter calculation time, the testability design does not have real-time requirements, so 26.045 s is completely acceptable. This demonstrates the effectiveness of the multipartite graph model and ENI structure. The strategy of PSO_MLP1 is shown in the
Appendix A. Following this strategy for fault isolation, 300 faults are injected based on
. All the diagnostic results were consistent with those of the injection, and the average cost was consistent with the expected cost. This indicates that the proposed method can generate a better diagnosis strategy, which is feasible for improving testing efficiency and reducing comprehensive test costs.
In the current real-case verification, the injected fault samples were used to check the consistency between the observed test outcomes and the binary dependency matrix D. Since the proposed strategy is derived from D rather than learned from data, these samples serve as consistency-verification samples instead of training/testing samples in the conventional machine-learning sense.
The present study is based on a deterministic binary dependency matrix . Such a formulation is appropriate for systems in which the test responses are highly repeatable and strongly separable as shown in , i.e., repeated executions of the same test under the same fault state produce stable binary outcomes. In cases where the discrimination capability of a test is weak or the test design is not sufficiently informative, the same test may provide only partial separation for certain faults, and the corresponding dependency relation is more appropriately represented by a fractional or probabilistic value between 0 and 1. Moreover, in more complex industrial scenarios, the outcome of a test may also be affected by sensor noise, measurement error, environmental disturbance, parameter drift, intermittent faults, or overlap between fault signatures, so that the same test under the same fault state does not always yield an identical result. This issue is especially relevant when the discrimination is based on waveform similarity, spectral features, or analog quantities near a threshold, where repeated tests may produce results that are distinguishable in most cases but not in all cases. Therefore, the difference between binary and probabilistic dependency relations reflects not only different forms of test-result representation, but also differences in test design quality and engineering application scenarios.
5. Conclusions
Based on the multi-signal flow graph model, minimizing the diagnostic cost is described as an MDP. Due to the combinatorial explosion, most existing algorithms are hard to solve this problem in complex systems. Therefore, this paper transforms the complex MDP into a simpler FEVP for nondeterministic elimination. Based on the ENI structure, the unknown function of FEVP is decomposed into three parts and solved separately. The simulation results show that different neural network structures and intelligent algorithms can establish the proposed ENI structure. Compared to existing algorithms, it offers greater advantages when applied to large-scale systems. The experiment results show that within an acceptable time, the cost can be reduced to 69.4% of comparison algorithms and can reach 63.9% on the testability design case of a two-channel MIMO system.
The present model is mainly suitable for testability-design problems with highly deterministic test responses. For systems with significant test uncertainty, the modeling stage itself should be adjusted by introducing probabilistic dependency matrices, robust strategy-generation rules, or joint cost–risk optimization criteria. In other words, whether test uncertainty should be explicitly incorporated into the MDP depends on the test mechanism, the signal-to-noise ratio, and the repeatability of the test outcomes in the target system. In this paper, we focus on the deterministic setting in order to clearly demonstrate the advantage of the multipartite graph model and the ENI structure for large-scale minimum-cost strategy generation, while the uncertainty-aware extension will be investigated in future work.
In our future work, we plan to implement the following three extensions to the proposed method: The first item is to improve the universality of the ENI structure and expand its application scope to the top-down and horizontal methods. The second item is to develop an adaptive method based on the ENI structure to improve the robustness of elimination action applied on different distributions of . The third item is to integrate with test uncertainty modeling, so that the proposed framework can be extended to probabilistic or weighted test-response representations for more engineering scenarios.