Next Article in Journal
Stability for Anchor Bolt-Reinforced Tunnel Roofs in Rock Strata with Modified HB Criterion
Previous Article in Journal
NLP-Based Consumer Complaint Assessment: Synthetic Data Generation, Featurization, and Evaluation Metrics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Fuzzy Comprehensive Evaluation Framework Integrating Time–Frequency Features and Combined Weighting for Matching Impact Signals with Multi-Layer Penetration Response Signals

1
School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
2
School of Locomotive and Rolling Stock, Nanjing Vocational Institute of Railway Technology, Nanjing 210031, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(12), 5990; https://doi.org/10.3390/app16125990
Submission received: 22 May 2026 / Revised: 9 June 2026 / Accepted: 11 June 2026 / Published: 13 June 2026
(This article belongs to the Section Mechanical Engineering)

Abstract

In impact testing, evaluating multiple-impact signals is critical for verifying whether a test setup can reproduce penetration response signals and ensure reliable results. To overcome the limitations of traditional methods, including incomplete indicator coverage, subjective weighting, and poor consistency, this study proposes a fuzzy comprehensive evaluation (FCE) framework based on time–frequency features and combined weighting. Using multi-layer penetration response signals as the matching target, a multidimensional indicator system covering time-domain features, frequency-domain features, and signal quality and stability is established. A combined weighting method integrating AHP, EWM, and CRITIC is then developed, and subjective and objective weights are fused using the geometric mean method. A fuzzy comprehensive evaluation model is used to quantify the matching degrees of multiple sets of multiple-impact signals, and robustness is verified through weight consistency tests and sensitivity analysis. The results show that the evaluated signal sets are rated “Excellent”. Under reasonable weight combinations, the probability of obtaining an “Excellent” result reaches 99.94%, and the maximum variation caused by a ±10% perturbation in a single indicator weight is only 0.0087. The proposed framework provides a practical tool for evaluating multi-layer penetration response simulations and can be extended to other complex dynamic signal-matching problems.

1. Introduction

In modern engineering, repeated impact loads have an increasingly significant effect on the performance and reliability of electromechanical systems. Such loads are commonly encountered in mechanical vibration, collision, and multi-layer target penetration by munitions [1,2,3,4]. More broadly, transient dynamic signals generated under impact or impact-like loading conditions are also important in structural monitoring and digital-twin-assisted system validation [5,6], as well as in advanced manufacturing and structural diagnostics, where complex engineering systems may operate under severe dynamic environments and potential impact conditions [7,8]. In these applications, reliable signal feature extraction and quantitative evaluation are essential for distinguishing true physical response characteristics from measurement uncertainty, noise interference, and structural variability. Among these scenarios, multi-layer target penetration represents one of the most severe operating conditions, because the control components of a projectile must withstand extreme transient impacts, placing stringent requirements on impact signal identification and control [9]. Owing to the inherent limitations of live-fire penetration tests, such as difficulties in data acquisition, high costs, and strong site dependence, multiple-impact test setups have become important tools for reproducing complex impact environments. Although these setups have improved in loading control and impact sequence simulation [10,11,12], systematic methods for evaluating whether the generated impact signals can reproduce the penetration response signal remain insufficient. At present, unified standards for impact signal matching evaluation are still lacking. Traditional single-indicator evaluation methods have several limitations, including incomplete indicator coverage, subjective weighting, and insufficient stability assessment. As a result, parameter adjustment often depends on experience, and the comparability of test results is limited. Therefore, a scientific evaluation framework is needed to improve the simulation accuracy and evaluation reliability of multiple-impact test setups.
Currently, methods for evaluating the matching degree of impact signals mainly include single weighting methods, hybrid weighting methods, and multi-criteria decision-making (MCDM)-based evaluation methods. Single weighting methods are typically represented by AHP [13] and the entropy weight method (EWM) [14]. AHP can incorporate expert experience and engineering judgment, but its results may be affected by subjectivity. In contrast, EWM determines weights according to the dispersion of indicator data and is more objective, but it does not consider the correlation or conflict among indicators. Hybrid weighting methods [15] are used in attempts to integrate subjective and objective information; however, they may still face challenges such as weight allocation uncertainty, indicator redundancy, and insufficient robustness. MCDM-based methods [16] provide a structured framework for processing multidimensional indicators, assigning weights, and generating comprehensive evaluation results. Therefore, they are suitable for impact signal matching, where signal similarity is jointly determined by time-domain characteristics, frequency-domain characteristics, signal quality, and stability.
Within the MCDM framework, combined weighting methods are often used to balance subjective judgment and objective data information. AHP can reflect expert experience and engineering judgment, whereas EWM determines weights according to the dispersion of indicator data. CRITIC further considers the contrast intensity of indicators and the conflict among them. Therefore, these methods can provide complementary weighting information from different perspectives. For impact signal matching evaluation, such a combined weighting strategy is useful because the matching degree is affected by multiple time-domain, frequency-domain, and signal quality indicators, and no single weighting method can fully represent their relative importance.
In recent years, multi-criteria decision-making (MCDM) methods have shown considerable potential in the evaluation of complex multi-indicator systems and have been widely applied in engineering design, risk assessment, infrastructure planning, site selection, supplier quality evaluation, sustainable manufacturing, and life-cycle-based assessment [17,18,19,20,21,22,23,24,25,26,27,28]. To improve evaluation reliability, researchers have increasingly combined subjective weighting methods with objective weighting methods and decision-making models. For example, AHP has been integrated with CRITIC, EWM, VIKOR, DEMATEL, GIS, neural networks, and machine learning to address complex engineering decision problems involving multidimensional indicators and uncertain data [20,21,22,23,24,25,26]. Other studies have applied MCDM to sustainable manufacturing and life-cycle-based building assessment, demonstrating its ability to balance multiple criteria and improve decision consistency under different engineering preferences [27,28].
These studies indicate that current MCDM research is developing in three main directions. First, MCDM is increasingly used as a general evaluation framework for complex engineering systems. Second, MCDM models are being combined with spatial, intelligent, and data-driven methods to improve decision support under heterogeneous information. Third, combined weighting, fuzzy or uncertain modelling, and robustness verification are increasingly adopted to improve interpretability and stability under scattered or uncertain data. These trends support the use of an MCDM-based framework for multiple-impact signal matching evaluation, where different time–frequency indicators must be integrated under experimental scatter and indicator uncertainty. However, such hybrid weighting strategies have rarely been applied to multiple-impact signal matching evaluation, and a complete framework integrating indicator construction, combined weighting, fuzzy comprehensive evaluation, and robustness verification has not yet been fully established.
To address the aforementioned issues, the aim of this study is to develop a fuzzy comprehensive evaluation framework for quantitatively assessing the matching degree between multiple-impact signals generated by a multiple-impact test setup and the penetration response signal. Specifically, the proposed framework is designed to solve the problem that traditional impact signal evaluation methods cannot provide a comprehensive, weighted, and robust assessment of signal matching performance. The framework consists of a multidimensional time–frequency feature indicator system, an AHP-EWM-CRITIC combined weighting method, and a fuzzy comprehensive evaluation model. Through this framework, the dynamic characteristics of impact signals can be comprehensively described, the subjective and objective information of indicators can be integrated, and the matching degree between multiple-impact signals and the penetration response signal can be quantitatively classified. This enables a more objective evaluation of the performance of multiple-impact test setups and provides a quantitative basis for assessing the matching degree between impact signals and the penetration response signal, as well as the simulation accuracy of the test setup. In addition, the proposed framework can provide a methodological reference for the evaluation of other complex dynamic signals in structural monitoring, system validation, and impact-like operating conditions. The main contributions of this study are summarized as follows:
(1) A multidimensional time–frequency feature indicator system is constructed for impact signal matching evaluation. The system covers time-domain features, frequency-domain features, and signal quality and stability indicators, enabling the characterization of impact signal intensity, duration, spectral distribution, and stability.
(2) An AHP-EWM-CRITIC combined weighting method is developed to integrate expert experience and objective data information. AHP is used to obtain subjective weights, EWM and CRITIC are used to extract objective weights, and the geometric mean method is used to obtain comprehensive weights. This combined weighting strategy serves as the weight-assignment module of the MCDM-based evaluation framework and provides more balanced indicator weights for the subsequent fuzzy comprehensive evaluation.
(3) The proposed framework is validated using impact test data and the penetration response signal. Weight consistency tests and sensitivity analysis are conducted to verify the rationality of the comprehensive weights and the robustness of the evaluation results.

2. Materials and Methods

2.1. Data Source

The experimental data used in this study to validate the fuzzy comprehensive evaluation framework for impact signal matching were obtained using an in-house-developed multiple-impact test setup [11], as shown in Figure 1. Figure 1a shows the schematic diagram of the setup, while Figure 1b,c presents photographs of the key experimental components, including the impact body and the target before and after impact. The setup mainly consists of a driving system, a high-mass rotating arm, an impact body, a test specimen, a layered target structure, an acceleration measurement system, a rotating electrical interface, and a data acquisition system. During the test, the impact body is fixed on the rotating arm, and the test specimen is mounted inside the impact body. The driving system drives the rotating arm to rotate, and the rotating arm then carries the impact body to penetrate the layered target structure, thereby generating successive impact loads. The acceleration response of the specimen is measured by an accelerometer mounted inside the test specimen and recorded by an oscilloscope (MSO5354, RIGOL Technologies Co., Ltd., Suzhou, China) through the rotating electrical interface.
The previous study [11,29] introduced the design of the setup and verified its ability to generate multiple-impact acceleration signals with identifiable impact peaks and repeatable response characteristics. Therefore, the setup provides a feasible experimental basis for obtaining the multiple-impact signals used in the present matching evaluation. In this study, the multiple-impact signals generated by this setup were used as the evaluated signals, while the measured penetration response signal was used as the reference signal.
With the support of the aforementioned multiple-impact test setup, multiple-impact tests were conducted, and the corresponding impact test data were collected.

2.2. A Fuzzy Comprehensive Evaluation Framework for Impact Signals Based on Time–Frequency Features and Combined Weighting

2.2.1. Overall Framework

To evaluate the matching degree between impact signals generated by multiple-impact test setups and multi-layer penetration response signals, this study develops a fuzzy comprehensive evaluation framework for impact signals based on time–frequency features and combined weighting. The overall workflow of the proposed framework is shown in Figure 2. The framework is built on a multidimensional time–frequency feature index system, uses the AHP-EWM-CRITIC combined weighting method as its core, and incorporates a fuzzy comprehensive evaluation model to achieve quantitative matching assessment. Among these components, combined weighting plays a central role in the proposed framework. Single-weighting methods have inherent limitations: AHP can incorporate expert experience but is highly subjective; EWM is more objective but does not consider correlations among indicators; and CRITIC objectively considers indicator correlations but does not incorporate expert judgment. In this study, the geometric mean method is used to integrate these three weighting methods, thereby preserving the rationality of expert experience while fully utilizing the objective information contained in the data. As a result, a composite weight vector that balances subjective and objective information is obtained. The fuzzy comprehensive evaluation (FCE) model [30] can handle uncertainty and fuzziness among indicators, but its effectiveness depends on the rationality of the weights and membership degrees. Therefore, the composite weights obtained from the combined weighting method are integrated with the indicator membership matrix, enabling the combination of subjective and objective information with fuzzy evaluation. In this way, the matching degree between multiple-impact signals and penetration response signals can be accurately quantified.
The complete implementation process of the proposed framework consists of the following four stages:
  • Construction of a multidimensional time–frequency feature index system for impact signals: Based on the time-domain features, frequency-domain features, and quality and stability characteristics of impact signals, a multidimensional time–frequency feature index system is established. This system includes amplitude, pulse width, root mean square (RMS), total power, spectral flatness, dominant frequency, signal-to-noise ratio (SNR), noise power, and time–frequency entropy, thereby providing a comprehensive characterization of signal properties.
  • Indicator normalization: To eliminate differences in units, dimensions, and value ranges, all indicators are normalized to ensure comparability under a unified scale.
  • Combined weight calculation: Subjective weights determined by experts using AHP are combined with objective weights derived from EWM, while CRITIC is employed to analyze the correlations and conflicts among indicators. The comprehensive weights are then obtained using a geometric mean-based combination method.
  • Fuzzy comprehensive evaluation: By combining the comprehensive weights with the membership matrix, a fuzzy comprehensive evaluation vector is constructed. This vector is then applied to multiple-impact signal datasets to calculate the evaluation scores and membership degrees of the matching degree for different datasets, thereby achieving a quantitative evaluation of the matching degree among multiple-impact signals.

2.2.2. Construction of a Multidimensional Time–Frequency Feature Index System

Impact signals generated under medium-velocity penetration [31] and multiple-impact conditions usually exhibit typical transient characteristics, including high-amplitude impact peaks, limited pulse duration, frequency concentration, and noise-induced fluctuations. These characteristics are closely related to the dynamic response of the tested system and the damage behavior of the target material [32]. Therefore, the evaluation of impact signal matching should consider not only the intensity and duration of the response, but also the spectral distribution, signal quality, and stability.
Based on this consideration, a multidimensional evaluation indicator system was established from three aspects: time-domain features, frequency-domain features, and signal quality and stability. The time-domain indicators, including amplitude, pulse width, and root mean square (RMS), are used to characterize the peak impact intensity, the duration of the main impact process, and the overall response level of the signal [33]. The frequency-domain indicators, including total power, spectral flatness, and dominant frequency, are used to describe the signal energy distribution, spectral concentration, and dominant vibration component [33,34]. The signal quality and stability indicators, including signal-to-noise ratio (SNR), noise power, and time–frequency entropy, are introduced to quantify noise interference, waveform disturbance, and the complexity of the signal energy distribution [33,35,36]. Among them, time–frequency entropy provides a measure of the non-stationary characteristics of the impact signal in the time–frequency domain [36].
Compared with high-dimensional joint time–frequency representations, the selected indicators are physically interpretable, computationally stable, and suitable for normalization, combined weighting, and fuzzy comprehensive evaluation. Therefore, they are appropriate for the objective of this study, which is to quantify the overall matching degree between multiple-impact signals and the penetration response signal rather than to reconstruct the complete localized time–frequency evolution of the response signal. The structure of the multidimensional evaluation indicator system is shown in Figure 3.
  • Development of multidimensional indicators based on time-domain features:
  • Amplitude
Amplitude represents the maximum instantaneous value of an impact signal and reflects its transient response characteristics. It is calculated as follows:
A P = max ( x i ) , i = 1 , 2 , , N
where Ap denotes the amplitude of the impact signal, x(i) represents the sampled value of the signal at the i-th sampling point, and N represents the total number of sampling points. Amplitude characterizes instantaneous impacts, mechanical collisions, and overload conditions during system operation, reflecting the transient impact force generated by the interaction between the impact body and the target structure. Therefore, it serves as a key indicator for evaluating impact intensity, material resistance, dynamic response, and penetration depth.
  • Pulse width
Pulse width is defined as the duration for which an impact pulse remains at a high level. For an ideal rectangular pulse, it can be expressed as follows:
W p = t o f f t o n
where ton and toff represent the start and end times of the pulse, respectively. Pulse width reflects the duration of the impact load and the continuity of energy transfer. A shorter pulse width is usually associated with a high-intensity transient impact, which may cause brittle failure in the surface layer. In contrast, a longer pulse width indicates more sustained energy transfer, which may lead to deep plastic deformation or global failure.
  • Root mean square (RMS)
The root mean square (RMS) characterizes the effective intensity and overall energy-related characteristics of an impact signal. It is calculated as follows:
R M S = 1 N i = 1 N x i 2 , i = 1 , 2 , , N
The RMS effectively reflects the overall energy-related characteristics of the impact signal and should satisfy the preset minimum energy requirement.
2.
Development of multidimensional indicators based on frequency-domain features:
  • Total power
Total power is defined as the integral of the power spectral density (PSD), and it can be expressed as follows:
P S D t o t a l   = 0 f max X ( f ) d f
where PSDtotal denotes the total power of the impact signal, X(f) represents the power spectral density (PSD) of the signal, and fmax denotes the upper frequency limit. The PSD can be obtained from the frequency-domain representation X(f) = F{x(t)}, where f is the frequency. Total power reflects the overall energy-related intensity of the impact signal. It can be used to quantify signal strength, thereby supporting the evaluation of its matching degree with the penetration response signal.
  • Spectral flatness
Spectral flatness measures the uniformity of the spectrum of an impact signal and indicates the degree to which the signal approaches white noise [34]. It is calculated as follows:
SF = e 1 M f = 0 M 1 ln X f 1 M f = 0 M 1 X ( f )
where M represents the total number of frequency points in the spectrum. A higher spectral flatness indicates a more uniform spectrum, whereas a lower value indicates the presence of distinct spectral peaks.
  • Dominant frequency
Dominant frequency refers to the frequency component with the highest amplitude in the spectrum of an impact signal and is typically extracted using the fast Fourier transform (FFT). The closer the dominant frequency of the impact signal is to that of the penetration response signal, the more similar the two signals are in the frequency domain. Therefore, dominant frequency is an important indicator for evaluating signal matching.
3.
Development of multidimensional indicators based on signal quality and stability:
  • Signal-to-noise ratio (SNR)
The signal-to-noise ratio (SNR) measures the ratio of useful signal power to noise power and reflects the clarity and identifiability of an impact signal. It is calculated as follows:
SNR = 10 log 10 P c P b
where Pc represents the useful signal power after noise reduction, and Pb represents the noise power. A higher SNR indicates better signal quality.
  • Noise power
Noise power is used to quantify the noise intensity in an impact signal and is typically obtained by integrating the noise power spectral density over a specified frequency band:
P noise = f low f high S noise ( f ) d f
where ton and toff represent the start and end times of the pulse, respectively. Pulse width where Snoise(f) represents the noise power spectral density, fhigh represents the upper limit of the noise frequency band, and flow represents the lower limit of the noise frequency band.
  • Time–frequency entropy
Time–frequency entropy is used to measure the complexity and information content of impact signals. By integrating the time-domain and frequency-domain characteristics of a signal, it reflects the distribution pattern of signal energy in the time–frequency domain [35,36].
First, the acquired impact signal is transformed into the time–frequency domain to obtain its time–frequency representation X(f,t). The normalized time–frequency energy distribution is calculated as follows:
P ( i , j ) = | X ( f , t ) | 2 i , j | X ( f , t ) | 2
where P(i,j) denotes the normalized energy probability distribution of the impact signal at the i-th time point and the j-th frequency point. The sum of all probability values satisfies P ( i , j ) = 1 .
After the normalized time–frequency distribution P(i,j) is obtained, the time–frequency entropy H is calculated as follows:
H = i , j P ( i , j ) log ( P ( i , j ) )
A higher entropy value indicates a broader frequency distribution and a more complex signal structure. Conversely, a lower entropy value indicates a more concentrated energy distribution and stronger regularity in the impact signal.
The consistency of these indicators between the impact signal and the penetration response signal is used to quantify the matching degree.

2.2.3. Indicator Normalization

In this study, the penetration response signal was used as the reference target for matching evaluation. Because the nine secondary indicators differ in units, value ranges, and optimization directions, normalization was performed before weighting and fuzzy comprehensive evaluation. The indicators were classified as positive, negative, or interval-type indicators according to their matching relationship with the penetration response signal. For positive indicators, larger original values indicate better matching and correspond to larger normalized values. For negative indicators, smaller original values indicate better matching after normalization. For the interval-type indicator, the optimal matching state is reached within a specified frequency range. Therefore, the normalization criteria were used to convert the original indicator values of multiple-impact signals into comparable matching scores relative to the penetration response signal.
Based on the above analysis, the normalization formula for positive indicators, including pulse width, root mean square (RMS), total power, spectral flatness, noise power, and time–frequency entropy, is expressed as follows:
S s t d = 1 , S S max S S min S max S min , S max > S S min 0 , S < S min
where Sstd represents the normalized value, S represents the original value of the indicator to be normalized, and Smax and Smin represent the upper and lower bounds of the indicator, respectively.
For negative indicators, including amplitude and signal-to-noise ratio (SNR), the normalization formula is expressed as follows:
S s t d = 1 , S < S min S max S S max S min , S max > S S min 0 , S S max
For the dominant frequency, an interval-type normalization method is adopted. Specifically, the dominant frequency is treated as a positive indicator in the range of 0–500 Hz and as a negative indicator in the range of 2000–5000 Hz, ensuring that the normalized value accurately reflects the matching degree between the impact signal and the penetration response signal.
It should be noted that the positive or negative attribute of each indicator was determined according to its matching relationship with the penetration response signal rather than by general signal quality criteria.

2.2.4. Comprehensive Weight Fusion Using the Geometric Mean Method

In impact signal matching evaluation, a single weighting method has difficulty balancing subjective experience and objective information because of indicator diversity, feature complexity, and the involvement of expert judgment. In addition, correlations and redundancies may exist among indicators, which can affect the rationality of the weights and the robustness of the evaluation results. To address these issues, an AHP-EWM-CRITIC combined weighting method is adopted in this study, and the geometric mean method is used to integrate the three types of weights. In this way, a comprehensive weighting scheme that balances subjective rationality and objective information is established. This scheme provides a reliable weighting basis for subsequent fuzzy comprehensive evaluation and supports the quantitative and robust assessment of the matching degree of multiple-impact signals. The specific process is described as follows:
  • Calculation of subjective weights using AHP
AHP was used to determine subjective weights based on expert judgments [37]. The relative importance of the primary and secondary indicators was scored using the 1–9 scale, and judgment matrices were constructed to calculate the corresponding weight vectors.
Several relevant technical experts were trained using the 1–9 scoring scale, and simulated expert scoring was then conducted. Based on the relative importance of each indicator, scores were assigned to the primary indicators, including time-domain features, frequency-domain features, and signal quality and stability indicators, as well as to the secondary indicators, including amplitude, pulse width, root mean square (RMS), total power, spectral flatness, dominant frequency, signal-to-noise ratio (SNR), noise power, and time–frequency entropy. Judgment matrices were then constructed for indicators at all levels. Subsequently, according to the AHP procedure, the subjective weight vectors of the impact signal matching indicators at each level were obtained, as shown in Equation (13). Table 1 presents the scoring results for the primary and secondary indicators.
W AHP = ( W 1 AHP , W 2 AHP , W 3 AHP ) W 1 AHP = ( w 1 AHP , w 2 AHP , w 3 AHP ) W 2 AHP = ( w 4 AHP , w 5 AHP , w 6 AHP ) W 3 AHP = ( w 7 AHP , w 8 AHP , w 9 AHP )
where WAHP denotes the AHP weight vector of the primary indicators, including time-domain features, frequency-domain features, and signal quality and stability. W i A H P denotes the local AHP weight vector of the secondary indicators under the i-th primary indicator, where i = 1, 2, 3. w j A H P denotes the local AHP weight of the j-th secondary indicator, where j = 1, 2, …, 9.
  • Calculation of objective weights using EWM
EWM was used to calculate objective weights according to the dispersion and information entropy of the normalized indicator data [38]. Indicators with greater dispersion provide more effective information and are assigned larger weights. The specific process is described as follows:
  • Based on the normalized indicator values, the proportion of each indicator in all samples is calculated to form a probability distribution matrix;
  • The information entropy formula is used to calculate the entropy value of each indicator, which reflects the inherent information dispersion or uncertainty of the indicator;
  • The information effectiveness and weighting contribution of each indicator are measured by calculating its redundancy, which is defined as 1 minus the entropy value;
  • The redundancy values are normalized to obtain the final objective weight vector, which represents the relative importance of each indicator in the matching evaluation.
The objective weight vectors of indicators at different levels calculated using the EWM method are expressed as follows:
W EWM = ( W 1 EWM , W 2 EWM , W 3 EWM ) W 1 EWM = ( w 1 EWM , w 2 EWM , w 3 EWM ) W 2 EWM = ( w 4 EWM , w 5 EWM , w 6 EWM ) W 3 EWM = ( w 7 EWM , w 8 EWM , w 9 EWM )
The symbols have the same meanings as those defined for AHP, with the superscript replaced by EWM.
  • Calculation of objective weights using CRITIC
CRITIC was used to determine objective weights by considering both indicator variation and inter-indicator conflict [39]. This method assigns larger weights to indicators with greater variability and lower redundancy. The specific process is described as follows:
  • The standard deviation of the normalized indicator data is calculated to reflect the dispersion degree and information content of each indicator;
  • The Pearson correlation coefficients between pairs of indicators are calculated to measure the redundancy among indicators;
  • The conflict degree of each indicator is determined based on its correlations with other indicators;
  • The standard deviation and conflict degree are combined and normalized to obtain the CRITIC objective weight vector of each indicator, reflecting its relative importance in the fuzzy comprehensive evaluation of impact signal matching.
The weight vectors of indicators at different levels calculated using the CRITIC method are expressed as follows:
W CRI = ( W 1 CRI , W 2 CRI , W 3 CRI ) W 1 CRI = ( w 1 CRI , w 2 CRI , w 3 CRI ) W 2 CRI = ( w 4 CRI , w 5 CRI , w 6 CRI ) W 3 CRI = ( w 7 CRI , w 8 CRI , w 9 CRI )
The symbols have the same meanings as those defined for AHP, with the superscript replaced by CRITIC.
  • Geometric mean-based weight combination
To integrate the subjective and objective weighting results, the geometric mean method was adopted in this study. AHP reflects expert judgment and engineering experience, EWM reflects the information dispersion of indicator data, and CRITIC reflects both the contrast intensity and conflict among indicators. Therefore, the three weighting methods provide complementary information. Compared with the arithmetic mean, the geometric mean has a multiplicative aggregation characteristic, which can reduce the dominance of any single weighting method. An indicator can obtain a relatively large comprehensive weight only when it receives relatively high weights from AHP, EWM, and CRITIC simultaneously. Conversely, if an indicator is assigned a high weight by only one method but low weights by the other methods, its comprehensive weight will be moderated during the integration process. Therefore, the geometric mean method provides a compromise weighting strategy for balancing expert judgment, data dispersion, and inter-indicator conflict.
Since three weighting methods are integrated, the unnormalized comprehensive weight of the j-th indicator is calculated as the cubic root of the product of the three weights:
w j = w j AHP w j EWM w j CRI 3 j = 1 9 w j AHP w j EWM w j CRI 3
where wj represents the comprehensive weight of the j-th secondary indicator. The calculated comprehensive weights are grouped according to the primary indicators to form the following weight vectors:
W = ( W 1 , W 2 , W 3 ) W 1 = ( w 1 , w 2 , w 3 ) W 2 = ( w 4 , w 5 , w 6 ) W 3 = ( w 7 , w 8 , w 9 )
where W denotes the overall comprehensive weight vector of the nine secondary indicators. Wj denotes the comprehensive weight vectors of the secondary indicators under the i-th primary indicator, and wj denotes the comprehensive weight of the j-th secondary indicator.

2.2.5. Fuzzy Comprehensive Evaluation

By combining the AHP-EWM-CRITIC combined weighting method with the fuzzy comprehensive evaluation model, a quantitative analysis of the matching degree of impact signals is conducted. This method can handle uncertainty and fuzziness among indicators while considering the effects of indicator weights on the evaluation results, thereby enabling a robust assessment of impact signal matching.
The factor set and evaluation set are constructed as follows:
  • Primary indicator set: U = {u1, u2, u3} (time-domain features, frequency-domain features, and signal quality and stability);
  • Secondary indicator set: u1 = {u11, u12, u13}, u2 = {u21, u22, u23}, u3 = {u31, u32, u33};
  • Evaluation set: V = {v1, v2, v3} (Excellent, Satisfactory, and Unsatisfactory).
For each secondary indicator, the membership degree corresponding to each evaluation grade is calculated using the membership function. Thus, the fuzzy evaluation matrices R1, R2, and R3 are constructed as follows:
R 1 = i v 1 ( u 11 ) i v 2 ( u 11 ) i v 3 ( u 11 ) i v 1 ( u 12 ) i v 2 ( u 12 ) i v 3 ( u 12 ) i v 1 ( u 13 ) i v 2 ( u 13 ) i v 3 ( u 13 )
R 2 = i v 1 ( u 21 ) i v 2 ( u 21 ) i v 3 ( u 21 ) i v 1 ( u 22 ) i v 2 ( u 22 ) i v 3 ( u 22 ) i v 1 ( u 23 ) i v 2 ( u 23 ) i v 3 ( u 23 )
R 3 = i v 1 ( u 31 ) i v 2 ( u 31 ) i v 3 ( u 31 ) i v 1 ( u 32 ) i v 2 ( u 32 ) i v 3 ( u 32 ) i v 1 ( u 33 ) i v 2 ( u 33 ) i v 3 ( u 33 )
where ivk(uij) represents the membership degree of the secondary indicator uij to the evaluation grade vk, with I = 1, 2, 3, j = 1, 2, 3, and k = 1, 2, 3.
The fuzzy comprehensive evaluation vector for each primary indicator is calculated as follows. The comprehensive weight vector of the secondary indicators under each primary indicator is multiplied by the corresponding fuzzy evaluation matrix to obtain the primary-level fuzzy comprehensive evaluation vector:
P i = W i × R i
where Pi represents the fuzzy comprehensive evaluation vector of the i-th primary indicator, Wi represents the comprehensive weight vector of the secondary indicators, and Ri represents the corresponding fuzzy evaluation matrix.
The final comprehensive evaluation vector is then calculated by aggregating the primary-level fuzzy evaluation vectors according to the primary-level comprehensive weight vector P:
P = W P 1 P 2 P 3
Based on the maximum membership principle, the matching quality of multiple-impact signals is determined by the evaluation grade with the largest membership degree in P. Thus, both qualitative and quantitative analyses can be conducted, and the final matching quality of the impact signal can be classified as Excellent, Satisfactory, or Unsatisfactory.

3. Experimental Study on Matching Degree Evaluation Based on the Fuzzy Comprehensive Evaluation Framework

In this section, the proposed framework is applied to three sets of multiple-impact signals. Time–frequency features are extracted, normalized, and weighted using the AHP-EWM-CRITIC combined weighting method, and then evaluated using the fuzzy comprehensive evaluation model. All algorithms are implemented using Python 3.8.10 (Python Software Foundation, Beaverton, OR, USA).

3.1. Extraction of Time–Frequency Features from Multiple-Impact Signals

Using the multiple-impact test setup, three sets of impact tests were conducted under the following conditions: three target plates made of AISI 1020 steel were used, with thicknesses of 4 mm, 4 mm, and 5 mm, respectively, and all impactors had the same design. The experimental results of the three sets of multiple-impact signals are shown separately in Figure 4a–c.
Time–frequency features were extracted from the impact signals of the three impact test groups, covering nine indicators in three dimensions: time-domain features, frequency-domain features, and signal quality and stability. The signals were sampled at 20 kHz, and the data range extended from 2 ms before the first waveform to 2 ms after the last waveform, as shown in Figure 4. The parameters of each indicator were extracted within this range and are summarized in Table 2.
Table 2 also includes the penetration response signals and the test results of 27 groups with different materials obtained using this setup. These material groups involved nine materials, namely AISI 1020 steel, AISI 1040 steel, AISI 1060 steel, 2A12 Al alloy, 7020 Al alloy, 7075 Al alloy, AZ31B Mg alloy, H62 brass, and S30153 stainless steel, with three repeated tests conducted for each material. These additional 27 groups of material test data were used to construct the sample set for objective weight calculation and normalization, thereby improving the representativeness of the EWM and CRITIC weighting results. The test data comprise a database for model validation.

3.2. Indicator Normalization and Parameter Determination

Using the multiple-impact test setup, three sets of impact tests were conducted under the following conditions: three target plates made of AISI 1020 steel were used, with thicknesses of 4 mm, 4 mm, and 5 mm, respectively, and all impactors had the same design. The experimental results are shown in Figure 4.
In this study, the penetration response signal was used as the reference signal for the matching evaluation. The purpose of the evaluation was to determine whether the multiple-impact signals generated by the test setup could reproduce the main time–frequency characteristics of the penetration response signal. Therefore, the normalization parameters, including the indicator type, Smin, and Smax, were determined according to the extracted features of the penetration response signal, the distribution range of the experimental samples, and expert experience, as shown in Table 3.
Because the nine secondary indicators have different units, value ranges, and optimization directions, normalization was performed before weight calculation and fuzzy comprehensive evaluation. Positive indicators indicate that a larger normalized value corresponds to better matching performance, whereas negative indicators indicate that a smaller original value is more favorable. For interval-type indicators, the normalized score is determined according to whether the original value falls within the desired matching range. Therefore, Table 3 provides the normalization criteria used to transform the original indicator values into comparable matching scores.
It should be noted that the parameters in Table 3 are not final evaluation results, but normalization criteria for different indicators. These criteria ensure that indicators with different physical meanings and units can be converted into dimensionless scores within a comparable range. In this way, the normalized values can be used consistently in the subsequent AHP-EWM-CRITIC weighting process and fuzzy comprehensive evaluation. For the dominant frequency indicator, the two parameter ranges in Table 3 correspond to the piecewise normalization rule used to describe the preferred and unfavorable frequency ranges.
The three sets of multiple-impact signals obtained from the impact tests were normalized to obtain the normalized values of each secondary indicator, as shown in Table 4. In the table, values closer to 1 indicate that the corresponding indicator is closer to the ideal matching state. These normalized results effectively reflect the matching performance of the impact signals under the current test conditions and provide a quantitative basis for evaluating the matching degree of impact signals.
Table 4 shows that the three test signals have different matching characteristics after normalization. Test 1 has better performance in signal quality and stability indicators, but its RMS and total power values are relatively low. Test 2 shows a more balanced performance among time-domain, frequency-domain, and signal quality indicators. Test 3 has higher normalized values for amplitude, pulse width, RMS, dominant frequency, noise power, and time–frequency entropy, but its total power and SNR indicators are relatively lower. Therefore, the normalized results in Table 4 not only reflect the differences among the three impact signals, but also provide the direct input data for the subsequent combined weighting and fuzzy comprehensive evaluation.

3.3. Combined Weighting Based on AHP-EWM-CRITIC

3.3.1. Subjective Weighting Based on AHP

To improve the reliability of the subjective weighting results, 20 relevant technical experts were invited to perform pairwise comparisons of the primary and secondary indicators using the AHP 1–9 scale. A total of 20 scoring forms were collected. Table 5 presents one representative scoring form for the primary indicators to illustrate the construction of the AHP judgment matrix. The same procedure was applied to all scoring forms for both primary and secondary indicators.
In Table 5, each element represents the relative importance of the row indicator compared with the column indicator. The diagonal elements are equal to 1, and the reciprocal relationship aji = 1/aij is satisfied. Based on Table 5, the judgment matrix A for the primary indicators is constructed as follows:
A = 1 5 7 1 / 5 1 2 1 / 7 1 / 2 1
where the rows and columns of A correspond to time-domain features, frequency-domain features, and quality and stability indicators, respectively. The weight vector of the primary indicators was calculated using the maximum eigenvalue method. The obtained weight vector was W = (0.7396, 0.1666, 0.0938), with a maximum eigenvalue of 3.0143 and a consistency index of CI = 0.0071. Since the number of primary indicators is n = 3, the random index is RI = 0.58 according to the standard random consistency index table. The consistency ratio is calculated as CR = CI/RI = 0.0123. Since CR ≤ 0.1, the judgment matrix satisfies the consistency requirement. All 20 expert scoring forms were then processed using the same procedure, and the corresponding weight vectors for the primary and secondary indicators were obtained, as shown in Table 6, Table 7, Table 8 and Table 9.
After data that failed the consistency test were excluded, the AHP weights of the primary and secondary indicators were calculated, as shown in Table 10.

3.3.2. Objective Weighting Based on the EWM

The EWM weighting results are shown in Table 11.

3.3.3. Objective Weighting Based on the CRITIC Method

The CRITIC weighting results are shown in Table 12.

3.3.4. Calculation of Comprehensive Weights

Using the geometric mean method described in Section 2.2.4, the AHP, EWM, and CRITIC weights were integrated to obtain comprehensive weights. The results are shown in Table 13.

3.4. Fuzzy Comprehensive Evaluation and Classification

3.4.1. Determination and Construction of Membership Functions

To evaluate the multiple-impact signals generated by the multiple-impact test setup, three membership functions were constructed in this study, corresponding to the evaluation grades “Excellent,” “Satisfactory,” and “Unsatisfactory.” An ascending half-Cauchy-type function, a symmetric Cauchy-type function, and a descending half-Cauchy-type function were used for these three grades, respectively. These functions were adopted because they can describe nonlinear and gradual transitions among adjacent evaluation grades, which is suitable for the fuzzy classification of impact signal matching quality.
In this study, the normalized evaluation score u was expressed on a scale of 0–100. According to the engineering interpretation of the matching degree under the current medium-velocity penetration scenario, u < 60 was regarded as a low-matching region, 60 ≤ u ≤ 80 as a transition region, and u ≥ 80 as a high-matching region. Therefore, 60 and 80 were used as the main grade boundaries. In addition, 70 was introduced as the transition threshold for the “Excellent” membership function, and 65 was used as the center of the “Satisfactory” membership function. The coefficients in the Cauchy-type functions were used to control the transition rate between adjacent grades, so that the membership degree could reflect gradual changes in signal matching quality rather than a simple binary classification.
The thresholds and shape parameters were determined according to the normalized indicator range, the characteristics of the penetration response signal, the distribution of the experimental samples, and expert experience under the current experimental conditions. It should be noted that these membership parameters are scenario-specific rather than universal constants. When the proposed framework is applied to other impact conditions, such as different material properties, projectile geometries, target configurations, impact velocities, or sensor installation conditions, the indicator ranges and membership function parameters should be redefined using representative data from the new application scenario.
The membership functions are defined as follows:
i v 1 ( u ) = 0 , 0 u < 70 1 1.25 + 0.0018 ( u 80 ) 2 , 70 u < 80 u 100 , 80 u 100
i v 2 ( u ) = 1 1 + 0.0085 ( u 65 ) 2
i v 3 ( u ) = 1 , 0 u < 60 1 1 + 0.01 ( u 60 ) 2 , 60 u < 80 1 u 100 , 80 u 100

3.4.2. Fuzzy Comprehensive Evaluation Results and Classification

Based on the membership functions defined above, the membership degrees of each normalized secondary indicator to the three evaluation grades were calculated. The fuzzy relation matrices of the three primary indicators were then constructed. Taking Test 1 as an example, the fuzzy relation matrices R1, R2, and R3 were obtained as follows:
R 1 = 0.7808 0.4989 0.2842 0.7273 0.7256 0.4234 0 0.9766 0.9007
R 2 = 0 0.1777 1 1 0.0876 0 0.9950 0.0900 0.0050
R 3 = 0.9250 0.1346 0.0750 1 0.0876 0 1 0.0876 0
The fuzzy comprehensive evaluation vectors P1, P2, and P3 are calculated by combining the comprehensive weight vectors W1, W2, and W3 with the corresponding fuzzy relation matrices R1, R2, and R3, respectively:
P 1 = W 1 × R 1 = 0.5726 0.6813 0.4761 P 2 = W 2 × R 2 = 0.5628 0.1273 0.4372 P 3 = W 3 × R 3 = 0.9612 0.1119 0.0388
Finally, the fuzzy comprehensive evaluation vectors of the three primary indicators are aggregated to obtain the final evaluation vector P for the matching evaluation of the impact signal:
P = 0.6411 0.4256 0.3854
For test 1, the final fuzzy comprehensive evaluation vector was P = (0.6411, 0.4256, 0.3854). According to the maximum membership principle, the impact signal was classified as “Excellent”. This indicates that the impact signal from Test 1 achieved a high matching degree with the penetration response signal.
Using the same method, the impact signals from the remaining two test groups were evaluated, and the fuzzy comprehensive evaluation vector of each group was obtained. The final evaluation results of the three test groups are summarized in Table 14.
The fuzzy comprehensive evaluation results of the three test groups show that the matching degrees of all three impact signals reached the “Excellent” grade according to the maximum membership principle. However, noticeable differences in matching quality were observed among the three tests. Test 2 obtained the highest membership degree for the “Excellent” grade, with a value of 0.7818, indicating the best matching performance and the closest agreement with the penetration response signal. Test 3 ranked second, with an “Excellent” membership degree of 0.7337, showing good matching performance. Test 1 also reached the “Excellent” grade, with an “Excellent” membership degree of 0.6411, but its membership degrees for the “Satisfactory” and “Unsatisfactory” grades were relatively high, at 0.4256 and 0.3854, respectively. This indicates that the matching result of Test 1 was less distinct than those of Tests 2 and 3.
Further analysis of the fuzzy relation matrices for Test 1, as shown in Equations (26)–(28), indicates that the membership degree of the pulse width indicator for the “Satisfactory” grade was close to that for the “Excellent” grade. For the RMS indicator, the membership degrees followed the order “Satisfactory” > “Unsatisfactory” > “Excellent”, whereas for the total power indicator, the order was “Unsatisfactory” > “Satisfactory” > “Excellent”. These results indicate that pulse width, RMS, and total power still have certain deficiencies in Test 1, which explains why its “Satisfactory” and “Unsatisfactory” memberships remained relatively high despite its final classification as “Excellent”.
Overall, the three impact signals all satisfied the “Excellent” matching criterion, but the matching quality followed the order Test 2 > Test 3 > Test 1. This result shows that the proposed fuzzy comprehensive evaluation framework can not only classify the matching grade of impact signals, but also distinguish differences in matching quality among signals with the same evaluation grade.

4. Discussion

Although the proposed framework achieved an “Excellent” evaluation result for all three test groups, the rationality of the comprehensive weights and the robustness of the evaluation results should be further verified. Therefore, consistency tests and sensitivity analyses were conducted in this section to evaluate the stability and reliability of the proposed framework.

4.1. Consistency Test for Comprehensive Weights

To verify the rationality of the comprehensive weights, consistency tests were conducted by comparing the comprehensive weight vector with the weight vectors obtained from AHP, EWM, and CRITIC. Spearman’s rank correlation coefficient was used to evaluate ranking consistency, and Euclidean distance was used to evaluate numerical similarity.

4.1.1. Spearman’s Rank Correlation Coefficient

Spearman’s rank correlation coefficient [40] was used to measure the ranking consistency between the comprehensive weight vector and each original weight vector. It is calculated as follows:
ρ = 1 6 j = 1 n d j 2 n ( n 2 1 )
where dj represents the difference between the ranks of the j-th indicator in two weight vectors, and n represents the total number of indicators.
The specific steps are described as follows:
  • The nine comprehensive weight values wj in the comprehensive weight vector W are ranked. A smaller rank indicates a larger weight, where rank 1 represents the most important indicator and rank 9 represents the least important indicator. If two or more weights are equal, their average rank is used;
  • The same ranking procedure is performed for the weight values obtained from other weighting methods, including AHP, EWM, and CRITIC;
  • The rank difference dj of each indicator between two weighting systems is then calculated. For example, the rank difference between the comprehensive weight and the AHP weight of the j-th indicator is calculated as follows:
d j = Rank w j Rank w j AHP
4.
The squared rank differences d j 2 are summed and substituted into Equation (31) to obtain Spearman’s rank correlation coefficient.
The subjective weights, objective weights, and comprehensive weights obtained using AHP, EWM, and CRITIC were ranked according to indicator importance, and the results are shown in Table 15.
The calculation results show that the Spearman’s rank correlation coefficient between the AHP subjective weights and the comprehensive weights was 0.48, whereas the coefficient between the CRITIC objective weights and the comprehensive weights was 0.63. These results indicate that the comprehensive weights maintain a certain degree of consistency with the importance rankings obtained from AHP and CRITIC. In contrast, the Spearman’s rank correlation coefficient between the EWM objective weights and the comprehensive weights was only 0.03, indicating a relatively weak ranking consistency. This low rank correlation is mainly attributed to the small variation among the EWM weights, which weakens its ability to distinguish the relative importance of different indicators in terms of ranking. However, this result only reflects the ranking relationship and does not necessarily indicate a large numerical deviation between the EWM weights and the comprehensive weights. Therefore, the numerical similarity among different weight vectors is further examined using Euclidean distance.

4.1.2. Euclidean Distance

Euclidean distance [41] was used to measure the numerical similarity between the comprehensive weight vector and each original weight vector. By treating each weight vector as a point in a nine-dimensional space, the distance between W and WP can be calculated as follows, where P ∈ {AHP, WEM, CRI}:
D E W , W P = j = 1 9 w j w j P 2
The calculation results show that the Euclidean distances between the comprehensive weight vector W and the weight vectors WAHP, WEWM, and WCRI are 0.17, 0.19, and 0.15, respectively. These results indicate that the comprehensive weight vector maintains a relatively close numerical relationship with all three original weight vectors. Among them, the comprehensive weight vector is closest to the CRITIC weight vector, followed by the AHP weight vector, while the distance from the EWM weight vector is also within a small range.
Further calculations show that the Euclidean distances among the three original weight vectors are 0.26, 0.27, and 0.28, with an average value of 0.27. In contrast, the average distance between the comprehensive weight vector and the three original weight vectors is 0.17. Since this value is smaller than the average distance among the three original weight vectors, the comprehensive weight vector can be considered to be located near the center of the three original weighting schemes. This indicates that the proposed combined weighting method effectively integrates the subjective information from AHP, the data-dispersion information from EWM, and the inter-indicator conflict information from CRITIC.
It should be noted that the Spearman correlation coefficient and Euclidean distance reflect different aspects of similarity. Spearman’s rank correlation focuses on the consistency of indicator importance rankings, whereas Euclidean distance measures the numerical closeness of weight vectors. Therefore, although the rank correlation between the EWM weights and the comprehensive weights is relatively low, their Euclidean distance remains small. This may be attributed to the relatively small variation among EWM weights, which weakens its ranking discrimination ability but does not necessarily lead to a large numerical distance from the comprehensive weight vector.
In summary, the analyses based on Spearman’s rank correlation coefficients and Euclidean distances show that the comprehensive weighting method achieves a reasonable integration of multiple weighting schemes. The comprehensive weights preserve a certain ranking consistency with AHP and CRITIC while maintaining numerical closeness to all three original weight vectors. These results verify the rationality and integration performance of the proposed AHP-EWM-CRITIC combined weighting method.

4.2. Weight Sensitivity Analysis

Uncertainties arising from subjective judgment and data dispersion may affect the weight determination process. In the proposed AHP-EWM-CRITIC combined weighting scheme, AHP weights are mainly influenced by expert judgment, whereas EWM and CRITIC weights are related to the dispersion and correlation structure of the experimental data. Therefore, sensitivity analysis was conducted to examine whether weight uncertainty would affect the final fuzzy comprehensive evaluation result. In this section, the results of Test 1 are used as an example. OAT-based local perturbation, AHP weight perturbation, and Dirichlet-based global sampling are used to analyze the robustness of the evaluation results from different perspectives.

4.2.1. Local Perturbation Analysis and Tornado Plot Based on the OAT Method

The one-at-a-time (OAT) method [42] is used to evaluate the marginal effect of a single weight wj on the target output PExcellent by applying a relative perturbation of ±ρ, such as 10%, to the weight:
w ˜ j ± = w j ( 1 ± ρ )
To ensure that the sum of all weights remains equal to 1, the remaining weights are normalized as follows:
w ˜ k = w k 1 w ˜ j 1 w j ,   k j
The change in the target output PExcellent under the positive and negative perturbations of w ~ j is then calculated as follows:
Δ P Excellent ( + ) = P Excellent ( w ˜ j + ) P Excellent ( w j ) ,   Δ P Excellent ( ) = P Excellent ( w ˜ j ) P Excellent ( w j )
The maximum absolute change is used to construct the tornado plot:
L j   = max ( Δ P Excellent ( + ) , Δ P Excellent ( ) )
The local sensitivity coefficient can be approximated using the central difference method:
S j = P 1 w j w j P Excellent ( w ˜ ( + ) ) P Excellent ( w ˜ ( ) ) 2 ρ w j
This coefficient can be positive or negative, reflecting the direction and magnitude of the response of PExcellent to changes in wj. In addition, whether the evaluation grade changes under different perturbation conditions should be examined to assess the stability of the model output.
Taking PExcellent as the target output, the OAT sensitivity analysis results for ρ = 10% were calculated. The maximum impact and local sensitivity coefficient of each weight are presented in Table 16. The results are sorted in descending order according to the maximum impact Lj, and the weight numbers correspond to the order of the weights in the vector.
As shown in Figure 5, the two weights with the greatest influence on PExcellent are w3 and w4. However, the maximum change in PExcellent caused by either of these weights is only 0.0087. Moreover, none of the ± 10% perturbations applied to any single weight caused a change in the evaluation grade, indicating that local variations in the weights do not alter the final evaluation conclusion.

4.2.2. AHP Weight Perturbation Analysis Based on the OAT Method

Since the AHP weights are derived from expert judgment, fluctuations in expert scoring or judgment consistency may affect the subjective weight vector and further propagate to the final comprehensive weights. To examine the influence of subjective weighting uncertainty, an AHP weight perturbation analysis was performed. Different from the OAT analysis in Section 4.2.1, which directly perturbs the final comprehensive weights, this analysis perturbs the AHP weight vector before combined weighting. The EWM and CRITIC weights were kept unchanged, and the comprehensive weights were then recalculated using the geometric mean method.
Following the perturbation and normalization procedure described in Section 4.2.1, each AHP weight was perturbed by ±5% and ±10%, respectively. After each perturbation, the AHP weight vector was renormalized to satisfy the unit-sum constraint. The recalculated comprehensive weights were then substituted into the fuzzy comprehensive evaluation model, and the change in PExcellent was used to evaluate the influence of AHP weight uncertainty on the final matching result.
The sensitivity analysis results under AHP weight perturbations are shown in Table 17. As shown in the table, the maximum change in PExcellent caused by the ±5% AHP weight perturbation was 0.0015, and the maximum change caused by the ±10% perturbation was 0.0030. In both cases, the final evaluation grade remained “Excellent”, indicating that moderate fluctuations in the AHP subjective weights did not change the final matching conclusion. Compared with the direct perturbation of the comprehensive weights, the AHP perturbation analysis reflects the propagation effect of subjective judgment uncertainty through the combined weighting process. The small variation in the final evaluation result indicates that the AHP-EWM-CRITIC combined weighting scheme can effectively reduce the influence of subjective weight uncertainty on the final fuzzy comprehensive evaluation result.

4.2.3. Global Perturbation and Probabilistic Analysis Based on Dirichlet Sampling

In practical applications, uncertainty in weight values often exists. Dirichlet sampling [43] is used to simulate this uncertainty, thereby evaluating the probability distribution and robustness of the model output.
Samples are generated from a Dirichlet distribution using the initial weight vector w0 and a concentration parameter κ > 0. A larger value of κ indicates that the sampled weights are more concentrated around w0:
w ~ Dirichlet ( κ w 0 )
The Dirichlet samples can also be generated using the Gamma distribution as follows:
w j = X j / i = 1 n X i
For each sampled weight vector, the corresponding membership degree PExcellent and evaluation grade are calculated. Then, the probability of each evaluation grade, as well as the mean, standard deviation, and quantiles of PExcellent, are computed. The results are shown in Figure 6 and Figure 7.
The results show that the probability of obtaining an “Excellent” grade is as high as 99.94%, with a mean PExcellent value of 0.6411 and a standard deviation of 0.0378. The 5th, 25th, 50th, 75th, and 95th percentiles are 0.5770, 0.6157, 0.6425, 0.6671, and 0.7009, respectively. This indicates that, even when weight uncertainty is considered, the model output consistently remains at the “Excellent” grade, and the PExcellent values are concentrated within the range of 0.5770–0.7009, with only slight variation.
Both OAT and Dirichlet analyses confirm that the proposed framework is insensitive to weight perturbations. The evaluation grade remained “Excellent” under both local and global weight variations, demonstrating the robustness of the evaluation conclusion.

4.3. Comparison with Conventional Matching and Weighting Methods

To further evaluate the effectiveness of the proposed fuzzy-combined weighting model, a comparison with conventional multi-criteria matching methods was conducted. Since the evaluation framework in this study is constructed based on normalized time–frequency indicators, each impact signal was represented as a nine-dimensional normalized feature vector, and the penetration response signal was used as the target feature vector. Three conventional multi-criteria matching methods were selected for comparison, including grey relational analysis (GRA), technique for order preference by similarity to ideal solution (TOPSIS), and VIKOR, which is commonly used for multi-criteria optimization and compromise ranking [44,45,46]. GRA evaluates the relational closeness between the evaluated signal and the target signal, TOPSIS measures the relative closeness to the ideal solution, and VIKOR provides a compromise ranking based on the overall deviation and the maximum individual deviation from the target feature vector.
In the implementation of TOPSIS and VIKOR, the penetration response feature vector was used as the positive ideal or target vector. Because all indicators had been normalized into benefit-type matching scores, the zero vector was used as the negative ideal vector. The comparison results are summarized in Table 18.
As shown in Table 18, the conventional multi-criteria matching methods provide quantitative comparison results based on the normalized feature vectors. GRA, TOPSIS, and VIKOR all identify Test 3 as the closest to the penetration response signal from the perspective of feature-vector closeness. Specifically, Test 3 obtained the highest GRA value of 0.8182 and the highest TOPSIS value of 0.8249, while its VIKOR Q value was 0.0000, indicating the best compromise ranking among the three tests. This suggests that Test 3 has the smallest overall deviation from the target feature vector according to these conventional methods.
However, conventional multi-criteria matching methods usually provide only a single closeness or ranking score. They cannot directly describe the grade-level uncertainty of the matching result. In contrast, the proposed fuzzy comprehensive evaluation method integrates multidimensional indicators, AHP-EWM-CRITIC combined weights, and fuzzy membership classification. Therefore, it provides not only PExcellent, but also the membership degrees corresponding to the grades “Excellent,” “Satisfactory,” and “Unsatisfactory.” In the proposed method, Test 2 obtained the highest PExcellent value of 0.7818, followed by Test 3 and Test 1. This indicates that the proposed method evaluates the comprehensive matching quality from a fuzzy multi-criteria decision-making perspective, rather than only measuring the overall closeness between feature vectors.
The difference between the conventional methods and the proposed method indicates that feature-vector closeness and fuzzy grade membership describe different aspects of signal matching. Conventional methods are useful for identifying the signal closest to the target feature vector, whereas the proposed method further evaluates whether the weighted time-domain, frequency-domain, and signal quality indicators jointly satisfy the predefined matching grade. Therefore, the proposed method provides a more interpretable evaluation result for impact signal matching under experimental scatter.
To further compare the influence of different weighting schemes, the fuzzy comprehensive evaluation results obtained using equal weighting, AHP, EWM, CRITIC, and the proposed AHP-EWM-CRITIC combined weighting method are shown in Table 19. The penetration response signal was also evaluated using the same membership functions to provide a reference grade-membership benchmark. It should be noted that PExcellent of the penetration response signal is not a waveform similarity value equal to 1, but the membership degree of the reference signal to the “Excellent” grade under the same fuzzy evaluation criteria.
The results show that different weighting schemes lead to different PExcellent distributions. Equal-weight FCE does not consider the relative importance of indicators, whereas AHP-FCE is more strongly influenced by expert judgment. EWM-FCE and CRITIC-FCE introduce objective information from data dispersion and indicator conflict, but each single objective method emphasizes only one aspect of the data structure. In contrast, the proposed FCE combines expert judgment, data dispersion, and inter-indicator conflict through AHP-EWM-CRITIC combined weighting.
For the proposed FCE, the PExcellent value of Test 2 is 0.7818, which is very close to that of the penetration response signal, 0.7862, with an absolute difference of only 0.0044. This indicates that Test 2 has the closest grade-membership behavior to the penetration response signal under the proposed comprehensive evaluation framework. Compared with conventional single-score matching methods, the proposed method provides a more interpretable evaluation result because it simultaneously gives the matching grade, the grade membership degrees, and the influence of multidimensional weighted indicators.
Overall, the comparison results show that conventional multi-criteria matching methods are useful for describing the overall closeness between the impact signal feature vector and the penetration response feature vector. However, they provide only single-score results and cannot directly reflect the contribution of different indicator groups or the uncertainty of grade classification. The proposed fuzzy-combined weighting model provides a more comprehensive evaluation by combining feature-level comparison, indicator weighting, and fuzzy grade membership. Therefore, it is more suitable for impact signal matching evaluation under experimental scatter, where multiple signal characteristics jointly influence the final matching conclusion.

4.4. Scalability and Limitations of the Proposed Framework

The proposed fuzzy comprehensive evaluation framework was established and validated under the current medium-velocity penetration signal matching scenario. The framework integrates multidimensional time–frequency indicators, combined weighting, and fuzzy comprehensive evaluation, and the results demonstrate its effectiveness and robustness for the present test conditions. However, several limitations should be noted when the framework is extended to other impact scenarios or complex dynamic signal evaluation tasks.
First, the feature representation used in this study focuses on physically interpretable and computationally stable indicators. The selected time-domain, frequency-domain, and signal quality indicators can characterize the main response intensity, duration, spectral distribution, and stability of impact signals. However, these indicators may not fully capture localized energy–frequency variations during short-duration transient stages. Advanced joint time–frequency methods, such as short-time Fourier transform, wavelet transform, or Hilbert-Huang transform, can provide more detailed descriptions of local time-varying spectral characteristics. Therefore, these advanced features can be incorporated into the proposed framework in future work by defining additional time–frequency indicators, followed by normalization, combined weighting, and fuzzy comprehensive evaluation.
Second, the membership functions used in this study were established for the current medium-velocity penetration signal matching scenario. Their thresholds and shape parameters were determined based on the normalized indicator range, the measured penetration response signal, the distribution of the experimental samples, and expert experience. Therefore, these parameters should not be regarded as universal constants. When the framework is applied to other impact scenarios, the membership function parameters may be affected by material properties, projectile geometry, target configuration, impact velocity, sensor installation, and data acquisition conditions. For example, changes in target material or projectile structure may alter the amplitude, pulse width, dominant frequency, and time–frequency entropy of the response signal, thereby changing the appropriate grade boundaries. Therefore, representative data from the new application scenario should be used to redefine the indicator ranges and membership function parameters.
Third, the objective weights obtained using EWM and CRITIC may be affected by the quality of the experimental data. Both methods rely on the dispersion characteristics of the indicator data, and CRITIC further considers the correlation and conflict among indicators. Therefore, abnormal fluctuations caused by signal-to-noise ratio degradation, high-frequency electrical noise, sensor drift, or unstable data acquisition conditions may increase the apparent dispersion of noise-related indicators, such as SNR, noise power, and time–frequency entropy. This may lead to an overestimation of the objective weights associated with signal quality and stability indicators, thereby introducing bias into the comprehensive evaluation. In the present study, the OAT perturbation, AHP weight perturbation, and Dirichlet sampling analyses show that the final evaluation grade remains unchanged under moderate weight perturbations. However, when severe noise degradation or sensor drift occurs, signal preprocessing, denoising, sensor calibration, and abnormal-sample screening should be performed before objective weighting. In addition, the objective weights should be recalculated using representative data from the updated experimental condition to improve the reliability of the comprehensive evaluation.
These limitations do not affect the general structure of the proposed framework, because the indicator system, combined weighting strategy, and fuzzy comprehensive evaluation procedure can be retained, while the feature indicators, indicator ranges, and membership thresholds can be adjusted according to different engineering applications. In future work, the scalability of the proposed framework will be further validated under a wider range of impact conditions, including different target materials, projectile geometries, multi-layer target configurations, and impact velocities.

5. Conclusions

To address the difficulties in multiple-impact signal evaluation, including indicator diversity, feature complexity, and the influence of subjective judgment, this study proposed a fuzzy comprehensive evaluation framework based on time–frequency features and AHP-EWM-CRITIC combined weighting. Traditional evaluation methods often have difficulty balancing subjective and objective information, which may lead to unreasonable weight assignment and insufficient robustness of the evaluation results. The proposed framework was designed to quantitatively assess the matching degree between multiple-impact signals and the penetration response signal. The main conclusions are summarized as follows:
  • A multidimensional time–frequency feature indicator system was established, covering time-domain features, frequency-domain features, and signal quality and stability. This system consists of three primary indicators and nine secondary indicators, enabling the comprehensive quantification of the intensity, duration, frequency distribution, and noise-related characteristics of impact signals. It effectively addresses the limitations of traditional single-indicator evaluation methods, which cannot fully characterize the complex dynamic properties of impact signals;
  • A fuzzy comprehensive evaluation model integrated with AHP-EWM-CRITIC combined weighting was proposed. In this model, expert experience is incorporated through the analytic hierarchy process (AHP), objective information is extracted from the data using the entropy weight method (EWM), and correlations and conflicts among indicators are considered using the CRITIC method. The geometric mean method is then used to integrate the three types of weights and obtain comprehensive weights. The weight consistency tests show that the Spearman’s rank correlation coefficients between the comprehensive weights and the AHP and CRITIC weights are 0.48 and 0.63, respectively, indicating that the comprehensive weights maintain a certain degree of ranking consistency with AHP and CRITIC. The Euclidean distance analysis further shows that the average distance between the comprehensive weight vector and the three original weight vectors is 0.17, which is smaller than the average distance among the three original weight vectors. These results demonstrate that the proposed method achieves an effective balance between subjective and objective information and improves the rationality of weight assignment.
  • The validity and robustness of the proposed framework were experimentally verified. Based on case studies using three sets of multiple-impact signals and the penetration response signal, the results show that the matching degrees of all three test groups reached the “Excellent” grade, with “Excellent” membership degrees of 0.6411, 0.7818, and 0.7337, respectively. Among them, Test 2 achieved the best matching performance. Further robustness analysis showed that the maximum change in the “Excellent” membership degree caused by a ±10% perturbation in a single indicator weight was only 0.0087, and no change in the evaluation grade occurred. The Dirichlet-based global sampling analysis indicated that, under reasonable weight combinations, the probability of obtaining an “Excellent” evaluation result was as high as 99.94%. These results demonstrate that the proposed framework is insensitive to weight perturbations and that the evaluation conclusions are stable and reliable under the current medium-velocity penetration signal matching scenario.
Compared with previous single-indicator evaluation methods and conventional multi-criteria matching approaches, the proposed fuzzy comprehensive evaluation framework provides a more comprehensive and interpretable method for quantifying the matching degree between multiple-impact signals and penetration response signals. By integrating time–frequency indicators, AHP-EWM-CRITIC combined weighting, fuzzy membership classification, and robustness verification, the framework enables a more objective evaluation of the simulation performance of multiple-impact test setups. However, the method still has some limitations. The evaluation process is more complex than traditional single-score approaches because it requires indicator construction, combined weight calculation, and membership function setting. In addition, the evaluation results may be affected by the selected indicators, membership function parameters, and data quality. Since the present validation was conducted under the current medium-velocity penetration signal matching scenario, the feature indicators, indicator ranges, and membership function parameters should be redefined when the framework is applied to different impact conditions. Future work will further validate the scalability of the proposed framework under broader impact conditions, including different target materials, projectile geometries, multi-layer target configurations, impact velocities, and noise levels. After scenario-specific adjustment, the proposed framework may also provide a methodological reference for complex dynamic signal evaluation in structural monitoring, system validation, and other impact-like operating conditions.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/app16125990/s1, Figure S1: Measured penetration response acceleration signal used as the reference signal for matching evaluation; Figure S2: Multiple-impact signal curves of the 27 material test groups used to construct the sample set for normalization and objective weighting: (a) AISI 1020 steel; (b) AISI 1040 steel; (c) AISI 1060 steel; (d) 2A12 Al alloy; (e) 7020 Al alloy; (f) 7075 Al alloy; (g) AZ31B Mg alloy; (h) H62 brass; (i) S30153 stainless steel.

Author Contributions

Conceptualization, H.S. and S.M.; methodology, H.S., F.L. and R.X.; software, H.S. and K.J.; validation, H.S., K.J. and M.C.; formal analysis, S.M. and M.C.; investigation, H.S., F.L. and R.X.; data curation, H.S.; writing—original draft preparation, H.S. and K.J.; writing—review and editing, S.M.; visualization, F.L.; supervision, S.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Open Fund Project of Jiangsu Provincial Engineering Center for High-speed Railway Digital Twin Full-dimensional Intelligent Management, grant number GTZWJJ2026012.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data generated or analyzed during this study are included in the article. The data and intellectual property rights belong to Nanjing University of Science and Technology. The original contributions presented in this study are included in the article. Further inquiries regarding the data and intellectual property can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Xu, B.C.; Liu, J.Z.; Jin, Y.C.; Yang, K.Y.; Zhao, S.Y.; Peng, Y. Vibration–collision coupling modeling in grape clusters for non-damage harvesting operations. Agriculture 2025, 15, 154. [Google Scholar] [CrossRef]
  2. Mu, Z.J.; Huang, Z.W.; Sun, Z.W.; Wu, X.G.; Li, G.S.; Song, X.Z. Experimental study on dynamic characteristics of axial-torsional coupled percussive drilling. J. Pet. Sci. Eng. 2022, 219, 111094. [Google Scholar] [CrossRef]
  3. Wang, Y.L.; Li, C.S.; Wang, X.F. A multi-source information fusion layer counting method for penetration fuze based on TCN-LSTM. Def. Technol. 2024, 33, 463–474. [Google Scholar] [CrossRef]
  4. Zu, J.; Ma, X.; Zhang, Y.; Yu, D.; Dai, K.R. Adaptive end-side intelligent feature recognition system for acceleration measurement signals with strong adhesion interference under continuous multi-impact. Def. Technol. 2026. [Google Scholar] [CrossRef]
  5. Cascino, A.; Nencioni, L.; Lanzillo, L.; Mazzeo, F.; Strano, S.; Terzo, M.; Delle Monache, S.; Meli, E. Development and experimental validation of a physics-based digital twin for railway freight wagon monitoring. Sensors 2026, 26, 643. [Google Scholar] [CrossRef]
  6. Cascino, A.; Delle Monache, S.; Lanzillo, L.; Mazzeo, F.; Nencioni, L.; Nicolella, A.; Strano, S.; Terzo, M. Development and experimental testing of a 3D vision system for railway freight wagon monitoring. Appl. Sci. 2025, 15, 11547. [Google Scholar] [CrossRef]
  7. Cascino, A.; Meli, E.; Rindi, A.; Pucci, E.; Matoni, E. Experimental validation and dynamic analysis of additive manufacturing burner for gas turbine applications. Machines 2025, 13, 1111. [Google Scholar] [CrossRef]
  8. González-Barrio, H.; Calleja-Ochoa, A.; Lamikiz, A.; López de Lacalle, L.N. Manufacturing processes of integral blade rotors for turbomachinery, processes and new approaches. Appl. Sci. 2020, 10, 3063. [Google Scholar] [CrossRef]
  9. Ma, X.; Shi, H.F.; Miao, X.Y.; Li, Q.Y.; Wang, X.F.; Ding, L.B.; Zhang, H.; Dai, K.R. Multiple dynamic impact signal identification method based on lightweight neural network with acceleration sensor. IEEE Sens. J. 2023, 23, 17289–17300. [Google Scholar] [CrossRef]
  10. Li, F.Y.; Ma, S.J. Simulation and experimental research of continuous high impact test equipment. In Proceedings of the IOP Conference Series: Materials Science and Engineering; IOP Publishing Ltd.: Bristol, UK, 2018; Volume 428, p. 012015. [Google Scholar]
  11. Shi, H.F.; Tang, T.; Li, J.Y.; Li, F.Y.; Ma, S.J.; Zhang, X.P. Low-velocity, high-energy impact methodology for simulating overload responses during multilayer projectile penetration. Result Eng. 2026, 29, 109042. [Google Scholar] [CrossRef]
  12. Li, F.Y.; Ma, S.J. Analysis and experimental study of acceleration model for short interval and multiple impact equipment. Shock Vib. 2019, 2019, 5139137. [Google Scholar] [CrossRef]
  13. Yaralioglu, I.; Kara, C. Sustainable urban design approach for public spaces using an analytical hierarchy process (AHP). Land 2025, 14, 19. [Google Scholar] [CrossRef]
  14. Cao, Y.P.; Wang, Y.F.; Li, Y.T. Decision analysis method integrating EWM and fuzzy comprehensive evaluation. Procedia Comput. Sci. 2024, 247, 493–502. [Google Scholar] [CrossRef]
  15. Lu, X.S.; Ren, S.Y.; Cui, Y.X.; Yin, X.Y.; Chen, X.L.; Zhang, Y.X.; Moghtaderi, B. A novel site selection approach for Co-location of petrol-hydrogen fueling stations using a game theory-based multi-criteria decision-making model. Int. J. Hydrogen Energy 2025, 106, 1443–1461. [Google Scholar] [CrossRef]
  16. Guo, Z.Y.; Liu, J.N.; Liu, X.C.; Meng, Z.Y.; Pu, M.L.; Wu, H.Y.; Yan, X.; Yang, G.; Zhang, X.J.; Chen, C.L.; et al. An integrated MCDM model with enhanced decision support in transport safety using machine learning optimization. Knowl.-Based Syst. 2024, 301, 112286. [Google Scholar] [CrossRef]
  17. Roozkhosh, P.; Emroozi, V.B.; Modares, A. A new model to design a product under redundancy allocation problem and MCDM. Int. J. Syst. Assur. Eng. Manag. 2025, 16, 38–58. [Google Scholar] [CrossRef]
  18. Moktadir, M.A.; Paul, S.K.; Bai, C.G.; Santibanez Gonzalez, E.D.R. The current and future states of MCDM methods in sustainable supply chain risk assessment. Environ. Dev. Sustain. 2025, 27, 7435–7480. [Google Scholar] [CrossRef]
  19. Ferdous, J.; Bensebaa, F.; Milani, A.S.; Hewage, K.; Bhowmik, P.; Pelletier, N. Development of a generic decision tree for the integration of multi-criteria decision-making (MCDM) and multi-objective optimization (MOO) methods under uncertainty to facilitate sustainability assessment: A methodical review. Sustainability 2024, 16, 2684. [Google Scholar] [CrossRef]
  20. Wang, X.J.; Wang, L.L. An integrated AHP–CRITIC–VIKOR decision framework for engineering design and evaluation of children’s scooters. Appl. Sci. 2026, 16, 4179. [Google Scholar] [CrossRef]
  21. Dutta, P.; Deka, S. A novel approach to flood risk assessment: Synergizing with geospatial based MCDM-AHP model, multicollinearity, and sensitivity analysis in the Lower Brahmaputra Floodplain, Assam. J. Clean. Prod. 2024, 467, 142985. [Google Scholar] [CrossRef]
  22. Rai, A.K.; Malakar, S.; Goswami, S. Evaluating seismic risk by MCDM and machine learning for the eastern coast of India. Environ. Monit. Assess. 2024, 196, 471. [Google Scholar] [CrossRef] [PubMed]
  23. Alharasees, O.; Kilikevičius, A.; Kale, U. Strategic evaluation of urban electric vehicles charging infrastructure in budapest using integrated multi-criteria methods. In Proceedings of the 4th Cognitive Mobility Conference; Springer: Cham, Switzerland, 2026; Volume 1768, pp. 297–306. [Google Scholar]
  24. Chen, B.; Zang, Z.H.; Xiao, Y.C.; Ding, H.Y.; Lin, S.; Dong, M. Research on the AHP–EWM–VIKOR Model and Comprehensive Evaluation Method for Selecting Sites for Artificial Caverns in CAES. Processes 2025, 13, 4048. [Google Scholar] [CrossRef]
  25. Zhang, K.C.; Chen, Z.C.; Wang, Y.W. A novel approach for agricultural carbon emission reduction by integrating fermatean neutrosophic set with WINGS and AHP-EWM. Sci. Rep. 2025, 15, 391. [Google Scholar] [CrossRef] [PubMed]
  26. Ma, Q.P.; Li, H.Y. A decision support system for supplier quality evaluation based on MCDM-aggregation and machine learning. Expert Syst. Appl. 2024, 242, 122746. [Google Scholar] [CrossRef]
  27. Xu, S.; Murugesan, T.M.; Elfar, A.A.A.; Durairaj, M.P.R. Evaluation of sustainable manufacturing performance—A case illustration with multistakeholder perspective. J. Clean. Prod. 2024, 458, 142368. [Google Scholar] [CrossRef]
  28. Theilig, K.; Lourenço, B.; Reitberger, R.; Lang, W. Life cycle assessment and multi-criteria decision-making for sustainable building parts: Criteria, methods, and application. Int. J. Life Cycle Assess. 2024, 29, 1965–1991. [Google Scholar] [CrossRef]
  29. Shi, H.F.; Li, F.Y.; Jia, K.M.; Ma, S.J.; Zhang, X.P. Effects of target material properties on acceleration characteristics during sequential multiple-target impacts based on quantitative prediction models. Appl. Sci. 2026, 16, 5706. [Google Scholar] [CrossRef]
  30. Hou, J.; Gao, T.; Yang, Y.; Wang, X.; Yang, Y.N.; Meng, S.Y. Battery inconsistency evaluation based on hierarchical weight fusion and fuzzy comprehensive evaluation method. J. Energy Storage 2024, 84, 110878. [Google Scholar] [CrossRef]
  31. Cheng, Y.H.; Wang, M.Y.; Shi, C.C.; Li, L.; Sun, A. Review of experimental investigation of concrete target to resist missile impact in large velocity range. J. Zhejiang Univ. (Eng. Sci.) 2015, 49, 616–625. (In Chinese) [Google Scholar] [CrossRef]
  32. Liang, J.; Fan, X.H.; Li, T.; Xiao, S.F.; Ma, F. Study on the effect of load on the structural response of projectile during penetration process. Sci. Rep. 2025, 15, 15089. [Google Scholar] [CrossRef]
  33. Bendat, J.S.; Piersol, A.G. Random Data: Analysis and Measurement Procedures, 4th ed.; John Wiley & Sons: Hoboken, NJ, USA, 2010. [Google Scholar]
  34. Dubnov, S. Generalization of spectral flatness measure for non-Gaussian linear processes. IEEE Signal Process. Lett. 2004, 11, 698–701. [Google Scholar] [CrossRef]
  35. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
  36. Yu, D.J.; Yang, Y.; Cheng, J.S. Application of time–frequency entropy method based on Hilbert–Huang transform to gear fault diagnosis. Measurement 2007, 40, 823–830. [Google Scholar] [CrossRef]
  37. Saaty, T. Decision making with the Analytic Hierarchy Process. Int. J. Serv. Sci. 2008, 1, 83–98. [Google Scholar] [CrossRef]
  38. Zhu, Y.X.; Tian, D.Z.; Yan, F. Effectiveness of entropy weight method in decision-making. Math. Probl. Eng. 2020, 2020, 3564835. [Google Scholar] [CrossRef]
  39. Diakoulaki, D.; Mavrotas, G.; Papayannakis, L. Determining objective weights in multiple criteria problems. Crit. Method. Comput. Oper. Res. 1995, 22, 763–770. [Google Scholar] [CrossRef]
  40. Li, X.L.; Ma, Y.C.; Zhou, Q.M.; Zhang, X.H. Sparse large-scale high-order fuzzy cognitive maps guided by spearman correlation coefficient. Appl. Soft Comput. 2024, 167, 112253. [Google Scholar] [CrossRef]
  41. Mussabayev, R. Optimizing euclidean distance computation. Mathematics 2024, 12, 3787. [Google Scholar] [CrossRef]
  42. Jeon, S.; Kiessé, T.S.; Lemosquet, S.; Nozière, P. Sensitivity analysis of the INRA 2018 feeding system for ruminants by hybrid local and global approaches: Comparing the contribution of dietary input variables to multiple response prediction in dairy cattle. J. Dairy Sci. 2025, 108, 527–537. [Google Scholar] [CrossRef] [PubMed]
  43. Kim, A.; Mutel, C.; Hellweg, S. Global sensitivity analysis of correlated uncertainties in life cycle assessment. J. Ind. Ecol. 2025, 29, 1090–1104. [Google Scholar] [CrossRef]
  44. Deng, J.L. Control problems of grey systems. Syst. Control Lett. 1982, 1, 288–294. [Google Scholar] [CrossRef]
  45. Hwang, C.L.; Yoon, K. Multiple Attribute Decision Making: Methods and Applications: A State-of-the-Art Survey; Springer: Berlin/Heidelberg, Germany, 1981. [Google Scholar]
  46. Opricovic, S.; Tzeng, G.H. Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. Eur. J. Oper. Res. 2004, 156, 445–455. [Google Scholar] [CrossRef]
Figure 1. Schematic diagram of the multiple-impact test setup and photographs of key experimental components: (a) schematic diagram; (b) impact body; (c) target before and after impact.
Figure 1. Schematic diagram of the multiple-impact test setup and photographs of key experimental components: (a) schematic diagram; (b) impact body; (c) target before and after impact.
Applsci 16 05990 g001
Figure 2. Flowchart of the proposed fuzzy comprehensive evaluation framework based on time–frequency features and combined weighting. The arrows indicate the workflow and data-transfer direction between different steps of the proposed evaluation framework.
Figure 2. Flowchart of the proposed fuzzy comprehensive evaluation framework based on time–frequency features and combined weighting. The arrows indicate the workflow and data-transfer direction between different steps of the proposed evaluation framework.
Applsci 16 05990 g002
Figure 3. Schematic diagram of the multiple-impact test setup.
Figure 3. Schematic diagram of the multiple-impact test setup.
Applsci 16 05990 g003
Figure 4. Results of the three sets of multiple-impact signals: (a) Test 1; (b) Test 2; (c) Test 3.
Figure 4. Results of the three sets of multiple-impact signals: (a) Test 1; (b) Test 2; (c) Test 3.
Applsci 16 05990 g004
Figure 5. OAT local perturbation tornado chart under ±10% single-indicator weight perturbation.
Figure 5. OAT local perturbation tornado chart under ±10% single-indicator weight perturbation.
Applsci 16 05990 g005
Figure 6. Grade determination probability under Dirichlet-based weight perturbation with κ = 100 .
Figure 6. Grade determination probability under Dirichlet-based weight perturbation with κ = 100 .
Applsci 16 05990 g006
Figure 7. Weight distribution under Dirichlet-based perturbation.
Figure 7. Weight distribution under Dirichlet-based perturbation.
Applsci 16 05990 g007
Table 1. AHP judgment matrices for the evaluation criteria of impact signal matching.
Table 1. AHP judgment matrices for the evaluation criteria of impact signal matching.
Primary
Indicators
Time-Domain FeaturesFrequency-Domain FeaturesQuality and
Stability
Secondary
Indicators
AmplitudePulse WidthRMS
Time-domain
features
1 Amplitude1
Frequency-domain features 1 Pulse width 1
Quality and
stability
1RMS 1
Secondary
indicators
Total powerSpectral flatnessDominant frequencySecondary
indicators
SNRNoise powerTime–
frequency entropy
Total Power1 SNR1
Spectral flatness 1 Noise power 1
Dominant frequency 1Time–frequency entropy 1
Table 2. Extracted time–frequency feature indicators for matching impact signals with penetration response signals.
Table 2. Extracted time–frequency feature indicators for matching impact signals with penetration response signals.
Test CaseAmplitude (g)Pulse Width (ms)RMS (g)Total Power (g2)Spectral FlatnessDominant Frequency (Hz)SNR
(dB)
Noise Power (g2)Time–
Frequency Entropy
Penetration response signal−18,343.300.905413.894.62 × 10110.16611.009.113.89 × 10105.08
Test 1 impact signal−14,552.000.633532.651.25 × 10110.42497.510.755.05 × 10105.51
Test 2 impact signal−14,858.300.873922.591.54 × 10110.34523.731.755.81 × 10105.34
Test 3 impact signal−16,269.700.854550.732.07 × 10110.22510.215.094.63 × 10104.64
AISI 1020-1−19,288.001.095774.995.39 × 10110.09443.469.873.12 × 10104.52
AISI 1020-2−19,195.330.795422.984.61 × 10110.09443.4611.271.78 × 10104.61
AISI 1020-3−20,287.670.905234.764.42 × 10110.10443.4611.751.65 × 10104.75
AISI 1040-1−25,606.330.595639.664.15 × 10110.23554.328.683.05 × 10105.42
AISI 1040-2−23,561.330.726723.557.06 × 10110.07554.3210.783.28 × 10104.60
AISI 1040-3−23,743.000.765441.154.05 × 10110.10554.3211.451.58 × 10105.00
AISI 1060-1−22,776.490.828253.751.29 × 10120.05554.329.836.76 × 10104.61
AISI 1060-2−20,744.950.846802.728.74 × 10110.06554.3212.282.21 × 10104.70
AISI 1060-3−21,873.650.946826.828.39 × 10110.06443.4612.232.27 × 10104.58
2A12-1−10,861.000.652896.141.20 × 10110.19443.467.121.11 × 10105.50
2A12-2−11,097.000.552550.718.95 × 10100.19443.466.979.07 × 1095.42
2A12-3−12,782.000.833948.092.47 × 10110.11443.469.241.43 × 10104.83
7020-1−12,141.670.513305.021.39 × 10110.24443.466.691.54 × 10105.71
7020-2−15,065.670.503825.852.18 × 10110.14443.468.261.63 × 10105.35
7020-3−14,169.330.763998.132.57 × 10110.11443.468.281.78 × 10104.82
7075-1−14,939.670.414021.142.47 × 10110.11443.469.691.38 × 10104.89
7075-2−16,343.330.764929.224.01 × 10110.11443.469.492.19 × 10104.93
7075-3−16,099.670.604820.403.89 × 10110.09443.4610.221.83 × 10104.70
AZ31B-1−6563.000.671741.773.79 × 10100.15554.325.734.79 × 1095.36
AZ31B-2−7345.330.581877.255.44 × 10100.14443.463.948.83 × 1095.32
AZ31B-3−5739.670.531312.312.26 × 10100.11554.328.641.43 × 1095.22
H62-1−18,599.330.944415.732.86 × 10110.15443.469.891.51 × 10105.28
H62-2−19,088.670.985723.025.49 × 10110.07443.4610.832.27 × 10104.52
H62-3−18,096.000.794332.042.87 × 10110.07554.3217.832.80 × 1094.77
S30153-1−16,508.670.724498.143.28 × 10110.14554.327.502.91 × 10105.12
S30153-2−18,894.670.735200.973.88 × 10110.13554.329.312.80 × 10104.80
S30153-3−16,259.000.694270.972.52 × 10110.14443.4611.401.10 × 10105.19
Note: The data in this table were obtained from experimental tests performed in this study. The penetration response signal was obtained from a medium-velocity penetration test in which a projectile penetrated a three-layer concrete target at a velocity of 770 m/s, and it was used as the reference signal for matching evaluation. The multiple-impact signals and the 27 groups of material test results were obtained using the self-developed multiple-impact test setup [29]. The suffixes “-1”, “-2”, and “-3” indicate the first, second, and third tests conducted using the corresponding material, respectively. The curves of the penetration response signal and the 27 groups of material test results are provided as Figures S1 and S2 in the Supplementary Materials, respectively.
Table 3. Normalization parameter settings for the evaluation indicators.
Table 3. Normalization parameter settings for the evaluation indicators.
No.Evaluation IndicatorIndicator TypeSminSmax
1Amplitude (g)Negative indicator−16,000−10,000
2Pulse width (ms)Positive indicator0.200.80
3RMS (g)Positive indicator10005000
4Total power (g2)Positive indicator03.00 × 1011
5Spectral flatnessPositive indicator00.3
6Dominant frequency (Hz)Positive indicator0500
Negative indicator20005000
7SNR (dB)Negative indicator010
8Noise power (g2)Positive indicator2.00 × 10105.00 × 1010
9Time–frequency entropyPositive indicator25
Table 4. Normalized results of the secondary indicators.
Table 4. Normalized results of the secondary indicators.
Test No.Amplitude (g)Pulse Width (ms)RMS (g)Total Power (g2)Spectral FlatnessDominant Frequency (Hz)SNR (dB)Noise Power (g2)Time–Frequency Entropy
10.760.720.630.421.001.000.931.001.00
20.811.000.730.511.001.000.831.001.00
31.001.000.890.690.731.000.490.880.88
Table 5. Scoring form for primary indicators in impact signal matching evaluation.
Table 5. Scoring form for primary indicators in impact signal matching evaluation.
Primary IndicatorTime-Domain FeaturesFrequency-Domain FeaturesQuality and
Stability
Time-domain features157
Frequency-domain features1/512
Quality and stability1/71/21
Table 6. Weight calculation results for primary indicators in impact signal matching evaluation.
Table 6. Weight calculation results for primary indicators in impact signal matching evaluation.
No.Time-Domain FeaturesFrequency-Domain FeaturesQuality and Stability C R Consistency Test
10.740.170.090.01Passed
20.680.180.140.05Passed
30.540.100.360.08Passed
40.490.450.060.01Passed
50.580.080.331.28Failed
60.620.290.090.00Passed
70.730.200.070.08Passed
80.580.340.080.03Passed
90.440.470.080.00Passed
100.410.260.330.05Passed
110.500.070.430.02Passed
120.680.180.140.63Failed
130.560.370.070.07Passed
140.790.110.100.02Passed
150.510.080.410.05Passed
160.610.060.330.01Passed
170.510.410.080.05Passed
180.460.480.060.00Passed
190.630.110.260.03Passed
200.690.130.170.07Passed
Average Weight0.580.240.18
Table 7. Weight calculation results for secondary indicators of time-domain features.
Table 7. Weight calculation results for secondary indicators of time-domain features.
No.AmplitudePulse WidthRMS C R Consistency Test
10.690.130.170.07Passed
20.320.620.070.00Passed
30.610.170.220.08Passed
40.440.490.080.01Passed
50.410.500.090.03Passed
60.490.450.060.01Passed
70.710.140.140.00Passed
80.500.370.140.08Passed
90.660.070.270.04Passed
100.460.420.130.01Passed
110.670.260.070.63Failed
120.520.360.120.09Passed
130.770.140.090.05Passed
140.470.440.080.00Passed
150.690.190.130.08Passed
160.490.440.070.01Passed
170.580.360.060.05Passed
180.590.340.060.02Passed
190.440.500.060.02Passed
200.290.620.090.00Passed
Average Weight0.530.350.11
Table 8. Weight calculation results for secondary indicators of frequency-domain features.
Table 8. Weight calculation results for secondary indicators of frequency-domain features.
No.Total PowerSpectral FlatnessDominant Frequency C R Consistency Test
10.180.090.740.00Passed
20.080.570.360.05Passed
30.420.070.510.03Passed
40.420.090.480.02Passed
50.070.190.740.15Failed
60.210.080.720.02Passed
70.140.160.710.02Passed
80.170.190.630.01Passed
90.140.110.750.06Passed
100.100.170.730.03Passed
110.130.170.690.07Passed
120.100.090.810.00Passed
130.070.430.500.02Passed
140.130.420.460.01Passed
150.180.140.680.05Passed
160.430.100.470.00Passed
170.070.560.370.07Passed
180.080.170.750.09Passed
190.060.560.380.09Passed
200.140.060.800.09Passed
Average Weight0.170.220.61
Table 9. Weight calculation results for secondary indicators of signal quality and stability.
Table 9. Weight calculation results for secondary indicators of signal quality and stability.
No.SNRNoise PowerTime–Frequency Entropy C R Consistency Test
10.680.100.220.00Passed
20.410.080.510.05Passed
30.470.050.470.00Passed
40.450.090.450.00Passed
50.750.170.080.09Passed
60.480.160.361.18Failed
70.680.070.250.01Passed
80.600.200.200.00Passed
90.630.090.290.01Passed
100.140.090.770.05Passed
110.630.190.170.01Passed
120.370.080.550.07Passed
130.590.160.250.05Passed
140.590.050.360.03Passed
150.440.080.470.00Passed
160.570.070.360.05Passed
170.330.410.260.05Passed
180.360.060.580.05Passed
190.470.430.100.00Passed
200.370.410.220.32Failed
Average Weight0.490.140.37
Table 10. AHP weighting results for indicators at different levels.
Table 10. AHP weighting results for indicators at different levels.
Primary IndicatorWeightSecondary IndicatorLocal WeightGlobal Weight
Time-domain features0.5825Amplitude0.53340.3107
Pulse width0.35440.2064
RMS0.11220.0654
Frequency-domain features0.2382Total power0.17060.0406
Spectral flatness0.22250.0530
Dominant frequency0.60690.1446
Quality and stability0.1793SNR0.49220.0883
Noise power0.13730.0246
Time–frequency entropy0.37050.0664
Table 11. EWM weighting results for indicators at different levels.
Table 11. EWM weighting results for indicators at different levels.
Primary IndicatorWeightSecondary IndicatorGlobal Weight
Time-domain features0.4029Amplitude0.1252
Pulse width0.1416
RMS0.1361
Frequency-domain features0.4099Total power0.1332
Spectral flatness0.1319
Dominant frequency0.1448
Quality and stability0.1871SNR0.0418
Noise power0.0005
Time–frequency entropy0.1448
Table 12. CRITIC weighting results for indicators at different levels.
Table 12. CRITIC weighting results for indicators at different levels.
Primary IndicatorWeightSecondary IndicatorGlobal Weight
Time-domain features0.4728Amplitude0.2442
Pulse width0.0721
RMS0.1565
Frequency-domain features0.2830Total power0.1800
Spectral flatness0.1001
Dominant frequency0.0029
Quality and stability0.2443SNR0.1325
Noise power0.0854
Time–frequency entropy0.0264
Table 13. Comprehensive weighting results for impact signal matching evaluation.
Table 13. Comprehensive weighting results for impact signal matching evaluation.
Primary IndicatorWeightSecondary IndicatorLocal WeightGlobal Weight
Time-domain features0.5434Amplitude0.46890.2548
Pulse width0.28390.1543
RMS0.24720.1343
Frequency-domain features0.2734Total power0.43630.1193
Spectral flatness0.39070.1068
Dominant frequency0.17300.0473
Quality and stability0.1832SNR0.51730.0948
Noise power0.06680.0122
Time–frequency entropy0.41590.0762
Table 14. Final fuzzy comprehensive evaluation results for impact signals in Tests 1–3.
Table 14. Final fuzzy comprehensive evaluation results for impact signals in Tests 1–3.
Test No.PExcellentPSatisfactoryPUnsatisfactory
10.64110.42560.3854
20.78180.27410.2340
30.73370.28160.2249
Table 15. Importance rankings based on AHP, EWM, CRITIC, and comprehensive weights.
Table 15. Importance rankings based on AHP, EWM, CRITIC, and comprehensive weights.
Indicator R a n k   ( w j A H P ) R a n k   ( w j E W M ) R a n k   ( w j C R I ) R a n k   ( w j )
11711
22372
36433
48524
57655
63198
74846
89969
95287
Table 16. Results of the OAT-based weight sensitivity analysis. (ρ = 10%).
Table 16. Results of the OAT-based weight sensitivity analysis. (ρ = 10%).
WeightInitial WeightLj Δ P E x c e l l e n t ( + ) Δ P E x c e l l e n t ( ) Sj *
w30.13430.0087−0.00850.0087−0.6410
w40.11930.0077−0.00760.0077−0.6413
w50.10680.00390.0038−0.00390.3589
w10.25480.00370.0035−0.00370.1398
w90.07620.00280.0027−0.00280.3589
w70.09480.00270.0027−0.00270.2840
w60.04730.00170.0017−0.00170.3540
w20.15430.00140.0013−0.00140.0862
w80.01220.00040.0004−0.00040.3579
* The sign and magnitude of Sj indicate the direction and strength of the local sensitivity.
Table 17. Sensitivity analysis results under AHP weight perturbations.
Table 17. Sensitivity analysis results under AHP weight perturbations.
ρAHP Weight No.Initial Weight Δ P E x c e l l e n t A H P ( + ) Δ P E x c e l l e n t A H P ( ) L j A H P Evaluation Grade
5%10.31070.0006−0.00060.0006Excellent
20.20640.0002−0.00020.0002Excellent
30.0654−0.00140.00150.0015Excellent
40.0406−0.00130.00130.0013Excellent
50.05300.0006−0.00070.0007Excellent
60.14460.0003−0.00030.0003Excellent
70.08830.0004−0.00050.0005Excellent
80.02460.0001−0.00010.0001Excellent
90.06640.0004−0.00050.0005Excellent
10%10.31070.0011−0.00120.0012Excellent
20.20640.0004−0.00050.0005Excellent
30.0654−0.00280.00300.0030Excellent
40.0406−0.00250.00260.0026Excellent
50.05300.0012−0.00130.0013Excellent
60.14460.0005−0.00060.0006Excellent
70.08830.0009−0.00090.0009Excellent
80.02460.0001−0.00020.0002Excellent
90.06640.0009−0.00090.0009Excellent
Table 18. Comparison between conventional multi-criteria matching methods and the proposed fuzzy comprehensive evaluation method.
Table 18. Comparison between conventional multi-criteria matching methods and the proposed fuzzy comprehensive evaluation method.
Test No.GRATOPSISVIKOR QProposed PExcellentGrade
Test 10.58630.65241.00000.6411Excellent
Test 20.68090.70880.74680.7818Excellent
Test 30.81820.82490.00000.7337Excellent
Note: For GRA, TOPSIS, and PExcellent, larger values indicate better matching; for VIKOR Q, smaller values indicate better matching.
Table 19. Comparison of fuzzy comprehensive evaluation results under different weighting schemes.
Table 19. Comparison of fuzzy comprehensive evaluation results under different weighting schemes.
MethodTest 1 PExcellentTest 2 PExcellentTest 3 PExcellentPenetration
Response PExcellent
Equal-weigh FCE0.71420.82030.71070.6667
AHP-FCE0.76230.86840.83960.8341
EWM-FCE0.66080.80140.75950.8258
CRITIC-FCE0.58040.71100.63140.6820
Proposed FCE0.64110.78180.73370.7862
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Shi, H.; Jia, K.; Li, F.; Chen, M.; Xia, R.; Ma, S. A Fuzzy Comprehensive Evaluation Framework Integrating Time–Frequency Features and Combined Weighting for Matching Impact Signals with Multi-Layer Penetration Response Signals. Appl. Sci. 2026, 16, 5990. https://doi.org/10.3390/app16125990

AMA Style

Shi H, Jia K, Li F, Chen M, Xia R, Ma S. A Fuzzy Comprehensive Evaluation Framework Integrating Time–Frequency Features and Combined Weighting for Matching Impact Signals with Multi-Layer Penetration Response Signals. Applied Sciences. 2026; 16(12):5990. https://doi.org/10.3390/app16125990

Chicago/Turabian Style

Shi, Huifa, Kunming Jia, Feiyin Li, Mingxi Chen, Rongxiang Xia, and Shaojie Ma. 2026. "A Fuzzy Comprehensive Evaluation Framework Integrating Time–Frequency Features and Combined Weighting for Matching Impact Signals with Multi-Layer Penetration Response Signals" Applied Sciences 16, no. 12: 5990. https://doi.org/10.3390/app16125990

APA Style

Shi, H., Jia, K., Li, F., Chen, M., Xia, R., & Ma, S. (2026). A Fuzzy Comprehensive Evaluation Framework Integrating Time–Frequency Features and Combined Weighting for Matching Impact Signals with Multi-Layer Penetration Response Signals. Applied Sciences, 16(12), 5990. https://doi.org/10.3390/app16125990

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop