This section conducts simulation experiments to evaluate and compare the detection performance of various parameter settings and control chart methods, thereby verifying the practicality and superiority of the proposed method.
Section 4.1 describes how to use simulation to determine the appropriate control limit
L under different parameter combinations such that the
approximates the target value of 370.
Section 4.2 introduces the adopted Monte Carlo simulation method, including sample generation, algorithmic procedure, and the computation of evaluation metrics. In
Section 4.3, extensive simulations are conducted under four common distributions (normal, exponential, gamma, and
t-distribution), considering various parameter combinations and examining performance metrics such as
,
SDRL, and
MRL under different shifts to select suitable parameter settings for practical use. Finally,
Section 4.4 compares multiple control charts, including the proposed MA-Exp-EWMA control chart, to assess their detection capability and stability under various distributions.
4.3. Simulation Results
This section conducts simulation experiments under various distributional scenarios to evaluate the impact of different parameter settings on the detection performance of control charts, providing a basis for parameter selection in practical applications. Four different data distributions are considered: standard normal distribution , exponential distribution , gamma distribution , and Student’s t-distribution .
The selection of these four distributions was intended to evaluate the robustness of control charts across diverse data structures. The standard normal distribution
serves as the baseline for symmetric. To assess performance under heavy tails, we include the Student’s
t-distribution with 10 degrees of freedom, following the approach of Zou and Tsung (2011) [
15]. For skewed data, which are often present in practical processes, we adopt the
and the
distributions, representing high and moderate right skewness, respectively, both of which were used in the study by Talordphop et al. (2022) [
16].
In the simulation setup, three combinations of are considered: (0.5, 0), (0.5, 0.5), and (0.75, 0). The window size w is set to 3, 5, and 10; and the smoothing parameter is set to 0.05, 0.1, 0.2, and 0.4. Simulations are performed using these combinations to evaluate how different parameters affect detection performance.
First, Algorithm 1 from
Section 4.1 is used to determine the appropriate control limit
L, aiming for an average run length of approximately
under in-control conditions. Then, under various shift magnitudes
, Algorithm 2 is used to evaluate
,
SDRL, and
MRL under each configuration. These indicators help analyze the stability and sensitivity of each parameter combination in detecting anomalies, guiding parameter selection in real data applications.
4.3.1. Normal Distribution
Based on
Table 1,
Table 2 and
Table 3, several important observations can be made under the normal distribution
. First, regarding the smoothing parameter
, a general trend shows that as
increases, both
and
SDRL tend to increase across all
and window sizes
w. This indicates that larger
values delay anomaly detection and result in greater variability. Conversely, smaller
values respond more quickly to changes in variation but also introduce more fluctuation in detection.
Furthermore, for the (a, c) parameter combinations, the three settings being (0.5, 0), (0.5, 0.5), and (0.75, 0), the combination (0.5, 0.5) generally performs the worst, characterized by its higher and SDRL across configurations, indicating poorer detection performance. The (0.75, 0) parameter setting generally outperforms (0.5, 0.5). Furthermore, it often surpasses (0.5, 0), though its superiority over (0.5, 0) is not absolute and varies depending on the specific values of and w.
Finally, examining the effect of window size w, results show that when is large, increasing w helps reduce , meaning faster detection. However, when is small, increasing w tends to raise , indicating slower detection. Regardless of , SDRL consistently decreases as w increases, demonstrating that larger windows contribute to more stable detection by reducing run length variability.
4.3.2. Exponential Distribution
Based on
Table 4,
Table 5 and
Table 6, several key observations can be drawn under the exponential distribution
. First, we examine the impact of the smoothing parameter
on detection performance. Overall, as
increases, both the
and its
SDRL tend to decrease, indicating that increasing
enhances both detection speed and stability under skewed data. However, when
reaches 0.4,
and
SDRL rise again in some small-shift scenarios, suggesting that excessive smoothing may cause delayed detection. This effect is limited to small shifts; when the shift magnitude
increases, a larger
still helps accelerate detection, showing a typical improvement in sensitivity.
Regarding the performance of different combinations, it is found that their effectiveness highly depends on the window size w. When , the combination performs the worst overall, with relatively high and SDRL. However, when w increases to 5, becomes the best performer under extreme smoothing values and , suggesting a certain degree of robustness under extreme smoothing settings. Furthermore, when , consistently shows the best performance across almost all values, indicating its strong stability under long-window monitoring. As for the combinations and , they exhibit opposite trends: performs better with smaller w, while becomes more effective as w increases.
Finally, examining the effect of window size w, and excluding the specific case of with , the general trend shows that larger w leads to higher , meaning longer detection times. However, the behavior of SDRL is more complex, without a consistent increase or decrease as w increases. This reflects that under skewed distributions, detection stability is influenced by multiple interacting factors, rather than a single parameter.
4.3.3. Gamma Distribution
Based on
Table 7,
Table 8 and
Table 9, several key observations can be made regarding the detection performance under the gamma distribution
. First, with respect to the smoothing parameter
, as
increases, both the
and its
SDRL generally decrease, indicating that a larger
enhances both detection speed and stability. However, this trend does not hold in all cases. When the shift magnitude increases, the relationship between
and ARL may reverse, with larger
leading to longer
. Additionally, under small shifts with
, the
results for different
values vary inconsistently, indicating a more complex role of the smoothing parameter when using long window sizes. Hence,
should be adjusted based on the actual shift magnitude.
Regarding the impact of the parameter combinations, the three settings , , and show mixed results under different conditions, without a clearly dominant combination. This suggests that for data following a gamma distribution, the detection performance of these parameter settings is highly influenced by other factors such as and w, and thus, no universally optimal setting exists. Parameter selection should be made according to the specific application context.
Finally, considering the effect of window size w, the overall trend shows that both and SDRL tend to increase as w increases. This implies that although a longer monitoring window helps smooth out fluctuations, it may also delay detection and potentially reduce detection stability. Therefore, under the gamma distribution, special attention should be given to balancing window size and smoothing strength to avoid compromising detection efficiency.
4.3.4. t-Distribution
Based on
Table 10,
Table 11 and
Table 12, several key observations can be made regarding the detection performance under the
distribution. First, regarding the smoothing parameter
, as
increases, both the
and its
SDRL tend to rise. This indicates that under heavy-tailed distributions, an overly high degree of smoothing slows down and destabilizes the detection response. A smaller
is therefore recommended to improve detection efficiency.
Regarding the impact of the parameter combinations, simulation results show that consistently performs the worst, while the performance of and varies depending on other conditions. Overall, tends to outperform under most configurations, particularly when the smoothing level is moderate or the window size is medium.
As for the effect of window size w, does not exhibit a consistent trend as w increases, suggesting a complex relationship between window length and detection speed under the distribution, likely influenced by data volatility. In contrast, the behavior of SDRL is more consistent: as w increases, SDRL clearly decreases, indicating that a larger window size effectively smooths variability and improves detection stability. Therefore, under the t-distribution, moderately increasing the window size can help reduce false alarms and signal fluctuations, though changes in should still be considered to avoid detection delays.
4.3.5. Overview of Simulation Results
Based on the simulation results across the four types of distributions, the optimal parameter configuration chosen in this study is , , and . Regarding the smoothing parameter , in symmetric distributions (e.g., and ), a smaller generally yields faster detection, reflected in lower and SDRL. However, in asymmetric distributions (e.g., and ), a larger tends to enhance detection performance. Thus, to balance performance across different distribution types, is selected as a compromise.
As for the window size w, although larger values typically improve SDRL in symmetric distributions, they lead to higher and SDRL in asymmetric settings, causing delayed detection due to over-smoothing. Therefore, a smaller window size is chosen to avoid excessive latency, achieving a trade-off between responsiveness and stability.
Regarding the combinations, the configuration performs the worst in symmetric distributions ( and ) in terms of both and SDRL, and it also underperforms in when . Hence, it is not recommended. Between and , the latter generally shows superior performance in symmetric distributions and also performs better in under small window settings. Based on the above findings, is selected as the final recommended combination.
In summary, the MA-Exp-EWMA control chart configured with , , and achieves a good balance between detection sensitivity and stability, performing well under both symmetric and asymmetric distributions. This parameter set can be further applied to real-world monitoring scenarios such as financial anomaly detection, quality control, or environmental surveillance to verify its practical robustness and effectiveness. Adjustments can also be made depending on specific application needs to optimize monitoring performance.
4.4. Simulation Comparison
Following the recommendations from the simulation results in
Section 4.3, the MA-Exp-EWMA control chart adopts the parameter setting
,
,
, and
. To evaluate its overall detection performance, it is compared against conventional and enhanced control charts, including Shewhart, MA, EWMA, MA-EWMA, and Exp-EWMA.
Simulations are conducted under four commonly used distributions: , , , and , to examine the performance of each method across distributional shapes. Recognizing that distribution symmetry may affect results, simulation scenarios are categorized into “symmetric” (comprising and ) and “asymmetric” (comprising and ) to further explore their impact on detection performance.
4.4.1. Normal and t-Distributions
In this section, symmetric distributions are considered using the standard normal
and the
distribution. The performance of various control charts is evaluated across different levels of shift
. Simulation results are summarized in
Table 13 and
Table 14. These results are discussed below in terms of three key metrics:
,
SDRL, and
MRL.
From the results, under small shifts (), the proposed MA-Exp-EWMA chart exhibits the best performance in both and SDRL, offering the shortest average detection time and the most stable variation. This advantage is consistent across both symmetric distributions, confirming its strength in early detection of small shifts.
For moderate shifts (), MA-Exp-EWMA continues to lead in SDRL, indicating sustained stability. However, its becomes slightly less optimal than that of Exp-EWMA, suggesting that Exp-EWMA may detect medium shifts slightly faster. Still, MA-Exp-EWMA remains more stable overall.
When shifts are large (), the EWMA control chart achieves the lowest , indicating the fastest alarm, while Exp-EWMA exhibits the lowest SDRL, reflecting high detection stability. In this case, although MA-Exp-EWMA is slightly outperformed, it still demonstrates reasonable detection speed and excellent stability, making it a practical choice across the full range of shift magnitudes.
Regarding
MRL, MA-Exp-EWMA often holds an advantage for small to moderate shifts, with only a slight drop under large shifts compared to some other methods. Overall, the MA-Exp-EWMA control chart shows strong and consistent performance under symmetric distributions, especially suited for early detection applications such as process monitoring. Its comprehensive performance is also visualized in
Figure 1.
4.4.2. Exponential and Gamma Distributions
In this section, we analyze commonly encountered asymmetric distributions by evaluating the performance of control charts under the exponential distribution
and the gamma distribution
, across various shift magnitudes
. Simulation results are summarized in
Table 15 and
Table 16, and are discussed below using three key indicators—
,
SDRL, and
MRL.
Overall, across all shift levels, the Exp-EWMA control chart demonstrates the best performance in most scenarios in terms of , SDRL, and MRL, indicating both fast and stable detection capabilities. The MA-Exp-EWMA control chart, in contrast, outperforms other methods in SDRL only at shift levels and , suggesting that it provides relatively stable detection under moderate shift conditions.
Although MA-Exp-EWMA is not the top-performing method under very small or very large shifts—and generally lags in the
MRL metric—it still maintains reasonable stability across most settings. In particular, it exhibits favorable performance under moderate shifts in asymmetric data. Thus, this method retains practical potential and application value when dealing with asymmetric data characterized by moderate shifts and stable variance. The overall results are illustrated in
Figure 2.
4.4.3. Overview of Simulation Comparisons
Simulation results show that the proposed MA-Exp-EWMA control chart performs consistently well for symmetric distributions (e.g., normal and t), offering advantages in both detection speed () and stability (SDRL), indicating strong practical applicability.
For highly skewed distributions (e.g., exponential and gamma), the Exp-EWMA control chart generally achieves the best results, especially under large shifts. Although MA-Exp-EWMA excels in SDRL under moderate shifts, it performs less favorably in MRL and under extreme conditions.
In practice, real-world data often deviate from idealized distributions and rarely exhibit extreme skewness. The MA-Exp-EWMA control chart balances sensitivity and smoothness, enabling prompt response to early shifts and stable detection across a range of symmetric and moderately skewed data. Its superior SDRL further highlights robustness against variability.
Thus, excluding highly skewed scenarios, the MA-Exp-EWMA control chart is a flexible and reliable choice for applications requiring both accuracy and consistency.