Interpretable Multivariate Process Monitoring Using MEWMA and Explainable Machine Learning
Abstract
1. Introduction
- (1)
- Integration of MEWMA-based monitoring with supervised ML for multivariate IC/OOC classification,
- (2)
- Learning of nonlinear decision boundaries from MEWMA-generated IC/OOC labels using supervised ML models,
- (3)
- Use of SHAP analysis to explain variable-level contributions to OOC classifications,
- (4)
- Development of an interpretable and data-driven framework that links IC/OOC classification with explainable ML.
2. Background
2.1. Multivariate Exponentially Weighted Moving Average (MEWMA) Control Chart
2.2. Machine Learning (ML)
2.2.1. Extreme Gradient Boosting (XGBoost)
2.2.2. Random Forest (RF)
2.2.3. Support Vector Machine (SVM)
2.2.4. Light Gradient Boosting Machine (LightGBM)
2.2.5. Logistic Regression (LR)
2.2.6. Categorical Boosting (CatBoost)
2.2.7. K-Nearest Neighbors (KNN)
2.3. SHAP Analysis
3. Methodology
3.1. Data Collection and Preprocessing
- The dataset was verified to be free of missing observations, and the measurement records were pre-reviewed for data quality; this review revealed no records indicating missing data or measurement/data entry errors.
- Although MEWMA analysis is theoretically based on the assumption of multivariate normality, data transformation was not applied because MEWMA is relatively robust to moderate deviations from normality, as reported by Stoumbos and Sullivan [13].
- For MEWMA-based labeling, the original dimensional measurements were used to preserve the natural covariance structure of the process. Z-score standardization was applied only in the ML stage for scale-sensitive models, namely KNN, SVM, and Logistic Regression. Tree-based models, including XGBoost, Random Forest, LightGBM, and CatBoost, were trained using the original feature scale, since their splitting mechanisms are not directly affected by feature scaling. Standardization was particularly necessary for KNN because distance-based classification may otherwise be dominated by variables with larger numerical ranges.
3.2. MEWMA Chart and Labeling OOC Signals
3.3. Classification with ML Algorithms
3.4. SHAP Explainability Analysis
3.5. Computational Efficiency and Real-Time Applicability
4. Results and Discussion
5. Conclusions and Limitations
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Montgomery, D.C. Introduction to Statistical Quality Control; John Wiley & Sons: New York, NY, USA, 2020. [Google Scholar]
- Yeganeh, A.; Johannssen, A.; Chukhrova, N. The partitioning ensemble control chart for on-line monitoring of high-dimensional image-based quality characteristics. Eng. Appl. Artif. Intell. 2024, 127, 107282. [Google Scholar] [CrossRef]
- Kazmi, M.W.; Noor-ul-Amin, M. Integrating machine learning based EWMA control charts for multivariate process monitoring. Comput. Ind. Eng. 2025, 204, 111131. [Google Scholar] [CrossRef]
- Weix, D.; Cath, T.Y.; Hering, A.S. Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches. Qual. Reliab. Eng. Int. 2024, 40, 2822–2840. [Google Scholar] [CrossRef]
- Sabahno, H.; Amiri, A. New statistical and machine learning based control charts with variable parameters for monitoring generalized linear model profiles. Comput. Ind. Eng. 2023, 184, 109562. [Google Scholar] [CrossRef]
- Yao, W.; Li, D.; Gao, L. Fault detection and diagnosis using tree-based ensemble learning methods and multivariate control charts for centrifugal chillers. J. Build. Eng. 2022, 51, 104243. [Google Scholar] [CrossRef]
- Bersimis, S.; Sgora, A.; Psarakis, S. Methods for interpreting the out-of-control signal of multivariate control charts: A comparison study. Qual. Reliab. Eng. Int. 2017, 33, 2295–2326. [Google Scholar] [CrossRef]
- Ali, S.; Abuhmed, T.; El-Sappagh, S.; Muhammad, K.; Alonso-Moral, J.M.; Confalonieri, R.; Guidotti, R.; Del Ser, J.; Díaz-Rodríguez, N.; Herrera, F. Explainable artificial intelligence (XAI): What we know and what is left to attain trustworthy artificial intelligence. Inf. Fusion 2023, 99, 101805. [Google Scholar] [CrossRef]
- Lundberg, S.M.; Lee, S.-I. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems; Curran Associates: Red Hook, NY, USA, 2017; pp. 4765–4774. [Google Scholar]
- Lundberg, S.M.; Erion, G.; Chen, H.; DeGrave, A.; Prutkin, J.M.; Nair, B.; Katz, R.; Himmelfarb, J.; Bansal, N.; Lee, S.-I. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2020, 2, 56–67. [Google Scholar] [CrossRef] [PubMed]
- Lowry, C.A.; Woodall, W.H.; Champ, C.W.; Rigdon, S.E. A multivariate exponentially weighted moving average control chart. Technometrics 1992, 34, 46–53. [Google Scholar] [CrossRef]
- Bersimis, S.; Psarakis, S.; Panaretos, J. Multivariate statistical process control charts: An overview. Qual. Reliab. Eng. Int. 2007, 23, 517–543. [Google Scholar] [CrossRef]
- Stoumbos, Z.G.; Sullivan, J.H. Robustness to non-normality of the multivariate EWMA control chart. J. Qual. Technol. 2002, 34, 260–276. [Google Scholar] [CrossRef]
- Woodall, W.H. Controversies and contradictions in statistical process control. J. Qual. Technol. 2000, 32, 341–350. [Google Scholar] [CrossRef]
- Mason, R.L.; Tracy, N.D.; Young, J.C. Decomposition of T2 for multivariate control chart interpretation. J. Qual. Technol. 1995, 27, 99–108. [Google Scholar] [CrossRef]
- Johannssen, A.; Qiu, P.; Yeganeh, A.; Chukhrova, N. Explainable AI for trustworthy intelligent process monitoring. Comput. Ind. Eng. 2025, 209, 111407. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; ACM: New York, NY, USA, 2016; pp. 785–794. [Google Scholar] [CrossRef]
- Zhao, Z.; Duan, W.; Cai, G.; Wu, M.; Liu, S. CPT-based fully probabilistic seismic liquefaction potential assessment to reduce uncertainty: Integrating XGBoost algorithm with Bayesian theorem. Comput. Geotech. 2022, 149, 104868. [Google Scholar] [CrossRef]
- Khan, A.A.; Chaudhari, O.; Chandra, R. A review of ensemble learning and data augmentation models for class imbalanced problems: Combination, implementation and evaluation. Expert Syst. Appl. 2024, 244, 122778. [Google Scholar] [CrossRef]
- Nijman, S.W.J.; Leeuwenberg, A.M.; Beekers, I.; Verkouter, I.; Jacobs, J.J.L.; Bots, M.L.; Asselbergs, F.W.; Moons, K.G.M.; Debray, T.P.A. Missing data is poorly handled and reported in prediction model studies using machine learning: A literature review. J. Clin. Epidemiol. 2022, 142, 218–229. [Google Scholar] [CrossRef] [PubMed]
- Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
- Belgiu, M.; Dragut, L. Random forest in remote sensing: A review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 2016, 114, 24–31. [Google Scholar] [CrossRef]
- Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- Oliveira, R.M.A.; Sant’Anna, Â.M.O.; da Silva, P.H.F. Explainable machine learning models for defects detection in industrial processes. Comput. Ind. Eng. 2024, 192, 110214. [Google Scholar] [CrossRef]
- Hastie, T.; Tibshirani, R.; Friedman, J. The Elements of Statistical Learning; Springer: New York, NY, USA, 2009. [Google Scholar]
- Cervantes, J.; Garcia-Lamont, F.; Rodríguez-Mazahua, L.; Lopez, A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing 2020, 408, 189–215. [Google Scholar] [CrossRef]
- Ke, G.; Meng, Q.; Finley, T.; Wang, T.; Chen, W.; Ma, W.; Ye, Q.; Liu, T.Y. LightGBM: A highly efficient gradient boosting decision tree. Adv. Neural Inf. Process. Syst. 2017, 30, 3149–3157. [Google Scholar]
- González, S.; García, S.; Del Ser, J.; Rokach, L.; Herrera, F. A practical tutorial on bagging and boosting based ensembles for machine learning. Inf. Fusion 2020, 64, 205–237. [Google Scholar] [CrossRef]
- Meng, Q.; Ke, G.; Wang, T.; Chen, W.; Ye, Q.; Ma, Z.M.; Liu, T.Y. A communication-efficient parallel algorithm for decision tree. Adv. Neural Inf. Process. Syst. 2016, 29, 1279–1287. [Google Scholar]
- Mienye, I.D.; Sun, Y.X. A survey of ensemble learning: Concepts, algorithms, applications, and prospects. IEEE Access 2022, 10, 99129–99149. [Google Scholar] [CrossRef]
- Nikolaou, D.; Ziakopoulos, A.; Dragomanovits, A.; Roussou, J.; Yannis, G. Comparing machine learning techniques for predictions of motorway segment crash risk level. Safety 2023, 9, 32. [Google Scholar] [CrossRef]
- Prokhorenkova, L.; Gusev, G.; Vorobev, A.; Dorogush, A.V.; Gulin, A. CatBoost: Unbiased boosting with categorical features. Adv. Neural Inf. Process. Syst. 2018, 31, 6639–6649. [Google Scholar]
- Ben Jabeur, S.; Gharib, C.; Mefteh-Wali, S.; Ben Arfi, W. CatBoost model and artificial intelligence techniques for corporate failure prediction. Technol. Forecast. Soc. Change 2021, 166, 120658. [Google Scholar] [CrossRef]
- Cover, T.; Hart, P. Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 1967, 13, 21–27. [Google Scholar] [CrossRef]
- Yang, Y.; Liu, X. A re-examination of text categorization methods. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; ACM Press: New York, NY, USA, 1999; pp. 42–49. [Google Scholar]
- Weinberger, K.Q.; Saul, L.K. Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 2009, 10, 207–244. [Google Scholar]
- Ponce-Bobadilla, A.V.; Schmitt, V.; Maier, C.S.; Mensing, S.; Stodtmann, S. Practical guide to SHAP analysis. Clin. Transl. Sci. 2024, 17, e70056. [Google Scholar] [CrossRef] [PubMed]
- Schulte, L.; Ledel, B.; Herbold, S. Studying explanations for automated prediction of bug issues using LIME and SHAP. Empir. Softw. Eng. 2024, 29, 93. [Google Scholar] [CrossRef]












| Model | Search Range/Fixed Configuration | Final Configuration | Class Weighting | Seed |
|---|---|---|---|---|
| XGBoost | n_estimators ∈ {100, 200}; | 100; | scale_pos_weight = 1.50 | 42 |
| max_depth ∈ {3,4,5}; | 3; | |||
| learning_rate ∈ {0.1, 0.2}; | 0.1; | |||
| subsample ∈ {0.8, 1.0}; | 0.8; | |||
| min_child_weight ∈ {1, 3, 5}; | 1; | |||
| gamma ∈ {0, 0.1, 0.2} | 0.2 | |||
| Random Forest | n_estimators; max_depth | 200; 5 | balanced | 42 |
| SVM | kernel; C; gamma; | RBF kernel; 1.0; scale | balanced | 42 |
| LightGBM | n_estimators; learning rate; max depth; | 300; 0.05; 5 | balanced | 42 |
| LR | C; solver; maximum iterations | 1.0; liblinear; 1000 | balanced | 42 |
| CatBoost | iterations; depth; learning rate | 300; 5; 0.05 | scale_pos_weight = 1.50 | 42 |
| KNN | k; weighting; metric; p | 5; distance; Minkowski; p = 2 (Euclidean) | None | N/A |
| Performance Metrics | XGBoost | RF | SVM | LightGBM | LR | CatBoost | KNN |
|---|---|---|---|---|---|---|---|
| Accuracy | 0.8100 | 0.7900 | 0.7950 | 0.7550 | 0.7400 | 0.7950 | 0.7350 |
| Precision | 0.8088 | 0.7500 | 0.7241 | 0.6598 | 0.6591 | 0.7746 | 0.6392 |
| Recall | 0.6875 | 0.7125 | 0.7875 | 0.8000 | 0.7250 | 0.6875 | 0.7750 |
| F1 Score | 0.7432 | 0.7308 | 0.7545 | 0.7232 | 0.6905 | 0.7285 | 0.7006 |
| ROC AUC | 0.8365 | 0.8375 | 0.8174 | 0.8341 | 0.7386 | 0.8353 | 0.8129 |
| Confusion Matrix |
| Comparison | p-Value | Significant (α = 0.05) |
|---|---|---|
| XGBoost vs. CatBoost | 0.508 | No |
| XGBoost vs. SVM | 0.728 | No |
| XGBoost vs. RF | 0.503 | No |
| XGBoost vs. LightGBM | 0.061 | No |
| XGBoost vs. LR | 0.029 | Yes |
| XGBoost vs. KNN | 0.028 | Yes |
| CatBoost | SVM | RF | LightGBM | LR | KNN | |
|---|---|---|---|---|---|---|
| XGBoost | 0.996 | 1.000 | 0.376 | 0.951 | <0.001 | <0.001 |
| Case (Status = 1) | Property Values (Diameter, Height, Thickness) | Main Contributing Feature (Contribution of %) | Second Contribution (Contribution of %) |
|---|---|---|---|
| #23 | 134.20, 163.77, 27.03 | Height—66.1% | Diameter—30.5% |
| #94 | 142.8, 161.89, 28.23 | Diameter—69.55% | Thickness—23.76% |
| #241 | 132.46, 162.01, 26.3 | Thickness—82.84% | Diameter—12.68% |
| Processing Step | Mean Time (s) | Standard Deviation (s) | Median (s) | 95th Percentile (s) |
|---|---|---|---|---|
| MEWMA update | 0.000055 | 0.000009 | 0.000055 | 0.00007 |
| XGBoost prediction | 0.010742 | 0.025676 | 0.002093 | 0.08734 |
| SHAP explanation | 0.084255 | 0.030924 | 0.096790 | 0.10032 |
| Total processing time | 0.095052 | 0.035659 | 0.099403 | 0.18292 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Beylihan, E.; Beykent, A.; Elevli, S. Interpretable Multivariate Process Monitoring Using MEWMA and Explainable Machine Learning. Mathematics 2026, 14, 2328. https://doi.org/10.3390/math14132328
Beylihan E, Beykent A, Elevli S. Interpretable Multivariate Process Monitoring Using MEWMA and Explainable Machine Learning. Mathematics. 2026; 14(13):2328. https://doi.org/10.3390/math14132328
Chicago/Turabian StyleBeylihan, Eda, Ahad Beykent, and Sermin Elevli. 2026. "Interpretable Multivariate Process Monitoring Using MEWMA and Explainable Machine Learning" Mathematics 14, no. 13: 2328. https://doi.org/10.3390/math14132328
APA StyleBeylihan, E., Beykent, A., & Elevli, S. (2026). Interpretable Multivariate Process Monitoring Using MEWMA and Explainable Machine Learning. Mathematics, 14(13), 2328. https://doi.org/10.3390/math14132328

