Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient

Xian, Shilai; Zhang, Li

doi:10.3390/math13111748

This is an early access version, the complete PDF, HTML, and XML versions will be available soon.

Open AccessFeature PaperArticle

Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient

by

Shilai Xian

and

Li Zhang

^*

Department of Mathematic and Statistics, Yunnan University, Kunming 650000, China

^*

Author to whom correspondence should be addressed.

Mathematics 2025, 13(11), 1748; https://doi.org/10.3390/math13111748

Submission received: 11 April 2025 / Revised: 11 May 2025 / Accepted: 21 May 2025 / Published: 25 May 2025

(This article belongs to the Section D: Statistics and Operational Research)

Download Versions Notes

Abstract

This study proposes a standardized robustness measurement framework for comprehensive evaluation models based on the intraclass correlation coefficient ICC(3,1), aiming to address the issue of non-unique evaluation results caused by the abundance of such models, as well as the lack of standardization and the arbitrariness in existing robustness testing procedures. Theoretical derivation and simulation confirm that ICC(3,1) correlates positively with Kendall’s W and negatively with RMSE and Normalized Inversion Index, demonstrating superior stability, discrimination, and interpretability. Under increased noise, ICC(3,1) maintains a balance between robustness and sensitivity, supporting its application in robustness evaluation and method selection.

Keywords: ICC(3,1); robustness measurement; comprehensive evaluation model; MSC: 62K99

Share and Cite

MDPI and ACS Style

Xian, S.; Zhang, L. Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient. Mathematics 2025, 13, 1748. https://doi.org/10.3390/math13111748

AMA Style

Xian S, Zhang L. Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient. Mathematics. 2025; 13(11):1748. https://doi.org/10.3390/math13111748

Chicago/Turabian Style

Xian, Shilai, and Li Zhang. 2025. "Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient" Mathematics 13, no. 11: 1748. https://doi.org/10.3390/math13111748

APA Style

Xian, S., & Zhang, L. (2025). Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient. Mathematics, 13(11), 1748. https://doi.org/10.3390/math13111748

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient

Abstract

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI