Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient

Shilai Xian and Li Zhang ()
Additional contact information
Shilai Xian: Department of Mathematic and Statistics, Yunnan University, Kunming 650000, China
Li Zhang: Department of Mathematic and Statistics, Yunnan University, Kunming 650000, China

Mathematics, 2025, vol. 13, issue 11, 1-20

Abstract: This study proposes a standardized robustness measurement framework for comprehensive evaluation models based on the Intraclass Correlation Coefficient (ICC(3,1)), The framework aims to address two key issues: (1) the non-unique evaluation results caused by the abundance of such models, and (2) the lack of standardization and the arbitrariness in existing robustness testing procedures. Theoretical derivation and simulation confirm that ICC(3,1) exhibits a positive correlation with Kendall’s Coefficient of Concordance (Kendall’s W) and a negative correlation with Root Mean Square Error (RMSE) and Normalized Inversion Index (NII), demonstrating superior stability, discrimination, and interpretability. Under increased noise levels, ICC(3,1) maintains a balance between robustness and sensitivity, supporting its application in robustness evaluation and method selection.

Keywords: ICC(3,1); robustness measurement; comprehensive evaluation model (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/11/1748/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/11/1748/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:11:p:1748-:d:1663945

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().