CWBCM method to determine the importance of classification performance evaluation criteria in machine learning: Case studies of COVID-19, Diabetes, and Thyroid Disease

Maede Parishani and Morteza Rasti-Barzoki

Omega, 2024, vol. 127, issue C

Abstract: Problems with multiple conflicting criteria are usually modeled by the methods proposed in the field of Multi-Criteria Decision Making (MCDM). In MCDM, one of the most important topics is the weighting of criteria. On the other hand, classification is employed in numerous real-world issues, like disease diagnosis. Diverse algorithms have been developed for this purpose. It is important to evaluate the classification performance in every problem by evaluating algorithms. The evaluation of algorithms includes several conflicting criteria; Therefore, it can be represented as an MCDM problem. We aim to develop a new weighting method that can be used for the classification problem with more than two classes, involve the risk of threatening human life, and consider minor features for different diseases in weighting. At present, none of the existing weighting methods fulfill these requirements. This research presents a new method called “Criteria Weighting Based on Confusion Matrix (CWBCM)” and our innovation is that, for the first time, all these gaps are filled with this method. This method calculates the exact importance of criteria using the confusion matrix in machine learning. The proposed method has been implemented on six different datasets of three diseases: COVID-19, thyroid, and diabetes, and compared with two common methods, Shannon and AHP. Two methods, TOPSIS and EDAS, were also used to rank the classifiers. Finally, the results show that our method is superior to the other two weighting methods in all critical factors and has unique features that other methods do not have.

Keywords: Multi-criteria decision-making (mcdm); Artificial intelligence; Machine Learning; COVID-19; Diabetes; Thyroid (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0305048324000628
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jomega:v:127:y:2024:i:c:s0305048324000628

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.omega.2024.103096

Access Statistics for this article

Omega is currently edited by B. Lev

More articles in Omega from Elsevier
Bibliographic data for series maintained by Catherine Liu ().