Roza: a new and comprehensive metric for evaluating classification systems

Mesut Melek and Negin Melek

Computer Methods in Biomechanics and Biomedical Engineering, 2022, vol. 25, issue 9, 1015-1027

Abstract: Many metrics such as accuracy rate (ACC), area under curve (AUC), Jaccard index (JI), and Cohen’s kappa coefficient are available to measure the success of the system in pattern recognition and machine/deep learning systems. However, the superiority of one system to one other cannot be determined based on the mentioned metrics. This is because such a system can be successful using one metric, but not the other ones. Moreover, such metrics are insufficient when the number of samples in the classes is unequal (imbalanced data). In this case, naturally, by using these metrics, a sensible comparison cannot be made between two given systems. In the present study, the comprehensive, fair, and accurate Roza (Roza means rose in Persian. When different permutations of the metrics used are superimposed in a polygon format, it looks like a flower, so we named it Roza.) metric is introduced for evaluating classification systems. This metric, which facilitates the comparison of systems, expresses the summary of many metrics with a single value. To verify the stability and validity of the metric and to conduct a comprehensive, fair, and accurate comparison between the systems, the Roza metric of the systems tested under the same conditions are calculated and comparisons are made. For this, systems tested with three different strategies on three different datasets are considered. The results show that the performance of the system can be summarized by a single value and the Roza metric can be used in all systems that include classification processes, as a powerful metric.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/10255842.2021.1995721 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:gcmbxx:v:25:y:2022:i:9:p:1015-1027

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/gcmb20

DOI: 10.1080/10255842.2021.1995721

Access Statistics for this article

Computer Methods in Biomechanics and Biomedical Engineering is currently edited by Director of Biomaterials John Middleton

More articles in Computer Methods in Biomechanics and Biomedical Engineering from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().