FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms

Yi Peng, Gang Kou, Guoxun Wang and Yong Shi

Omega, 2011, vol. 39, issue 6, 677-689

Abstract: Various methods and algorithms have been developed for multiclass classification problems in recent years. How to select an effective algorithm for a multiclass classification task is an important yet difficult issue. Since the multiclass algorithm selection normally involves more than one criterion, such as accuracy and computation time, the selection process can be modeled as a multiple criteria decision making (MCDM) problem. While the evaluations of algorithms provided by different MCDM methods are in agreement sometimes, there are situations where MCDM methods generate very different results. To resolve this disagreement and help decision makers pick the most suitable classifier(s), this paper proposes a fusion approach to produce a weighted compatible MCDM ranking of multiclass classification algorithms. Several multiclass datasets from different domains are used in the experimental study to test the proposed fusion approach. The results prove that MCDM methods are useful tools for evaluating multiclass classification algorithms and the fusion approach is capable of identifying a compromised solution when different MCDM methods generate conflicting rankings.

Keywords: Multicriteria; Decision; making; Ranking; Multiclass; classification; TOPSIS; VIKOR; PROMETHEE; WSM (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (48)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0305-0483(11)00030-2
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jomega:v:39:y:2011:i:6:p:677-689

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Omega is currently edited by B. Lev

More articles in Omega from Elsevier
Bibliographic data for series maintained by Catherine Liu ().