Classification by majority voting in feature partitions

Hari Seetha, M. Narasimha Murty and R. Saravanan

International Journal of Information and Decision Sciences, 2016, vol. 8, issue 2, 109-124

Abstract: Nearest neighbour classifier and support vector machine (SVM) are successful classifiers that are widely used in many important application areas. But both these classifiers suffer from the curse of dimensionality. Nearest neighbour search, in high dimensional data, using Euclidean distance is questionable since all the pair wise distances seem to be almost the same. In order to overcome this problem, we propose a novel classification system based on majority voting. Firstly, we partition the features into a number of blocks and construct a classifier for each block. The majority voting is then performed across all classifiers to determine the final class label. Classification is also performed using non-negative matrix factorisation (NNMF) that embeds high dimensional data into low dimensional space. Experiments were conducted on three of the benchmark datasets and the results obtained showed that the proposed system outperformed the conventional classification using both k-nearest neighbour (k-NN) and support vector machine (SVM) classifiers. The proposed system also showed better performance when compared with the classification performance of 1NN and SVM classifier using NNMF-based dimensionally reduced data.

Keywords: curse of dimensionality; classification; support vector machines; SVM; non-negative matrix factorisation; NNMF; nearest neighbour classifier; majority voting; feature partitions; k-nearest neighbour; k-NN. (search for similar items in EconPapers)
Date: 2016
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=76509 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijidsc:v:8:y:2016:i:2:p:109-124

Access Statistics for this article

More articles in International Journal of Information and Decision Sciences from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().