 Combining multiple classifiers for wrapper feature selectionKyriacos Chrysostomou, Sherry Y. Chen and Xiaohui Liu International Journal of Data Mining, Modelling and Management, 2008, vol. 1, issue 1, 91-102 Abstract: Wrapper feature selection methods are widely used to select relevant features. However, wrappers only use a single classifier. The downside to this approach is that each classifier will have its own biases and will therefore select very different features. In order to overcome the biases of individual classifiers, this study introduces a new data mining method called wrapper-based decision trees (WDT), which combines different classifiers and uses decision trees to classify selected features. The WDT method combines multiple classifiers so selecting classifiers for use in the combinations is an important issue. Thus, we investigate how the number and nature of classifiers influence the results of feature selection. Regarding the number of classifiers, results showed that few classifiers selected more relevant features whereas many selected few features. Regarding the nature of classifier, decision tree classifiers selected more features and the features that generated accuracies much higher than other classifiers. Keywords: feature selection; wrappers; decision trees; support vector machine; SVM; Bayesian networks; multiple classifiers; data mining. (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:ids:ijdmmm:v:1:y:2008:i:1:p:91-102 Access Statistics for this article More articles in International Journal of Data Mining, Modelling and Management from Inderscience Enterprises Ltd |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.