Rule extraction from support vector machines: a hybrid approach for solving classification and regression problems

Mohammad Abdul Haque Farquad, Vadlamani Ravi and S. Bapi Raju

International Journal of Information and Decision Sciences, 2011, vol. 3, issue 3, 265-294

Abstract: In this paper, a novel hybrid approach to extract rules from support vector machine and support vector regression (SVM/SVR) is presented. The hybrid has three phases: 1) SVM-recursive feature elimination (RFE) algorithm is employed for feature selection; 2) using the selected features, SVM/SVR models are built and the actual target values of the training instances are replaced by the predictions obtained from these models resulting in a modified training set; 3) the modified training set is used for rule generation using decision tree (DT), classification and regression tree (CART), adaptive network based fuzzy inference system (ANFIS) and dynamic evolving fuzzy inference system (DENFIS). Extensive experiments are conducted on three benchmark classification problems, four bank bankruptcy prediction problems and five benchmark regression problems. We conclude that the rules obtained after feature selection perform comparably to those extracted from all features. Further, comprehensibility is also improved after feature selection.

Keywords: rule extraction; support vector machines; SVM; support vector regression; SVR; decision trees; classification; regression trees; CART; adaptive neuro-fuzzy inference system; ANFIS; dynamic evolving fuzzy inference system; DENFIS; root mean squared error; RMSE; feature selection; modelling; bank bankruptcy prediction; neural networks; fuzzy logic. (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=41587 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijidsc:v:3:y:2011:i:3:p:265-294

Access Statistics for this article

More articles in International Journal of Information and Decision Sciences from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().