EconPapers    
Economics at your fingertips  
 

Ensemble classification based on generalized additive models

Koen De Bock (), Kristof Coussement () and Dirk Van den Poel ()

No 2010/02, Working Papers from Hogeschool-Universiteit Brussel, Faculteit Economie en Management

Abstract: Generalized additive models (GAMs) are a generalization of generalized linear models (GLMs) and constitute a powerful technique which has successfully proven its ability to capture nonlinear relationships between explanatory variables and a response variable in many domains. In this paper, GAMs are proposed as base classifiers for ensemble learning. Three alternative ensemble strategies for binary classification using GAMs as base classifiers are proposed: (i) GAMbag based on Bagging, (ii) GAMrsm based on the Random Subspace Method (RSM), and (iii) GAMens as a combination of both. In an experimental validation performed on 12 data sets from the UCI repository, the proposed algorithms are benchmarked to a single GAM and to decision tree based ensemble classifiers (i.e. RSM, Bagging, Random Forest, and the recently proposed Rotation Forest). From the results a number of conclusions can be drawn. Firstly, the use of an ensemble of GAMs instead of a single GAM always leads to improved prediction performance. Secondly, GAMrsm and GAMens perform comparably, while both versions outperform GAMbag. Finally, the value of using GAMs as base classifiers in an ensemble instead of standard decision trees is demonstrated. GAMbag demonstrates comparable performance to ordinary Bagging. Moreover, GAMrsm and GAMens outperform RSM and Bagging, while these two GAM ensemble variations perform comparably to Random Forest and Rotation Forest. Sensitivity analyses are included for the number of member classifiers in the ensemble, the number of variables included in a random feature subspace and the number of degrees of freedom for GAM spline estimation.

Keywords: Data mining; Classification; Ensemble learning; GAM; UCI (search for similar items in EconPapers)
Pages: 30 page
Date: 2010-02
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (12) Track citations by RSS feed

Downloads: (external link)
https://lirias.hubrussel.be/bitstream/123456789/3656/1/10HRP02.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 500 Can't connect to lirias.hubrussel.be:443 (No such host is known. )

Related works:
Journal Article: Ensemble classification based on generalized additive models (2010) Downloads
Working Paper: Ensemble classification based on generalized additive models (2010)
Working Paper: Ensemble classification based on generalized additive models (2009) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hub:wpecon:201002

Access Statistics for this paper

More papers in Working Papers from Hogeschool-Universiteit Brussel, Faculteit Economie en Management Contact information at EDIRC.
Bibliographic data for series maintained by Sabine Janssens ( this e-mail address is bad, please contact ).

 
Page updated 2022-09-27
Handle: RePEc:hub:wpecon:201002