Advances in the combination of supervised classification methods: an experimental study

Sabina Mazza ()
Additional contact information
Sabina Mazza: Department of Methods and Models for Economics, Territory and Finance, Sapienza University of Rome (Italy)

No 133/14, Working Papers from Sapienza University of Rome, Metodi e Modelli per l'Economia, il Territorio e la Finanza MEMOTEF

Abstract: In this work we were interested in investigating the predictive accuracy of one of the most popular learning schemes for the combination of supervised classification methods: the Stacking Technique proposed by Wolpert (1992) and consolidated by Ting and Witten, (1999) and Seewald (2002). In particular, we made reference to the StackingC (Seewald 2002) as a starting point for our analysis, to which some modifications and extensions were made. Since most of the research on ensembles of classifiers tends to demonstrate that this scheme can perform comparably to the best of the base classifiers as selected by cross-validation, if not better, this motivated us to investigate the performance of the Stacking empirically. An analysis of the results obtained by applying the our Stacking scheme, which includes differences and characteristic implementations compared to what is proposed by the literature, to the set of the dataset generated by means of an experimental design does not lead us to believe that the Stacking scheme is preferable in terms of performances to the use of the best single classifier. It always achieves good performances and is to be considered among the best. On the contrary, in the case of contaminated data, Stacking improves its performances noticeably, and generally appears to be very competitive, above all when the contaminations are more substantial.

Keywords: Supervised classification methods; Ensemble learning; Stacking; Meta-level learning; Cross-validation (search for similar items in EconPapers)
JEL-codes: C13 C14 C38 (search for similar items in EconPapers)
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://web.uniroma1.it/memotef/sites/default/file ... ti/FullTextWP133.pdf 2014 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rsq:wpaper:32/14

Access Statistics for this paper

More papers in Working Papers from Sapienza University of Rome, Metodi e Modelli per l'Economia, il Territorio e la Finanza MEMOTEF Contact information at EDIRC.
Bibliographic data for series maintained by Arezzo Maria Felice ( this e-mail address is bad, please contact ).