MSEBAG: a dynamic classifier ensemble generation based on ‘minimum-sufficient ensemble' and bagging

Lei Chen and Mohamed S. Kamel

International Journal of Systems Science, 2016, vol. 47, issue 2, 406-419

Abstract: In this paper, we propose a dynamic classifier system, MSEBAG, which is characterised by searching for the ‘minimum-sufficient ensemble’ and bagging at the ensemble level. It adopts an ‘over-generation and selection’ strategy and aims to achieve a good bias–variance trade-off. In the training phase, MSEBAG first searches for the ‘minimum-sufficient ensemble’, which maximises the in-sample fitness with the minimal number of base classifiers. Then, starting from the ‘minimum-sufficient ensemble’, a backward stepwise algorithm is employed to generate a collection of ensembles. The objective is to create a collection of ensembles with a descending fitness on the data, as well as a descending complexity in the structure. MSEBAG dynamically selects the ensembles from the collection for the decision aggregation. The extended adaptive aggregation (EAA) approach, a bagging-style algorithm performed at the ensemble level, is employed for this task. EAA searches for the competent ensembles using a score function, which takes into consideration both the in-sample fitness and the confidence of the statistical inference, and averages the decisions of the selected ensembles to label the test pattern. The experimental results show that the proposed MSEBAG outperforms the benchmarks on average.

Date: 2016
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2015.1074762 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:47:y:2016:i:2:p:406-419

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2015.1074762

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().