Imbalanced classification by learning hidden data structure

Yang Zhao, Abhishek K. Shrivastava and Kwok Leung Tsui

IISE Transactions, 2016, vol. 48, issue 7, 614-628

Abstract: Approaches to solve the imbalanced classification problem usually focus on rebalancing the class sizes, neglecting the effect of the hidden structure within the majority class. The purpose of this article is to first highlight the effect of sub-clusters within the majority class on the detection of the minority instances and then handle the imbalanced classification problem by learning the structure in the data. We propose a decomposition-based approach to a two-class imbalanced classification problem. This approach works by first learning the hidden structure of the majority class using an unsupervised learning algorithm and thus transforming the classification problem into several classification sub-problems. The base classifier is constructed on each sub-problem. The ensemble is tuned to increase its sensitivity toward the minority class. We also provide a metric for selecting the clustering algorithm by comparing estimates of the stability of the decomposition, which appears necessary for good classifier performance. We demonstrate the performance of the proposed approach through various real data sets.

Date: 2016
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/0740817X.2015.1110269 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:uiiexx:v:48:y:2016:i:7:p:614-628

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/uiie20

DOI: 10.1080/0740817X.2015.1110269

Access Statistics for this article

IISE Transactions is currently edited by Jianjun Shi

More articles in IISE Transactions from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().