Imbalanced data issues in machine learning classifiers: a case study

Mingxing Gong

Journal of Operational Risk

Abstract: Machine learning classifiers are widely used in financial applications. Due to the nature of certain classification problems, special care should be taken when dealing with imbalanced data. In practice, many model developers and validators fail to take this into account in their model development and validation. In addition, resampling is a common technique to address imbalanced data issues when building traditional logistic regression models. However, there has been no specific discussion regarding the resampling ratio used to rebalance the data or how the issue of imbalance impacts different kinds of machine learning classifiers, especially the more advanced ones. This paper aims to outline the special characteristics of the classifiers, compare different methods in dealing with imbalanced data issues and provide best practice in model development, evaluation and validation to avoid common pitfalls. Although the methods discussed in this paper can apply to general machine learning classifiers in applications with imbalanced data issues, by using a case study in credit card fraud detection this paper calls practitioners’ attention to the imbalanced data problems therein, where class imbalance is often mistreated and lacks theoretical discussion.

References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.risk.net/journal-of-operational-risk/7 ... sifiers-a-case-study (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rsk:journ3:7955302

Access Statistics for this article

More articles in Journal of Operational Risk from Journal of Operational Risk
Bibliographic data for series maintained by Thomas Paine ().