A comprehensive study on the interplay between dataset characteristics and oversampling methods

Yue Yang, Tangtangfang Fang, Jinyang Hu, Chang Chuan Goh, Honghao Zhang, Yongmei Cai, Anthony Graham Bellotti, Boon Giin Lee and Zhong Ming

Journal of the Operational Research Society, 2025, vol. 76, issue 10, 1981-2002

Abstract: Addressing class imbalance in oversampling domain using machine learning methods requires careful selection of techniques and classifiers for optimal outcomes. While the importance of technique choice is well recognized, research on how dataset characteristics affect classification results remained limited. This study fills this gap by analyzing 16 datasets, categorized by financial relevance, temporal relevance, minority rate, minority sample count, and feature count. The effectiveness of various oversampling techniques is systematically evaluated and ranked using F1 and AUC, providing a structured framework for assessing the suitability of these techniques across diverse datasets. The evaluation involved 15 classifiers, resulting in 75 models combining four oversampling techniques and a baseline classifier. A ranking mechanism identified five top-performing models, emphasizing that classifier performance is influenced by the choice of the oversampling method, depending on dataset type. Notably, the traditional Synthetic Minority Oversampling Technique (SMOTE) outperformed the approaches based on Generative Adversarial Network (GAN) across different classifiers and datasets. Among classifiers, random forest proved to be the most robust across all dataset types, surpassing boosting-based classifiers. Overall, this study provides valuable insights into selecting the optimal oversampling methods and classifiers for specific dataset characteristics, offering a framework for addressing class imbalance in various contexts.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/01605682.2025.2450060 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tjorxx:v:76:y:2025:i:10:p:1981-2002

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tjor20

DOI: 10.1080/01605682.2025.2450060

Access Statistics for this article

Journal of the Operational Research Society is currently edited by Tom Archibald

More articles in Journal of the Operational Research Society from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().