A Comparative Analysis of Machine Learning Models for Predicting Loan Defaults under Imbalanced Data Conditions

Yi Zhou ()
Additional contact information
Yi Zhou: Imperial College London, Department of Mathematics

A chapter in Proceedings of the 2025 International Conference on Hybrid Commerce, Human Capital, and Economic Dynamics (ICHCH 2025), 2026, pp 213-220 from Springer

Abstract: Abstract Accurate loan default prediction is crucial for credit risk management. This study used Kaggle’s Loan Default Prediction dataset, applying preprocessing (cleaning, encoding, scaling) and testing six models: Logistic Regression, Decision Trees, Random Forest, eXtreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), and a neural network. Performance was evaluated using precision, recall, F1-score, and Receiver Operating Characteristic (AUC-ROC), with emphasis on handling class imbalance. Gradient boosting (especially LightGBM, AUC ~0.76) outperformed linear and tree-based models. Adjusting XGBoost’s decision threshold improved the minority class F1-score from 0.17 to 0.36 without losing Area Under the Curve (AUC). Ensemble methods like Voting Classifiers balanced recall and precision effectively. Key takeaways include model selection, threshold tuning, and ensemble strategies for imbalanced data. Future work could explore richer features, imbalance-aware loss functions, and explainability tools for transparency. This study provides a reproducible benchmark for default prediction, laying the groundwork for more robust, interpretable, and fair credit scoring systems in real-world financial applications.

Keywords: LightGBM; XGBoost; Predicting Loan Defaults (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:advbcp:978-2-38476-585-0_25

Ordering information: This item can be ordered from
http://www.springer.com/9782384765850

DOI: 10.2991/978-2-38476-585-0_25

Access Statistics for this chapter

More chapters in Advances in Economics, Business and Management Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().