Student Performance Prediction with Decision Tree Ensembles and Feature Selection Techniques

Amir Ahmad, Santosh Ray (), Md. Tabrej Khan () and Ali Nawaz ()
Additional contact information
Amir Ahmad: College of Information Technology, United Arab Emirates University, Al Ain, UAE
Santosh Ray: ��Faculty of Information Technology, Liwa College, Abu Dhabi, UAE
Md. Tabrej Khan: ��Faculty of Computer Science, Pacific Academy of Higher Education and Research University, Udaipur, Rajasthan, India
Ali Nawaz: College of Information Technology, United Arab Emirates University, Al Ain, UAE

Journal of Information & Knowledge Management (JIKM), 2025, vol. 24, issue 02, 1-21

Abstract: The prevalence of student dropout in academic settings is a serious issue that affects individuals and society as a whole. Timely intervention and support can be provided to such students if we get an accurate prediction of student performance. However, class imbalance and data complexity in education data are major challenges for traditional predictive analytics. Our research focusses on utilising machine learning techniques to predict student performance while handling imbalanced datasets. To address the imbalanced class problem, we employed both oversampling and undersampling techniques in our decision tree ensemble methods for the risk classification of prospective students. The effectiveness of classifiers was evaluated by varying the sizes of the ensembles and the oversampling and undersampling ratios. Additionally, we conducted experiments to integrate the feature selection processes with the best ensemble classifiers to further enhance the prediction. Based on the extensive experimentation, we concluded that ensemble methods such as Random Forest, Bagging, and Random Undersampling Boosting perform well in terms of performance measures such as Recall, Precision, F1-score, Area Under the Receiver Operating Characteristic Curve, and Geometric Mean. The F1-score of 0.849 produced by the Random Undersampling Boost classifier in conjunction with the Least Absolute Shrinkage and Selection Operator feature selection method indicates that this ensemble produces the best results.

Keywords: Student dropout prediction; classification; ensembles; decision trees; imbalanced class; feature selection (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219649225500169
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:jikmxx:v:24:y:2025:i:02:n:s0219649225500169

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219649225500169

Access Statistics for this article

Journal of Information & Knowledge Management (JIKM) is currently edited by Professor Suliman Hawamdeh

More articles in Journal of Information & Knowledge Management (JIKM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().