Unlocking the Potential of Competency Exam Data with Machine Learning: Improving Higher Education Evaluation

Ala Smadi, Ahmad Al-Qerem, Ahmad Nabot, Issam Jebreen, Amjad Aldweesh (), Mohammad Alauthman, Awad M. Abaker, Omer Radhi Al Zuobi and Musab B. Alzghoul
Additional contact information
Ala Smadi: Computer Science Department, Faculty of Information Technology, Zarqa University, Zarqa 13110, Jordan
Ahmad Al-Qerem: Computer Science Department, Faculty of Information Technology, Zarqa University, Zarqa 13110, Jordan
Ahmad Nabot: Computer Science Department, Faculty of Information Technology, Zarqa University, Zarqa 13110, Jordan
Issam Jebreen: Computer Science Department, Faculty of Information Technology, Zarqa University, Zarqa 13110, Jordan
Amjad Aldweesh: College of Computer Science and IT, Shaqra University, Shaqra 11961, Saudi Arabia
Mohammad Alauthman: Department of Information Security, University of Petra, Amman 11196, Jordan
Awad M. Abaker: College of Computer at Al-Gunfudah, Umm Al-Qura University, Mecca 24382, Saudi Arabia
Omer Radhi Al Zuobi: College of Computer at Al-Gunfudah, Umm Al-Qura University, Mecca 24382, Saudi Arabia
Musab B. Alzghoul: College of Computer at Al-Gunfudah, Umm Al-Qura University, Mecca 24382, Saudi Arabia

Sustainability, 2023, vol. 15, issue 6, 1-22

Abstract: In Jordanian higher education institutions, a competency exam was developed to ensure that students had the ability to attain particular competence levels. The results of the competency examination are one of the measures used as key performance indicators (KPIs) evaluating the quality of academic programs and universities. There are numerous evaluation methods for students’ performances based on the academic achievement of the pupils, including the application of conventional statistical approaches and machine learning. The objective of this paper is to develop a framework to help decision-makers and universities evaluate academic programs using ML by identifying programs and learning outcomes that need to be established by analyzing competency exam data. The developed framework can also reduce exam costs by substituting machine learning algorithms for the actual execution of the exam. We have created a dataset that can assist academics with their study; the dataset includes demographic and academic data about students, such as their gender, average university degree, type of university, and outcomes on the competency exam based on their level and competencies. Experiments supported the claim that models trained using samples from the student sub-dataset outperform models constructed using samples from the entire dataset. In addition, the experiments demonstrated that ML algorithms are an effective tool for recognizing patterns in student performance. Experiments demonstrated that no single ML model outperforms other ML models. However, the MLP model generates more accurate models, making them more beneficial for developing robust frameworks.

Keywords: student performance prediction; competency exams; data heterogeneity; machine learning; data segmentation; classification (search for similar items in EconPapers)
JEL-codes: O13 Q Q0 Q2 Q3 Q5 Q56 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2071-1050/15/6/5267/pdf (application/pdf)
https://www.mdpi.com/2071-1050/15/6/5267/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jsusta:v:15:y:2023:i:6:p:5267-:d:1098909

Access Statistics for this article

Sustainability is currently edited by Ms. Alexandra Wu

More articles in Sustainability from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().