Revolutionising Essay Evaluation: A Cutting-Edge Rubric for AI-Assisted Writing

Hassan Saleh Mahdi and Ahmed Alkhateeb
Additional contact information
Hassan Saleh Mahdi: Arab Open University, Saudi Arabia
Ahmed Alkhateeb: King Faisal University, Saudi Arabia

International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 2025, vol. 15, issue 1, 1-19

Abstract: This study aims to develop a robust rubric for evaluating artificial intelligence (AI)–assisted essay writing in English as a Foreign Language (EFL) contexts. Employing a modified Delphi technique, we conducted a comprehensive literature review and administered Likert scale questionnaires. This process yielded nine key evaluation criteria, forming the initial rubric. The rubric was applied to evaluate 33 AI-assisted essays written by students as part of an intensive course assignment. Statistical analysis revealed significant inter-rater reliability and convergent validity coefficients, supporting the adoption and further development of such rubrics across higher education institutions. The developed rubric was subsequently used to evaluate these essays using two AI tools: ChatGPT and Claude. The results indicated that both AI tools evaluated the essays with similar scores, demonstrating consistency in their assessment capabilities.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... .4018/IJCALLT.368226 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jcallt:v:15:y:2025:i:1:p:1-19

Access Statistics for this article

International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT) is currently edited by Bin Zou

More articles in International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT) from IGI Global
Bibliographic data for series maintained by Journal Editor ().