AI in language learning assessment: Examining the limitations of online testing and the reliability of teacher judgement

Kapxhiu Lorena

Academic Journal of Business, Administration, Law and Social Sciences, 2025, vol. 11, issue 3, 59-72

Abstract: The rapid integration of AI in language assessment has provoked heated discussions concerning validity, reliability, and academic integrity of remote testing used for ESL/EFL assessment. While the rapid integration of AI in assessment tools improves accessibility, scalability, and efficiency of resources and processes, the challenges of ensuring equitable testing conditions, preventing academic misconduct, and measuring language proficiency in high-stakes settings raise crucial questions. This is a comparison study between online technology-driven AI-based assessment versus teacher-mediated assessment in a British international school in Abu Dhabi. About 60 ESL students contributed to a 3-month study, with AI-administered tests used alongside traditional, in-person teacher assessments. Mixed-method analysis, drawing on quantitative scoring data, teacher observations, and student feedback, reported that AI-based assessments (i.e., CAT4, GL) often yielded inflated scores and were inconsistent at assessing productive and contextual language skills. Despite recent developments in policy such as Cambridge’s forthcoming hybrid model of assessment, one that reflects a reliance on the digitalization of testing, the findings indicate that there should still be a human-in-the-loop to support validity, fairness, and the integrity of second-language assessment.

Keywords: AI-based language assessment; Teacher judgement reliability; academic integrity; assessment validity; Blended Learning Models (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/ajbals-2025-0028 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:ajbals:v:11:y:2025:i:3:p:59-72:n:1006

DOI: 10.2478/ajbals-2025-0028

Access Statistics for this article

Academic Journal of Business, Administration, Law and Social Sciences is currently edited by Endri Papajorgji

More articles in Academic Journal of Business, Administration, Law and Social Sciences from Sciendo
Bibliographic data for series maintained by Peter Golla ().