Evaluating the Performance of Large Language Models on Arabic Lexical Ambiguities: A Comparative Study with Traditional Machine Translation Systems

Hamad Abdullah H Aldawsari

World Journal of English Language, 2025, vol. 15, issue 3, 354

Abstract: The rapid advancement in natural language processing (NLP) has led to the development of large language models (LLMs) with impressive capabilities in various tasks, including machine translation. However, the effectiveness of these new systems in handling linguistic complexities, such as Arabic lexical ambiguity, remains underexplored. This study investigates whether LLMs can outperform traditional machine translation (MT) systems in translating Arabic lexical ambiguities, characterized by homonyms, heteronyms, and polysemes. The evaluation involves two prominent LLMs, OpenAI's GPT and Google's Gemini, and compares their performance with traditional MT systems, Google Translate and SYSTRAN. The results indicate that GPT and Gemini offer substantial improvements in translation accuracy and intelligibility over traditional MT systems and highlight the advanced capabilities of LLMs in handling the complexities of Arabic, suggesting a significant step forward in machine translation technologies. This study highlights the potential of LLMs to overcome the limitations of traditional MT systems and provides a foundation for future research. The results contribute to the ongoing development of more effective and accurate translation systems, emphasizing the importance of adopting advanced AI technologies in the field of machine translation.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.sciedupress.com/journal/index.php/wjel/article/download/27261/16748 (application/pdf)
https://www.sciedupress.com/journal/index.php/wjel/article/view/27261 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jfr:wjel11:v:15:y:2025:i:3:p:354

Access Statistics for this article

World Journal of English Language is currently edited by Joe Nelson

More articles in World Journal of English Language from Sciedu Press
Bibliographic data for series maintained by Sciedu Press ().