Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

Bushra Munawar, Hina Rafique and Nida Mushtaq Khan

Journal of Education and Social Studies, 2024, vol. 5, issue 3, 230-240

Abstract: ChatGPT is an artificial intelligence model, highly proficient in English language and literature. This research explored the functionality of ChatGPT in producing research-oriented texts of the English language and literature in higher education institutions. It consisted of careful analysis of the quality, coherence, and relevance of ChatGPT- produced- content in terms of its capability to develop research topics, abstracts, research methodologies and theoretical- framework -based data analysis, and conclusions. Furthermore, the study focused on its role in academic context by drawing upon a comprehensive analysis of the strengths and limitations of ChatGPT in the research domain. Hence, the analysis consisted of scrutinizing the data for completeness, accuracy, and relevance of the content produced by ChatGPT administrating the CRAAP Test as the designed measure of performance of ChatGPT. Results showed a high proficiency of ChatGPT in originating research ideas and data explication but limiting response in composition of comprehensive abstract writing, research methodologies and principle design, especially when implementing practical implementation of overall research components. Furthermore, the study proposed that researchers should approach AI technology with a critical mindset. Contextually, the incorporation of human linguistic and literary expertise is recommended in utilization of ChatGPT in research studies and academic term papers. These measures will help maintain the quality and integrity of research and academic studies.

Keywords: ChatGPT; Artificial Intelligence; Language model; Research-content-generation; Scholarly inquiry; Research writing; Human oversight (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.scienceimpactpub.com/journals/index.php/jess/article/view/950/566 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:adx:jessjr:v:5:y:2024:i:3:p:230-240

Access Statistics for this article

More articles in Journal of Education and Social Studies from Science Impact Publishers
Bibliographic data for series maintained by Dr. Shahbaz Ahmad ().