You are the auditor: A ChatGPT-based multiple choice exam

Scott Dell and Mfon Akpan
Additional contact information
Scott Dell: Francis Marion University, USA
Mfon Akpan: Methodist University, USA

Advances in Online Education: A Peer-Reviewed Journal, 2024, vol. 3, issue 2, 111-120

Abstract: This case study examines the use of ChatGPT, a chatbot that utilises generative artificial intelligence (GenAI) technology, to amplify the efficacy of multiple-choice examinations in a financial accounting course. The primary objective is to introduce students to the advantages and limitations of GenAI tools such as ChatGPT while simultaneously fostering the development of critical thinking skills in their application. By demonstrating the tool’s ability to give both correct and incorrect responses, students will deepen their understanding of its appropriate use and develop a professional scepticism towards AI-generated responses, which can ‘hallucinate’ and yield incorrect answers to AI prompts. Furthermore, this study seeks to explore the role of AI-supported tests in fostering students’ problem-solving abilities and analytical acumen. The research examines student performance by giving exam questions, an AI-generated response and additional alternative answers in a multiple-choice format. On average, ChatGPT 3.5 responds with correct answers to accounting questions about 50 per cent of the time. To succeed in such examinations, students must evaluate if the ChatGPT answer is correct or if another of the given answers is more accurate. The case study also highlights the advantages and challenges of incorporating AI into accounting pedagogy, addressing concerns about the assimilation of this advanced technology.

Keywords: generative artificial intelligence; ChatGPT; AI-assisted learning; financial accounting; multiple-choice examination; critical thinking (search for similar items in EconPapers)
JEL-codes: A2 I2 (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://hstalks.com/article/8902/download/ (application/pdf)
https://hstalks.com/article/8902/ (text/html)
Requires a paid subscription for full access.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aza:aoe000:y:2024:v:3:i:2:p:111-120

Access Statistics for this article

More articles in Advances in Online Education: A Peer-Reviewed Journal from Henry Stewart Publications
Bibliographic data for series maintained by Henry Stewart Talks ().