Can ChatGPT be skeptical? A case-based evaluation of generative AI in financial statement auditing

Lane F. Grey and Yueqi Li

Accounting Research Journal, 2026, 1-16

Abstract: PurposeThis study aims to investigate how effectively GenAI (ChatGPT) displays professional skepticism characteristics in external audit tasks, as insufficient skepticism may impair audit quality and heighten the risk of audit failure.Design/methodology/approachChatGPT is evaluated using four audit tasks representing common judgment-oriented audit procedures. Three experienced external auditors independently assessed ChatGPT’s responses using a structured professional skepticism assessment.FindingsChatGPT appears to display varying levels of skepticism characteristics across audit tasks, with relatively higher levels in preliminary risk assessments and substantive analytical procedures and lower levels in going-concern evaluations. This suggests that it may be more effective in analytical tasks than in those requiring deeper professional judgment.Originality/valueThis study appears to be among the first to systematically assess whether a general-purpose reasoning GenAI tool can display characteristics associated with professional skepticism across different audit tasks. By applying an established skepticism framework, it provides a structured baseline for understanding where GenAI may support or fall short in audit judgment contexts.

Keywords: Generative AI; ChatGPT; Financial statement auditing; Professional skepticism (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.emerald.com/arj/article/doi/10.1108/AR ... ase-based-evaluation (text/html)
https://www.emerald.com/arj/article-pdf/doi/10.110 ... j-12-2025-0527en.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eme:arjpps:arj-12-2025-0527

DOI: 10.1108/ARJ-12-2025-0527

Access Statistics for this article

Accounting Research Journal is currently edited by Yaowen Shan and DaiFei "Troy" Yao

More articles in Accounting Research Journal from Emerald Group Publishing Limited
Bibliographic data for series maintained by Emerald Support ().