Investigating the role of AI explanations in lay individuals’ comprehension of radiology reports: A metacognition lens

Yegin Genc, Mehmet Eren Ahsen and Zhan Zhang

PLOS ONE, 2025, vol. 20, issue 9, 1-22

Abstract: While there has been extensive research on techniques for explainable artificial intelligence (XAI) to enhance AI recommendations, the metacognitive processes in interacting with AI explanations remain underexplored. This study examines how AI explanations impact human decision-making by leveraging cognitive mechanisms that evaluate the accuracy of AI recommendations. We conducted a large-scale experiment (N = 4,302) on Amazon Mechanical Turk (AMT), where participants classified radiology reports as normal or abnormal. Participants were randomly assigned to three groups: a) no AI input (control group), b) AI prediction only, and c) AI prediction with explanation. Our results indicate that AI explanations enhanced task performance. Our results indicate that explanations are more effective when AI prediction confidence is high or users’ self-confidence is low. We conclude by discussing the implications of our findings.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0321342 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 21342&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0321342

DOI: 10.1371/journal.pone.0321342

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().