Do people rely on ChatGPT more than their peers to detect deepfake news?

Yuhao Fu and Nobuyuki Hanaki

ISER Discussion Paper from Institute of Social and Economic Research, The University of Osaka

Abstract: This experimental study investigates how people rely on different sources of advice when detecting AI-generated fake news (deepfake news). In a laboratory deepfake detection task, student participants identified the proportion of human-written (non-AI-generated) content in synthetic deepfake news articles and received advice from ChatGPT (GPT-4), human peers, or linguistic experts. The results show that participants rely more on ChatGPT than on human peers when detecting GPT-2-generated deepfake news. Participants also rely more on linguistic experts than on peers, while the relative reliance on experts versus ChatGPT is mixed across experimental waves, potentially reflecting time trends in beliefs about AI-based detection. Moreover, performance improvements reflect the joint role of reliance and advice quality, arising primarily when participants rely on high-quality advice. Overall, relying on AI to detect AI-generated deepfakes can improve detection outcomes, but only when AI-based detection tools are of sufficiently high quality. These findings highlight the dual role of GAI as both a source of deepfakes and a tool for mitigating related risks.

Date: 2024-03, Revised 2026-02
New Economics Papers: this item is included in nep-ain and nep-exp
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.iser.osaka-u.ac.jp/static/resources/docs/dp/DP1233RR.pdf

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dpr:wpaper:1233rr

Access Statistics for this paper

More papers in ISER Discussion Paper from Institute of Social and Economic Research, The University of Osaka Contact information at EDIRC.
Bibliographic data for series maintained by Librarian ().