AI vs. human: A large-scale analysis of AI-generated fake reviews, human-generated fake reviews and authentic reviews

Yuexin Zhao, Siyi Tang, Hongyu Zhang and Long Lyu

Journal of Retailing and Consumer Services, 2025, vol. 87, issue C

Abstract: The rise of fake reviews generated by artificial intelligence (AI) poses significant challenges for online platforms, retailers, and consumers, as advanced generative models like ChatGPT produce fake reviews. More seriously, unlike human-generated fake reviews, which exhibit psychological cues, AI-generated fake reviews lack deceptive intent and instead reflect algorithmic patterns that are increasingly difficult to detect. This study investigates the linguistic distinctions among AI-generated fake reviews, human-generated fake reviews, and authentic reviews by integrating the theoretical model of textual differences and AI characteristics. Analyzing 714,016 reviews through text analysis, entropy weight method and hypothesis testing, this research finds that AI-generated fake reviews demonstrate higher comprehensibility, lower levels of specificity, exaggeration, and negligence compared to human-generated fakes and authentic reviews. These findings challenge the existing paradigms in fake review research. This means that in traditional detection, the situations where there are AI-generated fake reviews that do not conform to rules should be given further consideration. Additionally, AI-generated fake reviews exhibit significantly higher mechanicalness and lower empathy than authentic reviews, providing actionable linguistic cues for identification. These findings highlight the need for revised detection methods that account for AI characteristics. Theoretically, it innovatively combines the textual differences model with AI capabilities to investigate AI-generated fake reviews, enriching the fake review detection literature. Practically, it offers e-commerce platforms and consumers enhanced detection metrics to improve algorithmic accuracy in identifying AI-generated deception.

Keywords: AI-Generated fake reviews; Online reviews; Textual differences; AI capabilities (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0969698925001791
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:joreco:v:87:y:2025:i:c:s0969698925001791

DOI: 10.1016/j.jretconser.2025.104400

Access Statistics for this article

Journal of Retailing and Consumer Services is currently edited by Harry Timmermans

More articles in Journal of Retailing and Consumer Services from Elsevier
Bibliographic data for series maintained by Catherine Liu ().