Is AI-Generated Extremism Credible? Experimental Evidence from an Expert Survey

Stephane J. Baele, Elahe Naserian and Gabriel Katz

Terrorism and Political Violence, 2025, vol. 37, issue 8, 1060-1076

Abstract: Rapid progress in Artificial Intelligence (AI) over the past few years has unfolded important questions—and triggered anxiety—about the potential (mis)use of AI-generated content in information warfare and disinformation campaigns. A crucial question remains unanswered, however: whether—and to what extent—this technology can be harnessed in a credible way by extremists, whose language is usually characterized by highly specific subcultural registers that make them unlikely to be easily mimicked by AI models. This paper answers that question, offering the first rigorous evaluation of the credibility of synthetic (AI-generated) extremist prose. Using an expert survey experiment measuring the credibility of fake incel forum posts and ISIS magazines paragraphs generated through an original workflow for the production of synthetic extremist text, we show that these texts have high credibility scores, confusing world-leading experts. These findings, which are discussed under the broader light of the emerging literature on nefarious “dual-use” of synthetic content, not only define and evaluate the threat of extremists harnessing language models for propaganda, but they also more broadly strengthen our understanding of the role language models are due to play in hostile political communication, and ultimately resurface the debate on the human costs of technological progress.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/09546553.2024.2380089 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:ftpvxx:v:37:y:2025:i:8:p:1060-1076

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/ftpv20

DOI: 10.1080/09546553.2024.2380089

Access Statistics for this article

Terrorism and Political Violence is currently edited by James Forest

More articles in Terrorism and Political Violence from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().