Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content

Mykola Makhortykh (), Ernesto León, Clara Christner, Maryna Sydorova, Aleksandra Urman, Silke Adam, Michaela Maier and Teresa Gil-Lopez
Additional contact information
Mykola Makhortykh: University of Bern
Ernesto León: University of Bern
Clara Christner: University of Kaiserslautern-Landau
Maryna Sydorova: University of Bern
Aleksandra Urman: University of Zurich
Silke Adam: University of Bern
Michaela Maier: University of Kaiserslautern-Landau
Teresa Gil-Lopez: University Carlos III of Madrid

Quality & Quantity: International Journal of Methodology, 2025, vol. 59, issue 2, No 18, 1163-1207

Abstract: Abstract The rise of populist radical right (PRR) ideas stresses the importance of understanding how individuals engage with PRR content online. However, this task is complicated by the variety of channels through which such engagement can take place. In this article, we systematically compare computational approaches for detecting PRR content in textual data. Using 66 dictionary, classic supervised machine learning, and deep learning (DL) models, we compare how these distinct approaches perform on the PRR detection task for three Germanophone test datasets and how their performance is affected by different modes of text preprocessing. In addition to individual models, we examine the performance of 330 ensemble models combining the above-mentioned approaches for the dataset with a particularly high volume of noise. Our findings demonstrate that the DL models, in combination with more computationally intense forms of preprocessing, show the best performance among the individual models, but it remains suboptimal in the case of more noisy datasets. While the use of ensemble models shows some improvement for specific modes of preprocessing, overall, it mostly remains on par with individual DL models, thus stressing the challenging nature of computational detection of PRR content.

Keywords: Automated content analysis; Populist radical right; Supervised machine learning; Neural networks; Dictionaries; Ensemble modeling (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-024-02034-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:59:y:2025:i:2:d:10.1007_s11135-024-02034-1

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-024-02034-1

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().