Towards a large scale analysis of claims: developing a machine learning method for detecting and classifying politicians’ claims of representation

Ine Gevers (), August Mulder () and Walter Daelemans ()
Additional contact information
Ine Gevers: University of Antwerp
August Mulder: University of Antwerp
Walter Daelemans: University of Antwerp

Journal of Computational Social Science, 2024, vol. 7, issue 1, No 34, 917-961

Abstract: Abstract In recent decades, many theoreticians have argued that we should pay attention to the claims of representation politicians make about groups in society. Nevertheless, despite recent advances on this topic, empirical research on politicians’ claims of representation remains relatively scant and mostly limited to case studies and manual annotation. Therefore, we develop a reusable Natural Language Processing (NLP) system to automatically classify claims by Dutch-speaking Belgian politicians. Following our new operationalization of claims of representation, which includes six constitutive elements, we use a limited amount of manually annotated data to train NLP models to automatically extract and classify these six elements. Our results show that using a combination of transformer learning (such as BERT), classic machine learning algorithms (such as SVMs), and rule-based methods, we can successfully classify each element of claims of representation, with macro F1-scores between 0.61 and 0.91. Taking all elements into account, we are able to correctly classify 74% of all detected claims in Belgian politicians’ Facebook posts between 2010 and 2022. Being the first to automate this process, this study contributes to the literature by offering a tested and validated method for classifying claims in politicians’ communication, thereby allowing large scale, and longitudinal analysis of claims. In the last section of this article, we further demonstrate some of the possibilities of our models by analyzing which groups politicians claimed to represent in the years before and after the start of the COVID-19 pandemic.

Keywords: Representative claims; Group appeals; Natural language processing; Political discourse analysis; COVID-19; Pandemic (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s42001-024-00261-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jcsosc:v:7:y:2024:i:1:d:10.1007_s42001-024-00261-y

Ordering information: This journal article can be ordered from
http://www.springer. ... iences/journal/42001

DOI: 10.1007/s42001-024-00261-y

Access Statistics for this article

Journal of Computational Social Science is currently edited by Takashi Kamihigashi

More articles in Journal of Computational Social Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().