Calibrating Synthetic Respondents: A Within-Persona Experiment on Public Reactions to Protest in Turkey

Mehmet Fuat Kina and Helin Yaren Ekmen

No hp7gz_v1, SocArXiv from Center for Open Science

Abstract: Large language models are increasingly used to simulate survey respondents, yet the inference pipeline that turns a persona into a response is rarely calibrated for the population and outcome it is applied to. This study makes population- and outcome-specific calibration the research task itself. Using a nationally representative survey in Turkey as the benchmark, we construct persona-conditioned synthetic respondents for all 2,615 survey participants and search a structured space of persona content, sampling strategies, temperatures, model backbones, and prompt framings. Calibration is assessed against two held-out outcomes that carry the response structures on which social movement research typically rests, a rare binary measure of protest participation and a five-point attitude item, and the selected protocols differ between the two. We then run a within-persona synthetic experiment that places the same protest for Kurdish-language education in a political opportunity and a political threat context. The threat context lowers simulated movement legitimacy and willingness to attend, and the simulated contrasts differentiate by political orientation, ethnicity, and education in the directions theory anticipates. Calibration is a precondition for reading synthetic experiments, not a robustness check appended to them.

Date: 2026-09-24
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/6ab4fddff9c9ce8ea42c9c1c/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:socarx:hp7gz_v1

DOI: 10.31235/osf.io/hp7gz_v1

Access Statistics for this paper

More papers in SocArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().