Treatment format and external validity in international relations experiments

Sarah Kreps and Stephen Roblin

International Interactions, 2019, vol. 45, issue 3, 576-594

Abstract: Political scientists use short vignettes or mock news stories to embed treatments in experimental survey designs. We investigate whether the choice of format entails a trade off between internal and external validity. On the one hand, short vignettes may improve internal validity by isolating key variables without overloading respondents with information, thereby mitigating satisficing and improving data quality. On the other hand, mock news stories may improve external validity by approximating the circumstances under which individuals consume political information, which may enhance the credibility of the information. We find no evidence, however, that short vignettes mitigate satisficing more than mock news stories. Nor do we find that mock news stories enhance individual perceptions of the credibility of the information. Instead, we find that short vignettes are susceptible to confounding, which mock news story mitigate. These findings have important implications for debates about the use of survey experiments in political science.

Date: 2019
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1080/03050629.2019.1569002 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:ginixx:v:45:y:2019:i:3:p:576-594

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/GINI20

DOI: 10.1080/03050629.2019.1569002

Access Statistics for this article

International Interactions is currently edited by Michael Colaresi and Gerald Schneider

More articles in International Interactions from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().