Replication of Changing Hearts and Minds? Why Media Messages Designed to Foster Empathy Often Fail (Gubler et al., 2022)

Jakub Prochazka, Shubham Pandey, Ondrej Castek and Mojtaba Firouzjaeiangalougah

MUNI ECON Working Papers from Masaryk University

Abstract: This paper focuses on computational reproducibility and robustness replicability of Gubler et al.’s(2022) studies which examine the effect of media messages on empathic concern, dissonance, and out-group policy attitudes. The original paper tests four hypotheses using two online experiments with large samples from one US state (N1=5,800; N2=2,200). Regarding the first experiment, we successfully reproduced the effect that initial antipathy weakens the effect of humanizing treatment on empathic concern (H1). However, we show that the moderating effect is negligible and has little practical significance. Moreover, the individual effect estimates in our analyses slightly differed from the original paper due to different procedure of data cleaning and minor coding errors in the original paper. The most relevant difference was the opposite effect of gender than reported in the original paper. We also show that empathic concern might mediate the effect of humanizing treatment on attitudes toward immigrants (H3). The original study rejected the mediation hypothesis due to not finding a total effect of humanizing treatment on attitudes. In contrast, we found that humanization treatment has a positive indirect effect on attitudes through empathic concern. At the same time, it also has a direct negative effect on attitudes. For the second experiment (H1, H2a, H2b, H3), we attempted to reproduce the results using a different software. We partially succeeded once receiving support from the authors of the original study. We note throughout the report issues we have encountered.

Keywords: Reproduction; Replication; Research Transparency; Open Science; Economics; Political Science; Persuasion; Political Communication; Empathic Concern (search for similar items in EconPapers)
JEL-codes: B41 C10 C81 P49 (search for similar items in EconPapers)
Pages: 126 pages
Date: 2024-03, Revised 2024-08
New Economics Papers: this item is included in nep-exp and nep-pol
Note: License: CC BY-NC-ND 4.0
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://repec.econ.muni.cz/mub/wpaper/wp/econ/WP_MUNI_ECON_2024-02.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:mub:wpaper:2024-02

DOI: 10.5817/WP_MUNI_ECON_2024-02

Access Statistics for this paper

More papers in MUNI ECON Working Papers from Masaryk University Contact information at EDIRC.
Bibliographic data for series maintained by ().