The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020)

Philipp Knöpfle and Tim Schatto-Eckrodt
Additional contact information
Philipp Knöpfle: Department of Media and Communication, Ludwig Maximilian University of Munich, Germany
Tim Schatto-Eckrodt: Department of Communication and Journalism Studies, Hamburg University, Germany

Media and Communication, 2024, vol. 12

Abstract: Replication studies in computational communication science (CCS) play a vital role in upholding research validity, ensuring reliability, and promoting transparency. However, conducting such studies in CCS often proves challenging due to the data environments’ dynamic nature and the complexities surrounding data and software sharing. To shed light on these challenges, we examine the replication process with CCS studies by computationally reproducing and replicating Schatto-Eckrodt et al.’s (2020) computational analysis of the X (formerly Twitter) debate about the term “gaming disorder” being added to the International Classification of Diseases 11. Our results indicate a reproduction success rate of 88.46% of the original findings. Replicating the analysis presents several obstacles, particularly in data access and availability. Five years after the original data collection, we were able to recollect only 55.08% of the initial sample, primarily due to user and platform activities, including account deletions, user suspensions, and privacy settings. Our reproduction and replication efforts revealed intricate challenges in conducting CCS research, particularly concerning data access and third-party platforms. To enhance replication in CCS, we emphasize the crucial role of data sharing, increased transparency, extensive documentation, and regulatory processes. Thus, our analysis underscores replications’ critical role in enhancing CCS research validity and reliability.

Keywords: computational communication science; replicability; replication; reproducibility; Twitter (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.cogitatiopress.com/mediaandcommunication/article/view/7789 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cog:meanco:v12:y:2024:a:7789

DOI: 10.17645/mac.7789

Access Statistics for this article

Media and Communication is currently edited by Raquel Silva

More articles in Media and Communication from Cogitatio Press
Bibliographic data for series maintained by António Vieira () and IT Department ().