Paving the Road for Replications: Experimental Results from an Online Research Repository

Tom Coupé, W. Reed () and Christian Zimmerman
Authors registered in the RePEc Author Service: Christian Zimmermann

Working Papers in Economics from University of Canterbury, Department of Economics and Finance

Abstract: Are users of a bibliographic database interested in learning about replications? Can they be induced to learn? To answer these questions, we performed an experiment at the online research bibliography, RePEc (Research Papers in Economics). RePEc is the main research bibliography for pre-prints and published papers in economics. Using randomized stratification, we allocated 324 replications and their corresponding original studies to clusters. We then drew from those clusters to construct treatment and control groups. Brightly colored tabs were added to the relevant webpages to alert visitors to the existence of a replication study. We then monitored traffic over three phases lasting several months: a) no treatment, b) treatment on one group, c) treatment on both groups. Our estimates indicate that this intervention generated an average click-through-rate (CTR) of 1.6%, resulting in a 13% increase in the visits to replication webpages, though only the former estimate was statistically significant.

Keywords: Replications; RePEc; Experiment; Online Research Bibliography; Webpages; Click-throughs (search for similar items in EconPapers)
JEL-codes: A11 B41 Z00 (search for similar items in EconPapers)
Pages: 24 pages
Date: 2022-02-01
New Economics Papers: this item is included in nep-exp and nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://repec.canterbury.ac.nz/cbt/econwp/2205.pdf (application/pdf)

Related works:
Working Paper: Paving the Road for Replications: Experimental Results from an Online Research Repository (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cbt:econwp:22/05

Access Statistics for this paper

More papers in Working Papers in Economics from University of Canterbury, Department of Economics and Finance Private Bag 4800, Christchurch, New Zealand. Contact information at EDIRC.
Bibliographic data for series maintained by Albert Yee ().