Paving the Road for Replications: Experimental Results from an Online Research Repository

Tom Coupé, W. Reed (bob.reed@canterbury.ac.nz) and Christian Zimmerman
Authors registered in the RePEc Author Service: Christian Zimmermann

Working Papers in Economics from University of Canterbury, Department of Economics and Finance

Abstract: Are users of a bibliographic database interested in learning about replications? Can we motivate them to learn? To answer these questions, we performed an experiment on a RePEc (Research Papers in Economics) website: Using randomized stratification, we allocated 324 replications and their corresponding original studies to clusters; we then drew from those clusters to select treatment and control groups. We added brightly colored tabs to the relevant webpages to alert visitors to the existence of a replication study or to the original study of a replication. We monitored traffic over three phases lasting several months: a) no treatment, b) treatment on one group, c) treatment on both groups. We find a statistically significant increase in visits to replication pages, but the effect is small: Click-throughs to the replications occurred only 1% to 1.6% of the time.

Keywords: Replications; RePEc; Experiment; Online Research Repository; Webpages; Click-throughs (search for similar items in EconPapers)
JEL-codes: A11 B41 Z00 (search for similar items in EconPapers)
Pages: 23 pages
Date: 2021-10-01
New Economics Papers: this item is included in nep-exp and nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://repec.canterbury.ac.nz/cbt/econwp/2109.pdf (application/pdf)

Related works:
Working Paper: Paving the Road for Replications: Experimental Results from an Online Research Repository (2022)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cbt:econwp:21/09

Access Statistics for this paper

More papers in Working Papers in Economics from University of Canterbury, Department of Economics and Finance Private Bag 4800, Christchurch, New Zealand. Contact information at EDIRC.
Bibliographic data for series maintained by Albert Yee (albert.yee@canterbury.ac.nz).