Paving the Road for Replications: Experimental Results from an Online Research Bibliography

Tom Coupé, W. Reed () and Christian Zimmermann

No 2021-013, Working Papers from Federal Reserve Bank of St. Louis

Abstract: Are users of a bibliographic database interested in learning about replications? Can they be induced to learn? To answer these questions, we performed an experiment at the online research bibliography, RePEc (Research Papers in Economics). RePEc is the main research bibliography for pre-prints and published papers in economics. Using randomized stratification, we allocated 324 replications and their corresponding original studies to clusters. We then drew from those clusters to construct treatment and control groups. Brightly colored tabs were added to the relevant webpages to alert visitors to the existence of a replication study. We then monitored traffic over three phases lasting several months: a) no treatment, b) treatment on one group, c) treatment on both groups. Our estimates indicate that this intervention generated an average click-through-rate (CTR) of 1.6%, resulting in a 13% increase in the visits to replication webpages, though only the former estimate was statistically significant.

Keywords: replications; RePEc; Experiment; Online Research Bibliography; Webpages; Click-throughs (search for similar items in EconPapers)
JEL-codes: A11 B41 Z0 (search for similar items in EconPapers)
Pages: 25 pages
Date: 2021-10-28, Revised 2022-02-24
New Economics Papers: this item is included in nep-cbe and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://s3.amazonaws.com/real.stlouisfed.org/wp/2021/2021-013.pdf Full Text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedlwp:93317

Ordering information: This working paper can be ordered from

DOI: 10.20955/wp.2021.013

Access Statistics for this paper

More papers in Working Papers from Federal Reserve Bank of St. Louis Contact information at EDIRC.
Bibliographic data for series maintained by Scott St. Louis ().