Do Negative Replications Affect Citations?

Tom Coupé and W. Reed ()

Working Papers in Economics from University of Canterbury, Department of Economics and Finance

Abstract: This study examines the effect of negative replications on the citation rates of replicated studies. We study a set of 204 replicated studies in economics and compare their citation performance with an initial sample of 112,000 potential controls taken from Scopus. From this initial pool, we match each replicated study with multiple controls based on having comparable citation histories. Our main finding is that there is no evidence that studies that receive negative replications suffer a penalty in the form of fewer citations. We also find that replicated studies receive somewhat more citations than their matched control studies, though here the causal interpretation is more suspect.

Keywords: Replications; Citations; Matching; Meta-science; Self-correcting science (search for similar items in EconPapers)
JEL-codes: A11 A14 B41 C18 (search for similar items in EconPapers)
Pages: 24 pages
Date: 2022-09-01
New Economics Papers: this item is included in nep-hpe and nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://repec.canterbury.ac.nz/cbt/econwp/2216.pdf (application/pdf)

Related works:
Working Paper: Do Negative Replications Affect Citations? (2022)
Working Paper: Do Negative Replications Affect Citations? (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cbt:econwp:22/16

Access Statistics for this paper

More papers in Working Papers in Economics from University of Canterbury, Department of Economics and Finance Private Bag 4800, Christchurch, New Zealand. Contact information at EDIRC.
Bibliographic data for series maintained by Albert Yee ().