A practical guide to Registered Reports for economists

Thibaut Arpinon and Romain Espinosa ()
Additional contact information
Thibaut Arpinon: CREM, University of Rennes 1
Romain Espinosa: CIRED, CNRS

Journal of the Economic Science Association, 2023, vol. 9, issue 1, No 8, 90-122

Abstract: Abstract The current publication system in economics has encouraged the inflation of positive results in empirical papers. Registered Reports, also called Pre-Results Reviews, are a new submission format for empirical work that takes pre-registration one step further. In Registered Reports, researchers write their papers before running the study and commit to a detailed data collection process and analysis plan. After a first-stage review, a journal can give an In-Principle-Acceptance guaranteeing that the paper will be published if the authors carry out their data collection and analysis as pre-specified. We here propose a practical guide to Registered Reports for empirical economists. We illustrate the major problems that Registered Reports address (p-hacking, HARKing, forking, and publication bias), and present practical guidelines on how to write and review Registered Reports (e.g., the data-analysis plan, power analysis, and correction for multiple-hypothesis testing), with R and STATA codes. We provide specific examples for experimental economics, and show how research design can be improved to maximize statistical power. Last, we discuss some tools that authors, editors, and referees can use to evaluate Registered Reports (checklist, study-design table, and quality assessment).

Keywords: Registered Reports; Practical guide; Pre-registration; p-hacking; HARKing; Multiple-hypothesis testing; Power analysis; The smallest effect size of interest (search for similar items in EconPapers)
JEL-codes: A10 C12 C9 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://link.springer.com/10.1007/s40881-022-00123-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jesaex:v:9:y:2023:i:1:d:10.1007_s40881-022-00123-1

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/40881

DOI: 10.1007/s40881-022-00123-1

Access Statistics for this article

Journal of the Economic Science Association is currently edited by Nikos Nikiforakis and Robert Slonim

More articles in Journal of the Economic Science Association from Springer, Economic Science Association Contact information at EDIRC.
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().