Beyond Publication Bias: Characterizing and Understanding Missing Results in Economics
Fernando Hoces de la Guardia (),
Edward Miguel (),
Gufran Pathan (),
Akash Shaji (),
Viviane Helena Silva da Rocha (),
Erik Ø. Sørensen () and
Bertil Tungodden ()
Additional contact information
Fernando Hoces de la Guardia: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://fhoces.github.io/
Edward Miguel: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://emiguel.econ.berkeley.edu/
Gufran Pathan: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America
Akash Shaji: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://akashnshaji.com/
Viviane Helena Silva da Rocha: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America
Erik Ø. Sørensen: Dept. of Economics, Norwegian School of Economics and Business Administration, Postal: NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway, https://www.statsokonomen.no/
Bertil Tungodden: Dept. of Economics, Norwegian School of Economics and Business Administration, Postal: NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway, https://sites.google.com/view/bertiltungodden/home
No 17/2026, Discussion Paper Series in Economics from Norwegian School of Economics, Department of Economics
Abstract:
What scientists choose not to publish can be as important as what they do publish.We measure missing research results at the hypothesis level and use this approach to study under-reporting in economics. Across 5,057 pre-registered hypotheses from 317 studies registered on the American Economic Association RCT Registry between 2015 and 2017, only 42% have publicly available results eight to nine years after pre-registration. Among the available results, 64% are null, and we find little evidence that null results are disproportionately missing. In an RCT, direct engagement with authors increases the share of hypotheses with available results by 6.2 percentage points, while raising awareness alone has no significant effect and additional research assistance provides no further improvement. Direct engagement also increases explanations for unavailable results, reducing the share of hypotheses that remain unaccounted for by 16.4 percentage points. The findings document extensive under-reporting in economics that does not appear to be driven primarily by the suppression of null results, and suggest that reporting pre-registered results may need to become a standard part of the research process rather than something recovered years later.
Keywords: Publication bias; null results; randomized controlled trials (search for similar items in EconPapers)
JEL-codes: I24 (search for similar items in EconPapers)
Pages: 99 pages
Date: 2026-11-13
References: Add references at CitEc
Citations:
Downloads: (external link)
https://nva.sikt.no/registration/01a1e8e92afc-2e13 ... 61-af1a-a115a1ef454d Full text (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:hhs:nhheco:2026_017
Ordering information: This working paper can be ordered from
Access Statistics for this paper
More papers in Discussion Paper Series in Economics from Norwegian School of Economics, Department of Economics NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway. Contact information at EDIRC.
Bibliographic data for series maintained by Synne Stormoen ().