EconPapers    
Economics at your fingertips  
 

Beyond Publication Bias: Characterizing and Understanding Missing Results in Economics

Fernando Hoces de la Guardia (), Edward Miguel (), Gufran Pathan (), Akash Shaji (), Viviane Helena Silva da Rocha (), Erik Ø. Sørensen () and Bertil Tungodden ()
Additional contact information
Fernando Hoces de la Guardia: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://fhoces.github.io/
Edward Miguel: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://emiguel.econ.berkeley.edu/
Gufran Pathan: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America
Akash Shaji: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America, https://akashnshaji.com/
Viviane Helena Silva da Rocha: University of California, Berkeley, Postal: University of California, Berkeley, 207 Giannini Hall, Berkeley, CA 94720, The United States of America
Erik Ø. Sørensen: Dept. of Economics, Norwegian School of Economics and Business Administration, Postal: NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway, https://www.statsokonomen.no/
Bertil Tungodden: Dept. of Economics, Norwegian School of Economics and Business Administration, Postal: NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway, https://sites.google.com/view/bertiltungodden/home

No 17/2026, Discussion Paper Series in Economics from Norwegian School of Economics, Department of Economics

Abstract: What scientists choose not to publish can be as important as what they do publish.We measure missing research results at the hypothesis level and use this approach to study under-reporting in economics. Across 5,057 pre-registered hypotheses from 317 studies registered on the American Economic Association RCT Registry between 2015 and 2017, only 42% have publicly available results eight to nine years after pre-registration. Among the available results, 64% are null, and we find little evidence that null results are disproportionately missing. In an RCT, direct engagement with authors increases the share of hypotheses with available results by 6.2 percentage points, while raising awareness alone has no significant effect and additional research assistance provides no further improvement. Direct engagement also increases explanations for unavailable results, reducing the share of hypotheses that remain unaccounted for by 16.4 percentage points. The findings document extensive under-reporting in economics that does not appear to be driven primarily by the suppression of null results, and suggest that reporting pre-registered results may need to become a standard part of the research process rather than something recovered years later.

Keywords: Publication bias; null results; randomized controlled trials (search for similar items in EconPapers)
JEL-codes: I24 (search for similar items in EconPapers)
Pages: 99 pages
Date: 2026-11-13
References: Add references at CitEc
Citations:

Downloads: (external link)
https://nva.sikt.no/registration/01a1e8e92afc-2e13 ... 61-af1a-a115a1ef454d Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:nhheco:2026_017

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Discussion Paper Series in Economics from Norwegian School of Economics, Department of Economics NHH, Department of Economics, Helleveien 30, N-5045 Bergen, Norway. Contact information at EDIRC.
Bibliographic data for series maintained by Synne Stormoen ().

 
Page updated 2026-11-18
Handle: RePEc:hhs:nhheco:2026_017