EconPapers    
Economics at your fingertips  
 

Non-Standard Errors

Albert Menkveld, Anna Dreber, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Michael Kirchler, Sebastian Neusüss, Michael Razen, Utz Weitzel and Oliver Linton
Authors registered in the RePEc Author Service: Thomas P. Gehrig

Janeway Institute Working Papers from Faculty of Economics, University of Cambridge

Abstract: In statistics, samples are drawn from a population in a data generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants. Online appendix available at https://bit.ly/3DIQKrB . Please note a full list of authors is available in the working paper.

Keywords: Market Efficiency; P-hacking; Publication bias (search for similar items in EconPapers)
JEL-codes: A14 C10 C12 C59 C90 G14 G40 (search for similar items in EconPapers)
Date: 2021-11-25
New Economics Papers: this item is included in nep-exp
Note: onl20
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.janeway.econ.cam.ac.uk/working-paper-pdfs/jiwp2112.pdf

Related works:
Journal Article: Nonstandard Errors (2024) Downloads
Working Paper: Nonstandard errors (2024) Downloads
Working Paper: Nonstandard Errors (2024) Downloads
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors (2023) Downloads
Working Paper: Non-Standard Errors (2022) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cam:camjip:2112

Access Statistics for this paper

More papers in Janeway Institute Working Papers from Faculty of Economics, University of Cambridge
Bibliographic data for series maintained by Jake Dyer (jd419@cam.ac.uk).

 
Page updated 2024-12-28
Handle: RePEc:cam:camjip:2112