EconPapers    
Economics at your fingertips  
 

Non-Standard Errors

Christian Wolff, Albert Menkveld, Anna Dreber, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Michael Kirchler, Neusüess, Sebastian, Michael Razen and Utz Weitzel
Authors registered in the RePEc Author Service: Thomas P. Gehrig

No 16751, CEPR Discussion Papers from C.E.P.R. Discussion Papers

Abstract: In statistics, samples are drawn from a population in a data generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.

Date: 2021-11
References: Add references at CitEc
Citations:

Downloads: (external link)
https://cepr.org/publications/DP16751 (application/pdf)
CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org

Related works:
Journal Article: Nonstandard Errors (2024) Downloads
Working Paper: Nonstandard errors (2024) Downloads
Working Paper: Nonstandard Errors (2024) Downloads
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors (2023) Downloads
Working Paper: Non-Standard Errors (2022) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cpr:ceprdp:16751

Ordering information: This working paper can be ordered from
https://cepr.org/publications/DP16751

Access Statistics for this paper

More papers in CEPR Discussion Papers from C.E.P.R. Discussion Papers Centre for Economic Policy Research, 33 Great Sutton Street, London EC1V 0DX.
Bibliographic data for series maintained by ().

 
Page updated 2025-03-28
Handle: RePEc:cpr:ceprdp:16751