Non-Standard Errors
Albert Menkveld,
Anna Dreber,
Felix Holzmeister,
Juergen Huber,
Magnus Johannesson,
Michael Kirchler,
Sebastian Neusüss,
Michael Razen,
Utz Weitzel and
Gunther Capelle-Blancard
Additional contact information
Juergen Huber: University of Innsbruck
Michael Kirchler: University of Innsbruck
Sebastian Neusüss: Aalto University
Michael Razen: University of Innsbruck
Utz Weitzel: Vrije Universiteit Amsterdam, Radboud University
Authors registered in the RePEc Author Service: Thomas P. Gehrig
Documents de travail du Centre d'Economie de la Sorbonne from Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne
Abstract:
In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants
Keywords: non-standard errors; multi-analyst approach; liquidity (search for similar items in EconPapers)
JEL-codes: C12 C18 G1 G14 (search for similar items in EconPapers)
Pages: 57 pages
Date: 2021-11
New Economics Papers: this item is included in nep-exp
References: Add references at CitEc
Citations:
Downloads: (external link)
http://mse.univ-paris1.fr/pub/mse/CES2021/21033.pdf (application/pdf)
https://halshs.archives-ouvertes.fr/halshs-03500882
Related works:
Journal Article: Nonstandard Errors (2024) 
Working Paper: Nonstandard errors (2024) 
Working Paper: Nonstandard Errors (2024) 
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors (2023) 
Working Paper: Non-Standard Errors (2022) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-standard errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-Standard Errors (2021) 
Working Paper: Non-standard errors (2021) 
Working Paper: Non-standard errors (2021) 
Working Paper: Non-standard errors (2021) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:mse:cesdoc:21033
Access Statistics for this paper
More papers in Documents de travail du Centre d'Economie de la Sorbonne from Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne Contact information at EDIRC.
Bibliographic data for series maintained by Lucie Label ().