Non-standard errors

Albert Menkveld, Anna Dreber, Felix Holzmeister, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Sebastian Neusüss, Michael Razen and Utz Weitzel
Authors registered in the RePEc Author Service: Thomas P. Gehrig, El Mehdi Ferrouhi and Marco Alexander Schwarz

No 11/2021, IWH Discussion Papers from Halle Institute for Economic Research (IWH)

Abstract: In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.

Keywords: non-standard errors; multi-analyst approach; liquidity (search for similar items in EconPapers)
JEL-codes: C12 C18 G1 G14 (search for similar items in EconPapers)
Date: 2021
New Economics Papers: this item is included in nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/247267/1/1779882106.pdf (application/pdf)

Related works:
Journal Article: Nonstandard Errors (2024)
Working Paper: Nonstandard errors (2024)
Working Paper: Nonstandard Errors (2024)
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors* (2023)
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors (2022)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-standard errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-Standard Errors (2021)
Working Paper: Non-standard errors (2021)
Working Paper: Non-standard errors (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:iwhdps:112021

Access Statistics for this paper

More papers in IWH Discussion Papers from Halle Institute for Economic Research (IWH) Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().