Are Most Published Research Findings False?
Andreas Diekmann
Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), 2011, vol. 231, issue 5-6, 628-635
Abstract:
In a provocative article Ioannidis (2005) argues that, in disciplines employing statistical tests of significance, professional journals report more wrong than true significant results. This short note sketches the argument and explores under what conditions the assertion holds. The “positive predictive value” (PPV) is lower than 1/2 if the a priori probability of the truth of a hypothesis is low. However, computation of the PPV includes only significant results. If both significant and non-significant results are taken into account the “total error ratio” (TER) will not exceed 1/2 provided no extremely large publication bias is present. Moreover, it is shown that theory-driven research may reduce the proportion of errors. Also, the role of replications is emphasized; replication studies of original research are so important because they drastically decrease the error ratio.
Keywords: Tests of significance; statistical errors; replications; Tests of significance; statistical errors; replications (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations:
Downloads: (external link)
https://doi.org/10.1515/jbnst-2011-5-606 (text/html)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:jns:jbstat:v:231:y:2011:i:5-6:p:628-635
DOI: 10.1515/jbnst-2011-5-606
Access Statistics for this article
Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik) is currently edited by Peter Winker
More articles in Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik) from De Gruyter
Bibliographic data for series maintained by Peter Golla ().