The Cult of Statistical Significance – What Economists Should and Should Not Do to Make their Data Talk

Walter Krämer

Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, 2011, vol. 131, issue 3, 455-468

Abstract: This article takes issue with a rather devastating critique of statistical significance testing propagated in a recent book by Ziliak/McCloskey (2008) of the same title. Ziliak/McCloskey argue that statistical significance testing is a barrier rather than a booster for empirical research in economics and should therefore be abandoned altogether. The present article argues that this is good advice in some research areas but not in others, with the aim of making practitioners aware of various fallacies connected with the concept of statistical significance, and at the same time showing where significance testing is most fruitfully employed. Taking all issues which have appeared so far of the German Economic Review and a recent epidemiological meta-analysis as examples, the present paper shows that there has indeed been a lot of misleading work where confirmatory significance testing has played a major role, and that at the same time many promising avenues, best summarized under the heading “specification tests”, have not been used.

JEL-codes: B40 C12 C52 (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.3790/schm.131.3.455 (application/pdf)
Access to full text is restricted to subscribers (2008 onwards); Pay-per-view access from http://www.genios.de (2000 onwards with 2 years moving wall) and http://ejournals.duncker-humblot.de/loi/schm (2008 onwards)

Related works:
Working Paper: The cult of statistical significance. What economists should and should not do to make their data talk (2011)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aeq:aeqsjb:v131_y2011_i3_q3_p455-468

Ordering information: This journal article can be ordered from
http://www.duncker-h ... llersjahrbuch-1.html

Access Statistics for this article

Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften is currently edited by Gert G. Wagner and Joachim Wagner

More articles in Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften from Duncker & Humblot, Berlin
Bibliographic data for series maintained by Gabriele Freudenmann ( this e-mail address is bad, please contact ).