Damaging Real Lives through Obstinacy: Re-Emphasising Why Significance Testing is Wrong
Stephen Gorard
Sociological Research Online, 2016, vol. 21, issue 1, 102-115
Abstract:
This paper reminds readers of the absurdity of statistical significance testing, despite its continued widespread use as a supposed method for analysing numeric data. There have been complaints about the poor quality of research employing significance tests for a hundred years, and repeated calls for researchers to stop using and reporting them. There have even been attempted bans. Many thousands of papers have now been written, in all areas of research, explaining why significance tests do not work. There are too many for all to be cited here. This paper summarises the logical problems as described in over 100 of these prior pieces. It then presents a series of demonstrations showing that significance tests do not work in practice. In fact, they are more likely to produce the wrong answer than a right one. The confused use of significance testing has practical and damaging consequences for people's lives. Ending the use of significance tests is a pressing ethical issue for research. Anyone knowing the problems, as described over one hundred years, who continues to teach, use or publish significance tests is acting unethically, and knowingly risking the damage that ensues.
Keywords: Significance Testing; Inverse Probabilities; Statistical Errors; Ethics of Social Research (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)
Downloads: (external link)
https://journals.sagepub.com/doi/10.5153/sro.3857 (text/html)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:sae:socres:v:21:y:2016:i:1:p:102-115
DOI: 10.5153/sro.3857
Access Statistics for this article
More articles in Sociological Research Online
Bibliographic data for series maintained by SAGE Publications ().