Accounting research and the significance test crisis

David Johnstone

CRITICAL PERSPECTIVES ON ACCOUNTING, 2022, vol. 89, issue C

Abstract: The emerging or at least threatening “significance test crisis” in accounting has been prompted by a chorus across multiple physical and social sciences of dissatisfaction with conventional frequentist statistical research methods and behaviors, particularly the use and abuse of p-levels. There are now hundreds of published papers and statements, echoing what has been said behind closed doors for decades, namely that much if not most empirical research is unreliable, simply wrong or at worst fabricated. The problems are a mixture of flawed statistical logic (as Bayesians have claimed for decades), “p-hacking” by way of fishing for significant results and publications, selective reporting or “the file drawer problem”, and ultimately the “agency problem” that researchers charged by funding bodies (their Universities, governments and taxpayers) with conducting disinterested “objective science” are motivated more by the personal need to publish and please other researchers. Expanding on that theme, the supply of empirical research in the “market for statistical significance” is described in terms of “market failure” and “the market for lemons”.

Keywords: Empirical accounting research; Significance tests; Replication crisis; p-levels; p-hacking; Registered reports (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1045235421000150
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:crpeac:v:89:y:2022:i:c:s1045235421000150

DOI: 10.1016/j.cpa.2021.102296

Access Statistics for this article

CRITICAL PERSPECTIVES ON ACCOUNTING is currently edited by Marcia Annisette, Christine Cooper and Yves Gendron

More articles in CRITICAL PERSPECTIVES ON ACCOUNTING from Elsevier
Bibliographic data for series maintained by Catherine Liu ().