Discontinuous Distribution of Test Statistics Around Significance Thresholds in Empirical Accounting Studies

Xin Chang, Huasheng Gao and Wei Li

Journal of Accounting Research, 2025, vol. 63, issue 1, 165-206

Abstract: Examining test statistics from articles in six leading accounting journals, we detect discontinuities in their distributions around conventional significance thresholds (p‐values of 0.05 and 0.01) and find an unusual abundance of test statistics that are just significant. Further analysis reveals that these discontinuities are more prominent in studies with smaller samples and are more salient in experimental than in archival studies. The discontinuity discrepancy between experimental and archival studies relates to several proxies for researcher degrees of freedom. Nevertheless, this evidence does not imply that experimental research is more prone to questionable research practices than archival studies. Overall, our findings speak to the concern of whether accounting researchers could exercise undisclosed discretion to obtain and report statistically significant results. Based on our results, a healthy skepticism of some just‐significant test statistics is warranted.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/1475-679X.12579

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:joares:v:63:y:2025:i:1:p:165-206

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0021-8456

Access Statistics for this article

Journal of Accounting Research is currently edited by Philip G. Berger, Luzi Hail, Christian Leuz, Haresh Sapra, Douglas J. Skinner, Rodrigo Verdi and Regina Wittenberg Moerman

More articles in Journal of Accounting Research from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().