How improper dichotomization and the misrepresentation of uncertainty undermine social science research

Edward E. Rigdon

Journal of Business Research, 2023, vol. 165, issue C

Abstract: If the fundamental problem in social science research was a matter of researchers “gaming” their p-values or even unintentionally accumulating “significant findings,” then steps such as monitoring the distribution of p-values in research could help to resolve the problem. Yet “significant” p-values do not indicate a “finding” nor their absence a “non-finding,” so these efforts may be misguided. More fundamental problems lie in researchers’ false dichotomization of intrinsically continuous p-values and in researchers’ misrepresentation of the uncertainty of their findings. Statistical standard errors as conventionally computed in social science research substantially understate the overall uncertainty of research results. Disregarding the meaningless concept of “statistical significance” and adopting a metrological view of uncertainty will better enable researchers, journals and disciplines to grasp the scientific contributions of individual research studies and to design future studies that will make a genuine contribution to the state of knowledge.

Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0148296323004447
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jbrese:v:165:y:2023:i:c:s0148296323004447

DOI: 10.1016/j.jbusres.2023.114086

Access Statistics for this article

Journal of Business Research is currently edited by A. G. Woodside

More articles in Journal of Business Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().