A toolbox to evaluate the trustworthiness of published findings

Susanne Jana Adler, Lukas Röseler and Martina Katharina Schöniger

Journal of Business Research, 2023, vol. 167, issue C

Abstract: During the past few years, researchers have criticized their professions for providing an entry point for false-positive results arising from publication bias and questionable research practices such as p-hacking (i.e., selectively reporting analyses that yield a p-value below 5 %). Researchers are advocating replication studies and the implementation of open-science practices, like preregistration, in order to identify trustworthy effects. Nevertheless, because such consumer research developments are still emerging, most prior research findings have not been replicated, leaving researchers in the dark as to whether a line of research or a particular effect is trustworthy. We tackle this problem by providing a toolbox containing multiple heuristics to identify data patterns that might, from the information provided in published articles, indicate publication bias and p-hacking. Our toolbox is an easy-to-use instrument with which to initially assess a given set of findings.

Keywords: Null hypothesis significance testing; P-hacking; Publication bias; P-curve; Z-curve (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0148296323005489
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jbrese:v:167:y:2023:i:c:s0148296323005489

DOI: 10.1016/j.jbusres.2023.114189

Access Statistics for this article

Journal of Business Research is currently edited by A. G. Woodside

More articles in Journal of Business Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().