Tighter nets for smaller fishes? Mapping the development of statistical practices in consumer research between 2008 and 2020

Antonia Krefeld-Schwalb () and Benjamin Scheibehenne
Additional contact information
Antonia Krefeld-Schwalb: Erasmus University Rotterdam
Benjamin Scheibehenne: Karlsruhe Institute of Technology

Marketing Letters, 2023, vol. 34, issue 3, No 1, 365 pages

Abstract: Abstract During the last decade, confidence in many social sciences, including consumer research, has been undermined by doubts about the replicability of empirical research findings. These doubts have led to increased calls to improve research practices and adopt new measures to increase the replicability of published work from various stakeholders such as funding agencies, journals, and scholars themselves. Despite these demands, it is unclear to which the research published in the leading consumer research journals has adhered to these calls for change. This article provides the first systematic empirical analysis of this question by surveying three crucial statistics of published consumer research over time: sample sizes, effect sizes, and the distribution of published p values. The authors compile a hand-coded sample of N = 258 articles published between 2008 and 2020 in the Journal of Consumer Psychology, the Journal of Consumer Research, and the Journal of Marketing Research. An automated text analysis across all publications in these three journals corroborates the representativeness of the hand-coded sample. Results reveal a substantial increase in sample sizes above and beyond the use of online samples along with a decrease in reported effect sizes. Effect and samples sizes are highly correlated which at least partially explains the reduction in reported effect sizes.

Keywords: Experimental research methods; False-positive results; Review (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://link.springer.com/10.1007/s11002-022-09662-3 Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:mktlet:v:34:y:2023:i:3:d:10.1007_s11002-022-09662-3

Ordering information: This journal article can be ordered from
http://www.springer. ... etailsPage=societies

DOI: 10.1007/s11002-022-09662-3

Access Statistics for this article

Marketing Letters is currently edited by Joel Steckel and Peter Golder

More articles in Marketing Letters from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().