Sampling Bias in Entrepreneurial Experiments

Ruiqing Cao (), Rembrand Koning () and Ramana Nanda
Additional contact information
Ruiqing Cao: Stockholm School of Economics, 113 83 Stockholm, Sweden
Rembrand Koning: Harvard Business School, Boston, Massachusetts 02163

Management Science, 2024, vol. 70, issue 10, 7283-7307

Abstract: Using data from a prominent online platform for launching new digital products, we document that “sampling bias”—defined as the difference between a startup’s target customer base and the actual sample on which early “beta tests” are conducted—has a systematic and persistent impact on the venture’s success. Specifically, we show that products with a female-focused target market launching on a typical day, when nine in 10 users on this platform are men, experience 45% less growth a year after launch than those for whom the target market is more male-focused. By isolating exogenous variation in the composition of beta testers unrelated to the characteristics of launched products on that day, we find that on days when there are unexpectedly more women beta testers on the platform—reducing the amount of sampling bias for female-focused products—the gender performance gap shrinks toward zero. Our results highlight how sampling bias can lead to fewer successfully commercialized innovations for consumers who are underrepresented among early users.

Keywords: entrepreneurial strategy; experimentation; gender; technology ventures (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.2021.01740 (application/pdf)

Related works:
Working Paper: Sampling Bias in Entrepreneurial Experiments (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:70:y:2024:i:10:p:7283-7307

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().