Sampling Bias in Entrepreneurial Experiments

Ruiqing Cao, Rembrand M. Koning and Ramana Nanda

No 28882, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: Using data from a prominent online platform for launching new digital products, we document that ‘sampling bias’—defined as the difference between a startup’s target customer base and the actual sample on which early ‘beta tests’ are conducted—has a systematic and persistent impact on the venture’s success. Specifically, we show that products with a female-focused target market launching on a typical day, when nine in ten users on this platform are men, experience 45% less growth a year after launch than those for whom the target market is more male-focused. By isolating exogenous variation in the composition of beta testers unrelated to the characteristics of launched products on that day, we find that on days when there are unexpectedly more women beta testers on the platform—reducing the amount of sampling bias for female-focused products—the gender-performance gap shrinks towards zero. Our results highlight how sampling bias can lead to fewer successfully commercialized innovations for consumers who are underrepresented among early users.

JEL-codes: L1 M13 O3 (search for similar items in EconPapers)
Date: 2021-06
New Economics Papers: this item is included in nep-ent and nep-pay
Note: PR
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.nber.org/papers/w28882.pdf (application/pdf)

Related works:
Journal Article: Sampling Bias in Entrepreneurial Experiments (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:28882

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w28882

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().