Testing the Waters: Behavior across Participant Pools

Erik Snowberg and Leeat Yariv

No 24781, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: We leverage a large-scale incentivized survey eliciting behaviors from (almost) an entire university student population, a representative sample of the U.S. population, and Amazon Mechanical Turk (MTurk) to address concerns about the external validity of experiments with student participants. Behavior in the student population offers bounds on behaviors in other populations, and correlations between behaviors are largely similar across samples. Furthermore, non-student samples exhibit higher measurement error. Adding historical lab participation data, we find a small set of attributes over which lab participants differ from non-lab participants. Using an additional set of lab experiments, we see no evidence of observer effects.

JEL-codes: B41 C80 C90 (search for similar items in EconPapers)
Date: 2018-06
New Economics Papers: this item is included in nep-exp
Note: AP CF DEV PE POL
References: Add references at CitEc
Citations: View citations in EconPapers (33)

Published as Erik Snowberg & Leeat Yariv, 2021. "Testing the Waters: Behavior across Participant Pools," American Economic Review, vol 111(2), pages 687-719.

Downloads: (external link)
http://www.nber.org/papers/w24781.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:24781

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w24781

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().