Two Selection Problems, One Bias Term: Experimental Sign-Up Is Treatment Choice in Disguise

John List

Natural Field Experiments from The Field Experiments Website

Abstract: Consider a referee report containing the sentence: "Assignment to treatment was voluntary, though the authors acknowledge this as a limitation in the conclusion." The Editor would summarily reject. Now replace "assignment to treatment" with "entry into the experimental sample," and the sentence describes the modal published experiment. This study shows that both biases are the same mathematical object. The bias from non-random sample entry is the sorting-on-gains term from the classic selection decomposition. Interestingly, they both admit an isomorphic Roy micro-foundation and inverse-Mills characterization. A simple calibration reveals that for the typical experiment, the observed bias can be large. One solution to this bias is to conduct a natural field experiment (NFE). When an NFE is not possible, three alternative reporting practices are offered.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
http://s3.amazonaws.com/fieldexperiments-papers2/papers/00837.pdf

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:feb:natura:00837

Access Statistics for this paper

More papers in Natural Field Experiments from The Field Experiments Website
Bibliographic data for series maintained by Franco Daniel Albino ().