Inference from field and laboratory experiments in economics: empirical evidence

Jonathan H.W. Tan, Zichen Zhao and Daniel John Zizzo

Journal of Economic Behavior & Organization, 2025, vol. 235, issue C

Abstract: Experimental economics publications test and make claims that are based on inferences from the experimental datasets they are based on. We ask whether the environment that the authors make claims about matches the actual environment that exists in their data. We answer this question by employing a sample of 520 publications in 2018 and 2019 at leading general and field journals in Economics to test. This is important as out-of-domain inference may (or may not) lead to issues of over-generalization. We study inferences made in different types of field and laboratory experiments. The average match rates are 11 % for laboratory experiments and 39 % for field experiments on aggregate. Around four out of five field experiments fail to match in at least three out of the five domains, as with almost all laboratory experiments. We conclude that out-of-domain inference applies to the majority of field and laboratory experiments. Policy testing experiments have a higher match rate. Further, we find that publications by top 20 institutions authors or with experiments conducted in majority White countries are more likely to generalize out-of-domain; specifically, there appears to be an institutional bias tied to the country of the experiment.

Keywords: Experimental design; Laboratory experiments; Field experiments; Validity; Inference (search for similar items in EconPapers)
JEL-codes: C18 C90 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S016726812500174X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jeborg:v:235:y:2025:i:c:s016726812500174x

DOI: 10.1016/j.jebo.2025.107055

Access Statistics for this article

Journal of Economic Behavior & Organization is currently edited by Houser, D. and Puzzello, D.

More articles in Journal of Economic Behavior & Organization from Elsevier
Bibliographic data for series maintained by Catherine Liu ().