Using a Satisficing Model of Experimenter Decision-Making to Guide Finite-Sample Inference for Compromised Experiments

Ganesh Karapakula and James Heckman

No 27738, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: This paper presents a simple decision-theoretic economic approach for analyzing social experiments with compromised random assignment protocols that are only partially documented. We model administratively constrained experimenters who satisfice in seeking covariate balance. We develop design-based small-sample hypothesis tests that use worst-case (least favorable) randomization null distributions. Our approach accommodates a variety of compromised experiments, including imperfectly documented re-randomization designs. To make our analysis concrete, we focus much of our discussion on the influential Perry Preschool Project. We reexamine previous estimates of program effectiveness using our methods. The choice of how to model reassignment vitally affects inference.

JEL-codes: C01 C4 I21 (search for similar items in EconPapers)
Date: 2020-08
New Economics Papers: this item is included in nep-ecm and nep-exp
Note: CH TWP
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published as James J Heckman & Ganesh Karapakula, 2021. "Using a satisficing model of experimenter decision-making to guide finite-sample inference for compromised experiments [Sampling-based versus design-based uncertainty in regression analysis]," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 1-39.

Downloads: (external link)
http://www.nber.org/papers/w27738.pdf (application/pdf)

Related works:
Journal Article: Using a satisficing model of experimenter decision-making to guide finite-sample inference for compromised experiments (2021)
Working Paper: Using a Satisficing Model of Experimenter Decision-Making to Guide Finite-Sample Inference for Compromised Experiments (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:27738

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w27738

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().