Characterizing Selection Bias Using Experimental Data

James Heckman, Hidehiko Ichimura, Jeffrey Smith and Petra Todd

No 6699, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: This paper develops and applies semiparametric econometric methods to estimate the form of selection bias that arises from using nonexperimental comparison groups to evaluate social programs and to test the identifying assumptions that justify three widely-used classes of estimators and our extensions of them: (a) the method of matching; (b) the classical econometric selection model which represents the bias solely as a function of the probability of participation; and (c) the method of difference-in-differences. Using data from an experiment on a prototypical social program combined with unusually rich data from a nonexperimental comparison group, we reject the assumptions justifying matching and our extensions of that method but find evidence in support of the index-sufficient selection bias model and the assumptions that justify application of a conditional semiparametric version of the method of difference-in-difference. Fa comparable people and to appropriately weight participants and nonparticipants a sources of selection bias as conveniently measured. We present a rigorous defin bias and find that in our data it is a small component of conventially meausred it is still substantial when compared with experimentally-estimated program impa matching participants to comparison group members in the same labor market, givi same questionnaire, and making sure they have comparable characteristics substan the performance of any econometric program evaluation estimator. We show how t analysis to estimate the impact of treatment on the treated using ordinary obser

JEL-codes: C14 C93 (search for similar items in EconPapers)
Date: 1998-08
New Economics Papers: this item is included in nep-ecm
Note: LS PE
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1345)

Published as Econometrica, Vol. 66, no. 5 (1999): 1017-1098.

Downloads: (external link)
http://www.nber.org/papers/w6699.pdf (application/pdf)

Related works:
Journal Article: Characterizing Selection Bias Using Experimental Data (1998)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:6699

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w6699

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().