The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies

James Heckman and Jeffrey Smith

No 6983, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: The key to estimating the impact of a program is constructing the counterfactual outcome representing what would have happened in its absence. This problem becomes more complicated when agents self-select into the program rather than being exogenously assigned to it. This paper uses data from a major social experiment to identify what would have happened to the earnings of self-selected participants in a job training program had they not participated in it. We investigate the implications of these earnings patterns for the validity of widely-used before-after and difference-in-differences estimators. Motivated by the failure of these estimators to produce credible estimates, we investigate the determinants of program participation. We find that labor force status dynamics, rather than earnings or employment dynamics, drive the participation process. Our evidence suggests that training programs often function as a form of job search. Methods that control only for earnings dynamics, like the conventional difference-in-differences estimator, do not adequately capture the underlying differences between participants and non-participants. We use the estimated probabilities of participation in both matching estimators and a nonparametric, conditional version of the differences-in-differences estimator and produce large reductions in the selection bias in non-experimental estimates of the effect of training on earnings.

JEL-codes: J24 (search for similar items in EconPapers)
Date: 1999-02
New Economics Papers: this item is included in nep-pbe and nep-pub
Note: LS PE
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (224)

Published as Economic Journal, Vol. 109, no. 457 (1999): 313-348.

Downloads: (external link)
http://www.nber.org/papers/w6983.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:6983

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w6983

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().