Using Lagged Outcomes to Evaluate Bias in Value-Added Models

Raj Chetty, John Friedman and Jonah Rockoff

American Economic Review, 2016, vol. 106, issue 5, 393-99

Abstract: Value-added (VA) models measure agents' productivity based on the outcomes they produce. The utility of VA models for performance evaluation depends on the extent to which VA estimates are biased by selection. One common method of evaluating bias in VA is to test for balance in lagged values of the outcome. We show that such balance tests do not yield robust information about bias in value-added models using Monte Carlo simulations. Even unbiased VA estimates can be correlated with lagged outcomes. More generally, tests using lagged outcomes are uninformative about the degree of bias in misspecified VA models. The source of these results is that VA is itself estimated using historical data, leading to non-transparent correlations between VA and lagged outcomes.

JEL-codes: D24 I21 J24 (search for similar items in EconPapers)
Date: 2016
Note: DOI: 10.1257/aer.p20161081
References: Add references at CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
https://www.aeaweb.org/articles?id=10.1257/aer.p20161081 (application/pdf)
https://www.aeaweb.org/aer/data/10605/P2016_1081_data.zip (application/zip)
https://www.aeaweb.org/aer/app/10605/P2016_1081_app.pdf (application/pdf)
https://www.aeaweb.org/aer/ds/10605/P2016_1081_ds.zip (application/zip)
Access to full text is restricted to AEA members and institutional subscribers.

Related works:
Working Paper: Using Lagged Outcomes to Evaluate Bias in Value-Added Models (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aea:aecrev:v:106:y:2016:i:5:p:393-99

Ordering information: This journal article can be ordered from
https://www.aeaweb.org/journals/subscriptions

Access Statistics for this article

American Economic Review is currently edited by Esther Duflo

More articles in American Economic Review from American Economic Association Contact information at EDIRC.
Bibliographic data for series maintained by Michael P. Albert ().