An Evaluation of Bias in Three Measures of Teacher Quality: Value-Added, Classroom Observations, and Student Surveys

Andrew Bacher-Hicks, Mark J. Chin, Thomas J. Kane and Doug Staiger

No 23478, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: There are three primary measures of teaching performance: student test-based measures (i.e., value added), classroom observations, and student surveys. Although all three types of measures could be biased by unmeasured traits of the students in teachers’ classrooms, prior research has largely focused on the validity of value-added measures. We conduct an experiment involving 66 mathematics teachers in four school districts and test the validity of all three types of measures. Specifically, we test whether a teacher’s performance on each measure under naturally occurring (i.e., non-experimental) settings predicts performance following random assignment of that teacher to a class of students. Combining our results with those from two previous experiments, we provide further evidence that value-added measures are unbiased predictors of teacher performance. In addition, we provide the first evidence that classroom observation scores are unbiased predictors of teacher performance on a rubric measuring the quality of mathematics instruction. Unfortunately, we lack the statistical power to reach any similar conclusions regarding the predictive validity of a teacher’s student survey responses.

JEL-codes: I21 J24 (search for similar items in EconPapers)
Date: 2017-06
New Economics Papers: this item is included in nep-edu, nep-exp and nep-ure
Note: CH ED LS PE
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
http://www.nber.org/papers/w23478.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:23478

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w23478

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().