Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages: What are the Implications for High-Stakes Personnel Policies in an Urban School District?

Han Bing, McCaffrey Daniel, Matthew Springer and Gottfried Michael
Additional contact information
Han Bing: RAND Corporation
McCaffrey Daniel: RAND Corporation
Gottfried Michael: RAND Corporation and Loyola Marymount University

Statistics, Politics and Policy, 2012, vol. 3, issue 2, 24

Abstract: Both research and practice of value-added models (VAM) have been growing in recent years due to the widespread effort to quantify teacher effectiveness. The existing VAM literature has not yet tested the sensitivity of value-added estimates to the rules that define which students contribute to each teacher’s value-added estimate. Student-teacher linkages are often a complex network due to various transfers, students taking multiple courses in the same subject, and students receiving special education or other “pull-out” services. Complex linkages are often considered as among the main threats to the validity of VAM. In this paper we conducted a case study to examine the sensitivity of VAM to the alternative link definitions. We examined three popular VAM approaches and applied alternative rules for linking students to teachers with each method. We found no overall sensitivity of estimated teacher effects to the linking rules. Even though more teachers had value-added estimates under more inclusive rules, for a teacher with estimates under all three rules, the correlation among pairs of estimates created using different linking rules was always above 0.95 and generally above 0.98 for each VAM approach. The value-added estimates of a small number of teachers were affected by highly different link definitions and these tended to be teachers with small numbers of students. Restricting the minimal sample size for calculating individual teachers’ value-added largely reduced the sensitivity in link definition.

Keywords: value-added model; student teacher linkage; sensitivity (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/2151-7509.1035 (text/html)
For access to full text, subscription to the journal or payment for the individual article is required.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:statpp:v:3:y:2012:i:2:p:24:n:1

Ordering information: This journal article can be ordered from
https://www.degruyter.com/journal/key/spp/html

DOI: 10.1515/2151-7509.1035

Access Statistics for this article

Statistics, Politics and Policy is currently edited by Joel A. Middleton

More articles in Statistics, Politics and Policy from De Gruyter
Bibliographic data for series maintained by Peter Golla ().