Evaluating students’ evaluations of professors
Michela Braga (),
Marco Paccagnella and
Michele Pellizzari
No 384, Working Papers from IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University
Abstract:
This paper contrasts measures of teacher effectiveness with the students’ evaluations for the same teachers using administrative data from Bocconi University (Italy). The effectiveness measures are estimated by comparing the subsequent performance in follow-on coursework of students who are randomly assigned to teachers in each of their compulsory courses. We find that, even in a setting where the syllabuses are fixed, teachers still matter substantially. The average difference in subsequent performance between students who were assigned to the best and worst teachers (on the effectiveness scale) is approximately 43% of a standard deviation in the distribution of exam grades, corresponding to about 5.6% of the average grade. Additionally, we find that our measure of teacher effectiveness is negatively correlated with the students’ evaluations of professors: in other words, teachers who are associated with better subsequent performance receive worst evaluations from their students. We rationalize these results with a simple model where teachers can either engage in real teaching or in teaching-to-the-test, the former requiring higher students’ effort than the latter. Teaching-to-the-test guarantees high grades in the current course but does not improve future outcomes. Hence, if students are myopic and evaluate better teachers from which they derive higher utility in a static framework, the model is capable of predicting our empirical finding that good teachers receive bad evaluations, especially when teaching-to-the-test is very effective. Consistently with the predictions of the model, we also find that classes in which high skill students are over-represented produce evaluations that are less at odds with estimated teacher effectiveness.
Date: 2011
New Economics Papers: this item is included in nep-edu and nep-lab
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)
Downloads: (external link)
https://repec.unibocconi.it/igier/igi/wp/2011/384.pdf (application/pdf)
Related works:
Journal Article: Evaluating students’ evaluations of professors (2014) 
Working Paper: Evaluating students' evaluations of professors (2011) 
Working Paper: Evaluating Students' Evaluations of Professors (2011) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:igi:igierp:384
Ordering information: This working paper can be ordered from
https://repec.unibocconi.it/igier/igi/
Access Statistics for this paper
More papers in Working Papers from IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University via Rontgen, 1 - 20136 Milano (Italy).
Bibliographic data for series maintained by ().