EconPapers    
Economics at your fingertips  
 

Evaluating Students' Evaluations of Professors

Michela Braga (), Marco Paccagnella and Michele Pellizzari

No 5620, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: This paper contrasts measures of teacher effectiveness with the students' evaluations for the same teachers using administrative data from Bocconi University (Italy). The effectiveness measures are estimated by comparing the subsequent performance in follow-on coursework of students who are randomly assigned to teachers in each of their compulsory courses. We find that, even in a setting where the syllabuses are fixed and all teachers in the same course present exactly the same material, teachers still matter substantially. The average difference in subsequent performance between students who were assigned to the best and worst teacher (on the effectiveness scale) is approximately 43% of a standard deviation in the distribution of exam grades, corresponding to about 5.6% of the average grade. Additionally, we find that our measure of teacher effectiveness is negatively correlated with the students' evaluations: in other words, teachers who are associated with better subsequent performance receive worst evaluations from their students. We rationalize these results with a simple model where teachers can either engage in real teaching or in teaching-to-the-test, the former requiring higher students’ effort than the latter. Teaching-to-the-test guarantees high grades in the current course but does not improve future outcomes. Hence, if students are myopic and evaluate better teachers from which they derive higher utility in a static framework, the model is capable of predicting our empirical finding that good teachers receive bad evaluations, especially when teaching-to-the-test is very effective (for example, with multiple choice tests). Consistently with the predictions of the model, we also find that classes in which high skill students are over-represented produce evaluations that are less at odds with estimated teacher effectiveness.

Keywords: postsecondary education; teacher quality (search for similar items in EconPapers)
JEL-codes: I20 (search for similar items in EconPapers)
Pages: 54 pages
Date: 2011-04
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4) Track citations by RSS feed

Published in: Economics of Education Review, 2014, 41, 71-88

Downloads: (external link)
http://ftp.iza.org/dp5620.pdf (application/pdf)

Related works:
Journal Article: Evaluating students’ evaluations of professors (2014) Downloads
Working Paper: Evaluating students' evaluations of professors (2011) Downloads
Working Paper: Evaluating students’ evaluations of professors (2011) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp5620

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().

 
Page updated 2021-06-22
Handle: RePEc:iza:izadps:dp5620