If (My) 6 Was (Your) 9: Reporting Heterogeneity in Student Evaluations of Teaching

Marco Bertoni, Enrico Rettore and Lorenzo Rocco

No 13565, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: Student Evaluations of Teaching (SET) are subjective measures of student satisfaction that are often used to assess teaching quality. In this paper, we show that heterogeneity in students' reporting styles challenges SET validity. Using administrative data that allow us to track all evaluations produced by each student, we are able to isolate student-specific reporting scales. We show that reporting heterogeneity explains at least one third of the within-course variation in SET.We also document that students sort across elective courses according to their reporting style. As a result, the average evaluation of two otherwise identical electives can differ only because of heterogeneity in the reporting style of students attending them. Using a simulation exercise, we show that this type of sorting coupled with large sampling variability severely alter the ranking of courses within a major, calling into question the use of SET to incentivise teachers.

Keywords: reporting heterogeneity; student evaluations of teaching; selection (search for similar items in EconPapers)
JEL-codes: D63 I23 I28 (search for similar items in EconPapers)
Pages: 45 pages
Date: 2020-08
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Published - published in: Labour Economics, 2024, 89, 102567

Downloads: (external link)
https://docs.iza.org/dp13565.pdf (application/pdf)

Related works:
Journal Article: If (my) 6 was (your) 9. Reporting heterogeneity in student evaluations of teaching (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp13565

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().