Measuring teaching quality in higher education: assessing selection bias in course evaluations

Maarten Goos () and Anna Salomons ()
Additional contact information
Maarten Goos: Utrecht University School of Economics
Anna Salomons: Utrecht University School of Economics

Research in Higher Education, 2017, vol. 58, issue 4, No 1, 364 pages

Abstract: Abstract Student evaluations of teaching (SETs) are widely used to measure teaching quality in higher education and compare it across different courses, teachers, departments and institutions. Indeed, SETs are of increasing importance for teacher promotion decisions, student course selection, as well as for auditing practices demonstrating institutional performance. However, survey response is typically low, rendering these uses unwarranted if students who respond to the evaluation are not randomly selected along observed and unobserved dimensions. This paper is the first to fully quantify this problem by analyzing the direction and size of selection bias resulting from both observed and unobserved characteristics for over 3000 courses taught in a large European university. We find that course evaluations are upward biased, and that correcting for selection bias has non-negligible effects on the average evaluation score and on the evaluation-based ranking of courses. Moreover, this bias mostly derives from selection on unobserved characteristics, implying that correcting evaluation scores for observed factors such as student grades does not solve the problem. However, we find that adjusting for selection only has small impacts on the measured effects of observables on SETs, validating a large related literature which considers the observable determinants of evaluation scores without correcting for selection bias.

Keywords: Education quality; Student evaluations of teaching (SET); Sample selection bias; Heckman selection model (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://link.springer.com/10.1007/s11162-016-9429-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:reihed:v:58:y:2017:i:4:d:10.1007_s11162-016-9429-8

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11162

DOI: 10.1007/s11162-016-9429-8

Access Statistics for this article

Research in Higher Education is currently edited by Robert K. Toutkoushian

More articles in Research in Higher Education from Springer, Association for Institutional Research
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().