Student Ratings of Instruction: Updating Measures to Reflect Recent Scholarship

Kathleen D. Dyer () and Dermot Donnelly-Hermosillo ()
Additional contact information
Kathleen D. Dyer: California State University
Dermot Donnelly-Hermosillo: California State University

Research in Higher Education, 2024, vol. 65, issue 7, No 10, 1587-1613

Abstract: Abstract This study aimed to demonstrate how one university worked to overcome some of the measurement problems associated with legacy student rating instruments through the creation and investigation of a new student rating instrument based on the most current scholarship on teaching and learning. Measurement problems with legacy instruments include asking about consumer satisfaction (including the use of global ratings) rather than directly assessing the quality of teaching, asking students for self-reports of learning, and asking students to make judgments about the internal state of their instructors. A new instrument was created to intentionally reduce these problems. The new instrument and its predecessor were both administered by 54 instructors in 81 classes and completed by 2,013 students. The following semester, the new instrument was administered university-wide including 1,450 instructors, 3,669 classes, and 58,320 students. The findings indicate that the new instrument created by this process is both reliable and valid but does not reflect multidimensionality. There is also no compelling evidence of bias according to gender or race. This work illustrates the process by which new and better instruments might be created and tested in order to replace flawed legacy instruments in higher education.

Keywords: Student ratings of instruction; Student evaluations of teaching; Reliability and validity; Bias (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11162-024-09804-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:reihed:v:65:y:2024:i:7:d:10.1007_s11162-024-09804-8

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11162

DOI: 10.1007/s11162-024-09804-8

Access Statistics for this article

Research in Higher Education is currently edited by Robert K. Toutkoushian

More articles in Research in Higher Education from Springer, Association for Institutional Research
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().