How Reliable are Students’ Evaluations of Teaching (SETs)? A Study to Test Student’s Reproducibility and Repeatability

Amalia Vanacore () and Maria Sole Pellegrino ()
Additional contact information
Amalia Vanacore: University of Naples “Federico II”
Maria Sole Pellegrino: University of Naples “Federico II”

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 2019, vol. 146, issue 1, No 6, 77-89

Abstract: Abstract Students’ Evaluations of Teaching (SETs) are widely used as measures of teaching quality in Higher Education. A review of specialized literature evidences that researchers widely discuss whether SETs can be considered reliable measures of teaching quality evaluation. Though the controversy mainly refers to the role of students as assessors of teaching quality, most of research studies on SETs focus on the design and validation of the evaluation procedure and even when the need of measuring SETs reliability is recognized, it is generally indirectly assessed for the whole group of students by measuring inter-student agreement. In this paper the focus is on the direct assessment of the reliability of each student as a measurement instrument of teaching quality. An agreement-based approach is here adopted in order to assess student’s ability to provide consistent and stable evaluations; the sampling uncertainty is accounted for by building non-parametric bootstrap confidence intervals for the adopted agreement coefficients.

Keywords: Students’ Evaluations of Teaching; Intra-rater agreement; Student reproducibility; Student repeatability (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://link.springer.com/10.1007/s11205-018-02055-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:soinre:v:146:y:2019:i:1:d:10.1007_s11205-018-02055-y

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11205-018-02055-y

Access Statistics for this article

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement is currently edited by Filomena Maggino

More articles in Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().