Reliability-Related Issues in the Context of Student Evaluations of Teaching in Higher Education

Ilker Kalender

International Journal of Higher Education, 2015, vol. 4, issue 3, 44

Abstract: Student evaluations of teaching (SET) forms have been the principal instrument to elicit students’ opinion in higher education institutions. Many decisions, including high-stake ones, are made based on SET scores reported by students. In this respect, reliability of SET scores is of considerable importance. But this paper has an argument that there are some problems in choosing and use of reliability indices in SET context. Three hypothesizes were tested- (i) using internal consistency measures is misleading in SET context since the variability is mainly due to disagreement between students’ ratings which requires use of inter-rater reliability coefficients, (ii) number of minimum feedbacks is not achieved in most of the classes, resulting unreliable decisions, and (iii) calculating reliability assuming a common factor structure across all classes is misleading because a common factorial model may not be tenable for all. Results showed that use of only internal consistency to assess SET scores may be misleading. Considerable large numbers of missing feedbacks were observed to achieve acceptable reliability levels. Findings also indicated that factorial models differed across several groups, which calculation of reliability coefficients become problematic.

Date: 2015
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.sciedupress.com/journal/index.php/ijhe/article/download/6972/4358 (application/pdf)
https://www.sciedupress.com/journal/index.php/ijhe/article/view/6972 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jfr:ijhe11:v:4:y:2015:i:3:p:44

Access Statistics for this article

More articles in International Journal of Higher Education from Sciedu Press Contact information at EDIRC.
Bibliographic data for series maintained by Sciedu Press ().