Reliability of Scores on the Summative Performance Assessments

Yanyun Yang, Albert Oosterhof and Yan Xia

The Journal of Educational Research, 2015, vol. 108, issue 6, 465-479

Abstract: The authors address the reliability of scores obtained on the summative performance assessments during the pilot year of our research. Contrary to classical test theory, we discussed the advantages of using generalizability theory for estimating reliability of scores for summative performance assessments. Generalizability theory was used as the framework because of the flexibility this approach provides for examining sources of inconsistency within a complex assessment. Two major sources of inconsistency on scores considered in this study were raters and agencies (teachers' rating vs. researchers' rating). Overall, results showed that the inconsistency in scores attributable to raters and agencies was relatively small. Suggestions regarding improvement of consistency in the subsequent years of our research were provided.

Date: 2015
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00220671.2014.917255 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:vjerxx:v:108:y:2015:i:6:p:465-479

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/vjer20

DOI: 10.1080/00220671.2014.917255

Access Statistics for this article

The Journal of Educational Research is currently edited by Mary F. Heller

More articles in The Journal of Educational Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().