Does peer grading work? How to implement and improve it? Comparing instructor and peer assessment in MOOC GdP

Rémi Bachelet (), Drissa Zongo and Aline Bourelle
Additional contact information
Rémi Bachelet: Centrale Lille
Drissa Zongo: Centrale Lille
Aline Bourelle: Centrale Lille

Post-Print from HAL

Abstract: Large scale peer assessment is arguably the most critical innovation required for development of MOOCs. Its core principle is to involve students in the evaluation and feedback process of correcting assignments. However, it has been criticized for being less rigorous than instructor assessment, too demanding on students and not reliable or fair due to student biases. This paper is drawn from data and practical hands-on experience from MOOC GdP2, in which assignments were both graded by instructors and by peers. Using data from 4650 papers, each graded by 3-5 peers and by an instructor, we test hypotheses and discuss a series of questions: How to train MOOC students to grade their peers? Is peer grading as accurate as instructor grading? What data pre-processing is to be used prior to testing hypotheses on peer grading? Which grading algorithm is best for processing peer-produced data? Is anonymity in peer assessment preferable to increased student interaction? We also present the improved peer grading systems we implemented in MOOC GdP 3 and 4 thanks to this research.

Keywords: peer grading; peer assessment; Massive open online courses; MOOC (search for similar items in EconPapers)
Date: 2015-05-18
New Economics Papers: this item is included in nep-edu
Note: View the original document on HAL open archive server: https://shs.hal.science/halshs-01146710v2
References: Add references at CitEc
Citations:

Published in European MOOCs Stakeholders Summit 2015, May 2015, Mons, Belgium

Downloads: (external link)
https://shs.hal.science/halshs-01146710v2/document (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hal:journl:halshs-01146710

Access Statistics for this paper

More papers in Post-Print from HAL
Bibliographic data for series maintained by CCSD ().