Teachers' leniency: experimental evidence

Etienne Dagorn, Isaac Parkes and Alberto Prati

CEP Discussion Papers from Centre for Economic Performance, LSE

Abstract: Two teachers grading the same student can reach very different conclusions— yet little is known about which teacher characteristics drive such disagreement. We investigate this question through a large-scale online experiment in which over 1,600 French secondary-school teachers independently evaluated the same set of fictitious student transcripts, generating hundreds of ratings per transcript. This design allows us to decompose grade variation into a component attributable to the student (transcript fixed effects) and one attributable to the teacher (rater fixed effects). After controlling for transcript fixed-effects, we find that teacher leniency accounts for about 40% of the remaining grade variance. These differences are largely unrelated to teachers' gender, subject, teaching style, or job satisfaction, but are positively associated with altruism (measured via an incentivized dictator game) and exhibit a U-shaped relationship with age, with middle-aged teachers being the most strict. An incentivized task reveals that most teachers perceive themselves as more lenient than their colleagues - in particular women - but middle-aged teachers less so. Finally, teachers' stated tolerance for inter-rater disagreement comfortably exceeds the disagreement we actually observe - in contrast with findings from other professional domains. These results speak to the design of fair assessment panels and suggest that differential leniency, while substantial, may be partly predictable and therefore correctable.

Keywords: Teacher grading; grading bias; teacher leniency; noise audit; inter-rater disagreement; experimen (search for similar items in EconPapers)
Date: 2026-08-12
References: Add references at CitEc
Citations:

Downloads: (external link)
https://cep.lse.ac.uk/pubs/download/dp2204.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cep:cepdps:dp2204

Access Statistics for this paper

More papers in CEP Discussion Papers from Centre for Economic Performance, LSE
Bibliographic data for series maintained by ().