Outlier Aversion in Subjective Evaluation

Jungmin Lee

Journal of Sports Economics, 2008, vol. 9, issue 2, 141-159

Abstract: The quality of subjective performance evaluation is dependent on the incentive structures evaluators face. Figure skating competitions provide a unique opportunity to study subjective evaluation. Using scoring data from World Figure Skating Championships between 2001 and 2003, I test for the existence of “outlier aversion†in which subjective evaluators avoid submitting outlying judgments. I find that judges manipulate scores to achieve a targeted level of agreement with the other judges. Agreement may not be a good criterion for the validity of an evaluation system, consistent with the recent applied psychology and management literature.

Keywords: subjective performance evaluation; outlier aversion; figure skating (search for similar items in EconPapers)
Date: 2008
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/1527002507299203 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jospec:v:9:y:2008:i:2:p:141-159

DOI: 10.1177/1527002507299203

Access Statistics for this article

More articles in Journal of Sports Economics
Bibliographic data for series maintained by SAGE Publications ().