Referees or sponsors? The role of evaluators in the promotion of research scientists in a public research organization

Miriam Glennie, Michael O’Donnell, Michelle Brown and John Benson

Research Evaluation, 2019, vol. 28, issue 1, 63-72

Abstract: Evaluators play a central role in assessments of researchers’ performance for reward, but the nature of their role and influence is not well understood. Ongoing reliance on evaluator judgement is typically justified as a need for referees in contests for reward, because quantitative performance measures alone can be subject to distortion. Yet, if evaluators are able to privately establish or interpret the performance standards utilized in evaluation, it may inhibit equality of opportunity, limit applicant pools, and reinforce existing inequalities. This article untangles the different roles played by evaluators through the development of a typology of systems of performance evaluation from existing literature. The typology is then applied to one type of evaluation system—promotion in a public research organization (PRO)—to investigate how and why particular evaluator roles emerge, and what contextual factors influence their implementation. Data are drawn from a mixed-method case study of a large Australian PRO, which includes data from one focus group, 22 in-depth interviews and 803 survey responses. The case study finds that evaluators’ role can extend to sponsorship of researchers through the promotion system when diversity in research specializations inhibits the establishment of uniform performance standards. It also demonstrates that reporting lines and evaluator workload impact how and to whom sponsoring support is given.

Keywords: researcher evaluation; typology; promotion; public research organization; sponsorship (search for similar items in EconPapers)
Date: 2019
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/reseval/rvy035 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:rseval:v:28:y:2019:i:1:p:63-72.

Access Statistics for this article

Research Evaluation is currently edited by Julia Melkers, Emanuela Reale and Thed van Leeuwen

More articles in Research Evaluation from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().