An evaluation of metrics used by the Performance-based Research Fund process in New Zealand

Robert Buckle () and John Creedy

New Zealand Economic Papers, 2019, vol. 53, issue 3, 270-287

Abstract: The New Zealand Performance-based Research Fund applies a set of metrics to assess researchers and rank disciplines and universities. The process involves giving a total weighted score (based on three components) to individuals and then assigning them to one of four Quality Categories (QCs), used to derive Average Quality Scores (AQS). This paper evaluates the properties of these metrics and argues that QC thresholds influence the final distribution of scores. The paper also demonstrates that the derivation of AQSs depends on the weights assigned to each QC and the distribution of portfolios. The method used to determine raw scores also has an independent effect on the distribution of scores. The paper compares how research rankings of New Zealand universities would vary if alternative summary measures, based on the total weighted scores rather than QCs, were used to evaluate performance.

Date: 2019
References: Add references at CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
http://hdl.handle.net/10.1080/00779954.2018.1480054 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:nzecpp:v:53:y:2019:i:3:p:270-287

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/RNZP20

DOI: 10.1080/00779954.2018.1480054

Access Statistics for this article

New Zealand Economic Papers is currently edited by Dennis Wesselbaum

More articles in New Zealand Economic Papers from Taylor & Francis Journals
Bibliographic data for series maintained by ().