Research assessment and recognized excellence: simple bibliometrics for more efficient academic research evaluations

Pierre Régibeau and Katharine Rockett

Economic Policy, 2016, vol. 31, issue 88, 611-652

Abstract: Many countries perform research assessment of universities, although the methods differ widely. Significant resources are invested in these exercises. Moving to a more mechanical, metrics-based system could therefore create very significant savings. We evaluate a set of simple, readily accessible metrics by comparing real Economics departments to three possible benchmarks of research excellence: a fictitious department composed exclusively of former Nobel Prize winners, actual world-leading departments, and reputation-based rankings of real departments. We examine two types of metrics: publications weighted by the quality of the outlet and citations received. The publication-based metric performs better at distinguishing the benchmarks if it requires at least four publications over a six year period and allows for a top rate for a very small set of elite reviews. Cumulative citations received over two six-year review periods appear to be somewhat more consistent with our three benchmarks than within-period citations, although within-period citations still distinguish quality. We propose a simple evaluation process relying on a composite index with a journal-based and a citations-based component. We also provide rough estimates of the cost: assuming that all fields of research would be amenable to a similar approach, we obtain a total cost of about £12M per review period.

Keywords: H4; I23; L51; O38 (search for similar items in EconPapers)
Date: 2016
References: Add references at CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://hdl.handle.net/10.1093/epolic/eiw011 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:ecpoli:v:31:y:2016:i:88:p:611-652.

Access Statistics for this article

Economic Policy is currently edited by Ghazala Azmat, Roberto Galbiati, Isabelle Mejean and Moritz Schularick

More articles in Economic Policy from CEPR, CESifo, Sciences Po Contact information at EDIRC., CES Contact information at EDIRC., MSH Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press ().