Research assessment and recognized excellence: simple bibliometrics for more efficient academic research evaluations
Pierre Régibeau and
Economic Policy, 2016, vol. 31, issue 88, 611-652
Many countries perform research assessment of universities, although the methods differ widely. Significant resources are invested in these exercises. Moving to a more mechanical, metrics-based system could therefore create very significant savings. We evaluate a set of simple, readily accessible metrics by comparing real Economics departments to three possible benchmarks of research excellence: a fictitious department composed exclusively of former Nobel Prize winners, actual world-leading departments, and reputation-based rankings of real departments. We examine two types of metrics: publications weighted by the quality of the outlet and citations received. The publication-based metric performs better at distinguishing the benchmarks if it requires at least four publications over a six year period and allows for a top rate for a very small set of elite reviews. Cumulative citations received over two six-year review periods appear to be somewhat more consistent with our three benchmarks than within-period citations, although within-period citations still distinguish quality. We propose a simple evaluation process relying on a composite index with a journal-based and a citations-based component. We also provide rough estimates of the cost: assuming that all fields of research would be amenable to a similar approach, we obtain a total cost of about £12M per review period.
Keywords: H4; I23; L51; O38 (search for similar items in EconPapers)
References: Add references at CitEc
Citations: View citations in EconPapers (5) Track citations by RSS feed
Downloads: (external link)
Access to full text is restricted to subscribers.
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:oup:ecpoli:v:31:y:2016:i:88:p:611-652.
Access Statistics for this article
Economic Policy is currently edited by Giuseppe Bertola, Philippe Martin and Paul Seabright
More articles in Economic Policy from CEPR Contact information at EDIRC., CES Contact information at EDIRC., MSH Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press ().