The effect of research evaluation exercises on research output: fifteen years of evidence from Italy

Massimiliano Bratti, Cicero Tindaro, Enrico Lippo, Carmela Anna Nappi and Matteo Turri

Politica economica, 2021, issue 1, 13-42

Abstract: In this paper, we investigate the potential benefits of implementing performance-based university research funding systems (PRFSs) in terms of both the quantity and«quality» (i.e. citation impact) of research outputs (measured through the Web of Science database). The Italian experience of the first two Research Evaluation Exercises is examined. We use a difference-in-differences in reverse (DDR) strategy, in which a country where a PRFS was always in place during the period of analysis – the «always treated» country, the UK – is compared with a country that switched from not having to implementing a PRFS – the «switched» country, Italy. Our analysis highlights that PRFSs are associated with an improvement in the average «quality» of research output (percentage of documents cited in the Web of Science database), although they do not positively impact output quantity (number of articles), which actually decreases, or «excellent» outputs (measured as the percentage of top-cited articles). An analysis of heterogeneous effects by scientific discipline shows that the effect on research «quality» concerns all fields except the humanities, with some positive effects on excellent research outputs in most hard sciences. Effects on research quality were not generalised but were observed only for the second research evaluation exercise. Other innovations introduced in the university system (the National Scientific Habilitation) may have partly contributed to this result.

Keywords: research assessment; performance-based university research funding; university research; difference-in-differences in reverse; Italy (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations: Track citations by RSS feed

Downloads: (external link)
https://www.rivisteweb.it/download/article/10.1429/101938 (application/pdf)
https://www.rivisteweb.it/doi/10.1429/101938 (text/html)
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:mul:je8794:doi:10.1429/101938:y:2021:i:1:p:13-42

Access Statistics for this article

Politica economica is currently edited by Giuseppe Marotta

More articles in Politica economica from Società editrice il Mulino
Bibliographic data for series maintained by ().