Bibliometric evaluation vs. informed peer review: Evidence from Italy

Graziella Bertocchi, Alfonso Gambardella, Tullio Jappelli (), Carmela A. Nappi and Franco Peracchi

Research Policy, 2015, vol. 44, issue 2, 451-466

Abstract: A relevant question for the organization of large-scale research assessments is whether bibliometric evaluation and informed peer review yield similar results. In this paper, we draw on the experience of the panel that evaluated Italian research in Economics, Management and Statistics during the national assessment exercise (VQR) relative to the period 2004–2010. We exploit the unique opportunity of studying a sample of 590 journal articles randomly drawn from a population of 5681 journal articles (out of nearly 12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysis and by informed peer review. In the total sample we find fair to good agreement between informed peer review and bibliometric analysis and absence of statistical bias between the two. We then discuss the nature, implications, and limitations of this correlation.

Keywords: Research assessment; Informed peer review; Bibliometric evaluation; VQR (search for similar items in EconPapers)
Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (42)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0048733314001450
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy (2013)
Working Paper: Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy (2013)
Working Paper: Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy (2013)
Working Paper: Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy (2013)
Working Paper: Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy (2013)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:respol:v:44:y:2015:i:2:p:451-466

DOI: 10.1016/j.respol.2014.08.004

Access Statistics for this article

Research Policy is currently edited by M. Bell, B. Martin, W.E. Steinmueller, A. Arora, M. Callon, M. Kenney, S. Kuhlmann, Keun Lee and F. Murray

More articles in Research Policy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().