Metodi bibliometrici e revisione dei pari per la valutazione della ricerca: un confronto metodologico

Bibliometric and peer review methods for research evaluation: a methodological appraisement

Tindaro Cicero, Marco Malgarini (), Carmela Anna Nappi and Franco Peracchi

MPRA Paper from University Library of Munich, Germany

Abstract: The Italian Research Evaluation exercise for the period 2004-2010 has analyzed almost 185,000 among articles, books, patents and other scientific products submitted by Italian Universities and other public research bodies. In most cases, scientific publications have been peer reviewed; however, in hard sciences, medicines, engineering and economics, bibliometric indicators have also been used. For those areas, we have extracted a representative sample of scientific products, equal to the 10% of the reference population of submitted products, to be evaluated both with peer review and biblometric methods. Our analysis shows that peer review and bibliometric evaluations exhibit a level of concordance higher than that observed among two different reviewers of the same article. In almost any scientific discipline, however, there is a systematic difference among peer and bibliometric evaluations: more specifically, bibliometric scores are on average significantly higher than those obtained with the peer review. Overall, our results obtained fully support the choice adopted in the Italian exercise of using both evaluation techniques in order to assess the quality of Italian research institutions.

Keywords: Indicatori bibliometrici; revisione dei pari; valutazione della ricerca (search for similar items in EconPapers)
JEL-codes: I20 I23 (search for similar items in EconPapers)
Date: 2013-10-06
New Economics Papers: this item is included in nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/50470/1/MPRA_paper_50470.pdf original version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:50470

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().