Do rankings reflect research quality?
Bruno Frey and
Katja Rost
Journal of Applied Economics, 2010, vol. 13, 1-38
Abstract:
Publication and citation rankings have become major indicators of the scientific worth of universities and determine to a large extent the career of individual scholars. Such rankings do not effectively measure research quality, which should be the essence of any evaluation. These quantity rankings are not objective; two citation rankings, based on different samples, produce entirely different results. For that reason, an alternative ranking is developed as a quality indicator, based on membership on academic editorial boards of professional journals. It turns out that the ranking of individual scholars based on that measure is far from objective. Furthermore, the results differ markedly, depending on whether research quantity or quality is considered. Thus, career decisions based on rankings are dominated by chance and do not reflect research quality. We suggest that evaluations should rely on multiple criteria. Public management should return to approved methods such as engaging independent experts who in turn provide measurements of research quality for their research communities.
Keywords: rankings; evaluations; universities; scholars; research quality (search for similar items in EconPapers)
JEL-codes: H43 L15 O38 (search for similar items in EconPapers)
Date: 2010
References: Add references at CitEc
Citations: View citations in EconPapers (61)
Downloads: (external link)
https://ucema.edu.ar/publicaciones/download/volume13/frey.pdf (application/pdf)
Related works:
Journal Article: Do Rankings Reflect Research Quality? (2010) 
Working Paper: Do Rankings Reflect Research Quality? (2008) 
Working Paper: Do Rankings Reflect Research Quality? (2008) 
Working Paper: Do Rankings Reflect Research Quality? (2008) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:cem:jaecon:v:13:y:2010:n:1:p:1-38
Access Statistics for this article
Journal of Applied Economics is currently edited by Germán Coloma and Mariana Conte Grand and Jorge M. Streb
More articles in Journal of Applied Economics from Universidad del CEMA Contact information at EDIRC.
Bibliographic data for series maintained by Valeria Dowding ().