Quantitative and Qualitative Rankings of Scholars

Katja Rost and Bruno Frey

Schmalenbach Business Review (sbr), 2011, vol. 63, issue 1, 63-91

Abstract: In a former article we started to argue that publication and citation rankings of individual scholars do not effectively measure research quality, which should in fact be the essence of evaluation (Frey and Rost (2010)). For the field of economics we show that an alternative ranking based on membership on academic editorial boards of professional journals is randomly correlated with citation and publication rankings of these scholars. In this article we go a step further by hypothesizing a systematic, inverted U-shaped relationship between quantitative and qualitative rankings. By relying on a longitudinal data set of management scholars who are part of the international topcommunity in organization science the findings support this multi-tasking effect. While a certain amount of publications indeed reflects aspects of research quality, it also suggests that maximizing publications ignores other essential aspects of research quality that are doubtlessly hard to measure. It follows that if career decisions are only based on high scores in publication rankings the result will be not only haphazard but may be even counterproductive for science.

Keywords: Evaluations; Rankings; Research Quality; Scholars; Universities (search for similar items in EconPapers)
JEL-codes: H43 L15 O38 (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://www.vhb.de/sbr/pdfarchive.html (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sbr:abstra:v:63:y:2011:i:1:p:63-91

Access Statistics for this article

Schmalenbach Business Review (sbr) is currently edited by Wolfgang Ballwieser

More articles in Schmalenbach Business Review (sbr) from LMU Munich School of Management Contact information at EDIRC.
Bibliographic data for series maintained by sbr ( this e-mail address is bad, please contact ).