Intellectual Infl uence: Quality versus Quantity

László Kóczy (), Alexandru Nichifor and Martin Strobel

No 1009, Working Paper Series from Óbuda University, Keleti Faculty of Business and Management

Abstract: To take development and budgeting decisions for research activi- ties the officials in charge need to constantly evaluate and assess the quality of research. Over the years a handful of scoring methods for academic journals have been proposed. Discussing the most prominent methods (de facto standards) we show that they cannot distinguish quality from quantity at article level and that they are inherently biased against journals publishing more articles. If we consider the length of a journal by the number of pages or characters, then all methods are biased against lengthier journals. The systematic bias we nd is analytically tractable and implies that the methods are ma- nipulable. We show that the strategies for successful manipulation are relatively easy to infer and implement. The implications of our ndings extend beyond the evaluation of academic research, to related settings like the ranking of web domains. Non-manipulable methods for measuring intellectual in uence exist.

Keywords: scoring methods bias; ranking rules bias; impact factor; invariant method; LP method; invariance to article-splitting; quality and quantity in ranking academic journals; scoring methods bias; ranking rules bias; impact factor; invariant method; LP method; invariance to article-splitting; quality and quantity in ranking academic journals (search for similar items in EconPapers)
Pages: 15 pages
Date: 2010
New Economics Papers: this item is included in nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://uni-obuda.hu/users/vecseya/RePEc/pkk/wpaper/1009.pdf Manuscript, 2010 (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://uni-obuda.hu/users/vecseya/RePEc/pkk/wpaper/1009.pdf [301 Moved Permanently]--> https://uni-obuda.hu/users/vecseya/RePEc/pkk/wpaper/1009.pdf)

Related works:
Working Paper: Intellectual Influence: quality versus quantity (2010)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pkk:wpaper:1009.rdf

Access Statistics for this paper

More papers in Working Paper Series from Óbuda University, Keleti Faculty of Business and Management Contact information at EDIRC.
Bibliographic data for series maintained by Alexandra Vécsey ( this e-mail address is bad, please contact ).