How much do journal titles tell us about the academic interest and relevance of economic research? An empirical analysis

Felix Schlaepfer ()
Additional contact information
Felix Schlaepfer: Institute for Environmental Decision, Swiss Federal Institute of Technology Zurich
Authors registered in the RePEc Author Service: Felix Schläpfer ()

No 917, SOI - Working Papers from Socioeconomic Institute - University of Zurich

Abstract: Unlike in other disciplines, research output in economics is commonly measured based on the journal titles in which an author has published. Here, I examine how much output measures based on journal titles tell us about the academic interest and relevance of economic papers as measured by citation frequency. Using data from the 2008 Handelsblatt ranking of economists in German speaking countries and interdisciplinary citation data from the Web of Science, I find that researcher scores based on journal titles explain only about one fourth of the variation (variance) in article citations. When the top 10 (20) percent of the researchers according to journal title scores are excluded, the percentage of explained variation in citation frequency drops to 5 (3) percent. These findings empirically confirm the hypothesis that the measures of research output in economics promote narrow and complacent work that is of interest to few, even among an academic audience. They suggest that responsible hiring committees and funding institutions should re-examine existing standards in evaluation and abandon the heavy reliance on journal titles as a measure of individual research output.

Keywords: citation index; incentives; publication; research evaluation; scientometrics (search for similar items in EconPapers)
JEL-codes: A10 (search for similar items in EconPapers)
Pages: 14 pages
Date: 2009-12
New Economics Papers: this item is included in nep-hpe and nep-sog
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.zora.uzh.ch/id/eprint/51926/1/wp0917.pdf First version, 2009 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:soz:wpaper:0917

Access Statistics for this paper

More papers in SOI - Working Papers from Socioeconomic Institute - University of Zurich Contact information at EDIRC.
Bibliographic data for series maintained by Severin Oswald ().