Ranking journals by voting with feet: a new method for journal evaluation

Kun Chen, Xu Liu, Abduhalik Wupur and Guo-liang Yang ()
Additional contact information
Kun Chen: Xinjiang University
Xu Liu: Xinjiang University
Abduhalik Wupur: Xinjiang University
Guo-liang Yang: Chinese Academy of Sciences

Scientometrics, 2024, vol. 129, issue 3, No 16, 1567-1588

Abstract: Abstract This paper introduces the Voting with Feet Index (VFI), a novel method for evaluating the quality of academic journals. Unlike previous approaches that rely on citation analysis or expert surveys, which have limitations such as not indicating paper quality or being time-consuming and expensive, the VFI argues that a journal's quality should be determined by the quality of the papers it publishes. This is measured through proxies such as awards, author reputation, and institutional affiliation, as assessing each paper individually is challenging. The study also examines the relative importance of these proxies and their potential combination. To rank journals, the VFI analyzes the distribution of papers that have received important awards, papers authored by notable scholars, and papers affiliated with distinguished institutions. A score is then calculated for each journal. The VFI was applied to 40 MS & OR (Management Science & Operations Research) journals and compared with impact factor and expert survey rankings. The results demonstrate a strong correlation between the VFI and these rankings, particularly for high-level journals. Furthermore, the rankings of selected journals in physics and chemistry were determined using Nobel Prize data. This analysis not only confirmed the accuracy of the VFI in identifying top journals but also highlighted important considerations for the indicator's construction. Overall, the VFI presents a promising new approach to assess journal quality, addressing the limitations of existing methods.

Keywords: Journal evaluation; Journal quality; MS&OR journals; Academic journals (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-023-04888-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:129:y:2024:i:3:d:10.1007_s11192-023-04888-y

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-023-04888-y

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().