When a journal is both at the ‘top’ and the ‘bottom’: the illogicality of conflating citation-based metrics with quality

Shannon Mason () and Lenandlar Singh ()
Additional contact information
Shannon Mason: Nagasaki University
Lenandlar Singh: University of Guyana

Scientometrics, 2022, vol. 127, issue 6, No 35, 3683-3694

Abstract: Abstract The ‘quality’, ‘prestige’, and ‘impact’ of a scholarly journal is largely determined by the number of citations its articles receive. Publication and citation metrics play an increasingly central (but contested) role in academia, often influencing who gets hired, who gets promoted, and who gets funded. These metrics are also of interest to institutions, as they may impact government funding, and their position in influential university rankings. Within this context, researchers around the world are experiencing pressure to publish in the ‘top’ journals. But what if a journal is considered a ‘top’ journal, and a ‘bottom’ journal at the same time? We recently came across such a case, and wondered if it was just an anomaly, or if it was more common than we might assume. This short communication reports the findings of our investigation into the nature and extent of this phenomenon in Scimago Journal Country and Rank (SJR) and Journal Citation Reports (JCR), both of which produce influential citation-based metrics. In analyzing around 25,000 journals and 12,000 journals respectively, we found that they are commonly placed into multiple subject categories. If citation-based metrics are an indication of broader concepts of research/er quality, which is so often implied or inferred, then we would expect that journals would be ranked similarly across these categories. However, our findings show that it is not uncommon for journals to attract citations to differing degrees depending on their category, resulting in journals that may at the same time be perceived as both ‘high’ and ‘low’ quality. This study is further evidence of the illogicality of conflating citation-based metrics with journal, research, and researcher quality, a continuing and ubiquitous practice that impacts thousands of researchers.

Keywords: Scholarly publishing; Journal metrics; Citation metrics (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-022-04402-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:127:y:2022:i:6:d:10.1007_s11192-022-04402-w

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-022-04402-w

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().