Analysis of journal evaluation indicators: an experimental study based on unsupervised Laplacian score

Lin Feng (), Jian Zhou (), Sheng-Lan Liu (), Ning Cai () and Jie Yang ()
Additional contact information
Lin Feng: Dalian University of Technology
Jian Zhou: Dalian University of Technology
Sheng-Lan Liu: Dalian University of Technology
Ning Cai: Beijing University of Posts and Telecommunications
Jie Yang: Tsinghua University

Scientometrics, 2020, vol. 124, issue 1, No 10, 233-254

Abstract: Abstract Academic journal rankings have always been a hot topic because the journals ranking will be significantly affected by using different ranking systems or bibliometrics indicators. Many studies have shown that feature selection methods are beneficial to categorize and rank journals according to the different evaluation indicators. However, such methods are limited to analyzing the journals published in a single discipline. In this article, we conduct an experiment based on unsupervised Laplacian score to analyze journal evaluation indicators between three different disciplines (Biology, Artificial Intelligence, and Mathematics). The journal’s features considered in the study include: JIF, 5-Year JIF, CiteScore, SJR, SNIP, and H-index. Based on the results of the feature selection, we first use the spectral clustering technique to verify the impact of different feature combinations on journals categorization. Furthermore, k-Nearest Neighbor (k-NN) and Back Propagation Neural Network classifiers are trained to measure the classification performance by using each single feature or feature subsets. The experimental results demonstrate that the two classifiers achieve the superior classification performance when the input of the classifier is the set of JIF, CiteScore, and H-index. Finally, we design a subjective questionnaire to collect the opinion of the volunteers with regard to the six evaluation indiactors in terms of familiarity, complexity, and usability. According to the vote results of a seven-point Likert scale, JIF and H-index receive the relatively higher ratings in comparison to other bibliometric indicators.

Keywords: Bibliometric indicators; Journals categorization; Laplacian score; Subjective questionnaire (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-020-03422-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:124:y:2020:i:1:d:10.1007_s11192-020-03422-8

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-020-03422-8

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().