Revalidation of the applicability of Altmetrics indicators in article-level evaluation: An empirical analysis of papers of different types of citation trajectories

Hao Li and Jianhua Hou

Journal of Informetrics, 2024, vol. 18, issue 4

Abstract: While providers try to control the quality of the data, the applicability of Altmetrics indicators to the assessment of scientific papers remains an open question. One important reason is that the citation counts used to explain and evaluate the applicability of Altmetrics in this regard do not directly and completely reflect the impact and quality of papers. In view of the fact that the introduction of citation trajectory helps to enrich our understanding of the impact and quality of papers, this study first discusses the correlation between citation counts and Altmetrics indicators of papers under different citation trajectory types on the basis of dividing five citation trajectory types and considering possible influences such as field and publication year. Then, after controlling the relevant variables, we construct a multinomial logistic regression with the citation trajectory type as the dependent variable to analyze the possible relationship between Altmetrics and the citation trajectory type of papers. Finally, we construct a decision tree model and a regression model after mixed sampling to verify the robustness of the regression results. The findings reveal that there were significant differences in the performance of Altmetrics indicators among papers with different citation trajectory types. The applicability of Altmetrics for evaluating papers with different citation trajectory types should be judged carefully. At the same time, it is suggested that robust Altmetrics (such as save) can be applied to assess the quality of papers and characterize the citation life cycle.

Keywords: Altmetrics; Citation trajectory; Article-level evaluation; Social impact (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1751157724000853
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:infome:v:18:y:2024:i:4:s1751157724000853

DOI: 10.1016/j.joi.2024.101573

Access Statistics for this article

Journal of Informetrics is currently edited by Leo Egghe

More articles in Journal of Informetrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().