Errors of measurement in scientometrics: classification schemes and document types in citation and publication rankings

Nicolas Robinson-Garcia (), Benjamín Vargas-Quesada (), Daniel Torres-Salinas (), Zaida Chinchilla-Rodríguez () and Juan Gorraiz ()
Additional contact information
Nicolas Robinson-Garcia: University of Granada
Benjamín Vargas-Quesada: University of Granada
Daniel Torres-Salinas: University of Granada
Zaida Chinchilla-Rodríguez: Consejo Superior de Investigaciones Científicas (CSIC)
Juan Gorraiz: University of Vienna

Scientometrics, 2024, vol. 129, issue 10, No 31, 6455-6475

Abstract: Abstract This research article delves into methodological challenges in scientometrics, focusing on errors stemming from the selection of classification schemes and document types. Employing two case studies, we examine the impact of these methodological choices on publication and citation rankings of institutions. We compute seven bibliometric indicators for over 8434 institutions using 23 different classification schemes derived from Clarivate’s InCites suite, as well as including all document types versus only citable items. Given the critical role university rankings play in research management and their methodological controversies, our goal is to propose a methodology that incorporates uncertainty levels when reporting bibliometric performance in professional practice. We then delve into differences in error estimates within research fields as well as between institutions from different geographic regions. The findings underscore the importance of responsible metric use in research evaluation, providing valuable insights for both bibliometricians and consumers of such data.

Keywords: Responsible metrics; Institutions rankings; Citation indicators; Publication counts; Classifications of science; Professional bibliometrics (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-024-05159-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:129:y:2024:i:10:d:10.1007_s11192-024-05159-0

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-024-05159-0

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().