EconPapers    
Economics at your fingertips  
 

Field-normalized citation impact indicators using algorithmically constructed classification systems of science

Ludo Waltman
Authors registered in the RePEc Author Service: Javier Ruiz-Castillo

UC3M Working papers. Economics from Universidad Carlos III de Madrid. Departamento de Economía

Abstract: We study the problem of normalizing citation impact indicators for differences in citation practices across scientific fields. Normalization of citation impact indicators is usually done based on a field classification system. In practice, the Web of Science journal subject categories are often used for this purpose. However, many of these subject categories have a quite broad scope and are not sufficiently homogeneous in terms of citation practices. As an alternative, we propose to work with algorithmically constructed classification systems. We construct these classification systems by performing a large-scale clustering of publications based on their citation relations. In our analysis, 12 classification systems are constructed, each at a different granularity level. The number of fields in these systems ranges from 390 to 73,205 in granularity levels 1 to 12. This contrasts with the 236 subject categories in the WoS classification system. Based on an investigation of some key characteristics of the 12 classification systems, we argue that working with a few thousand fields may be an optimal choice. We then study the effect of the choice of a classification system on the citation impact of the 500 universities included in the 2013 edition of the CWTS Leiden Ranking. We consider both the MNCS and the PPtop 10% indicator. Globally, for all the universities taken together citation impact indicators generally turn out to be relatively insensitive to the choice of a classification system. Nevertheless, for individual universities, we sometimes observe substantial differences between indicators normalized based on the journal subject categories and indicators normalized based on an appropriately chosen algorithmically constructed classification system.

Date: 2014-03
New Economics Papers: this item is included in nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://e-archivo.uc3m.es/rest/api/core/bitstreams ... 3b21e9bed28b/content (application/pdf)

Related works:
Journal Article: Field-normalized citation impact indicators using algorithmically constructed classification systems of science (2015) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cte:werepe:we1403

Access Statistics for this paper

More papers in UC3M Working papers. Economics from Universidad Carlos III de Madrid. Departamento de Economía
Bibliographic data for series maintained by Ana Poveda ().

 
Page updated 2025-03-19
Handle: RePEc:cte:werepe:we1403