Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research

Alfonso Ávila-Robinson (), Cristian Mejia and Shintaro Sengoku
Additional contact information
Alfonso Ávila-Robinson: Tecnologico de Monterrey
Cristian Mejia: Tokyo Institute of Technology
Shintaro Sengoku: Tokyo Institute of Technology

Scientometrics, 2021, vol. 126, issue 9, No 8, 7477-7502

Abstract: Abstract Interdisciplinary research (IDR) has become an important component in the conduction of leading-edge science and innovation. From the different approaches available to measuring IDR, bibliometric indicators have experienced the greatest growth. Despite the frequent use of bibliometric measures of IDR in research and policymaking, their adequacy has not been validated against scientists’ perceptions. Using the case of an IDR-oriented research institute in Japan, this study aims to investigate the differences and similarities between the outcomes of common bibliometric measures of IDR and the scientists’ perceptions of IDR. We used a unique dataset combining bibliometric measures with survey data collected from the scientists’ self-assessment of their research. This study also investigates the factors influencing the outcomes of bibliometrics and scientists' perceptions. Moreover, this study explores how IDR qualitative and quantitative measures differ from those that are more intuitive, such as scientific impact. It was observed that there is no “holy grail” measure for interdisciplinarity when compared with scientific impact, for which the impact factor is considered as a key metric by scientists. While bibliometric measures of interdisciplinarity show mild correlations with scientists' perceptions, they display high discriminatory power. The disagreement between qualitative and quantitative evaluations, as well as the significant field-specific nature of interdisciplinarity, calls for the use of multidimensional assessment approaches for assessing IDR, and the building of a consensus about the meaning and measurement of interdisciplinarity among scientists, respectively. The results of this study provide a series of guidelines for a more effective implementation of interdisciplinarity-oriented R&D policies at different organizational levels.

Keywords: Interdisciplinarity; Scientific impact; Bibliometric measures; Survey; Self-assessment data (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-021-04048-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:126:y:2021:i:9:d:10.1007_s11192-021-04048-0

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-021-04048-0

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().