What counts: Making sense of metrics of research value
Kate Williams
Science and Public Policy, 2022, vol. 49, issue 3, 518-531
Abstract:
There is no singular way of measuring the value of research. There are multiple criteria of evaluation given by different fields, including academia but also others, such as policy, media, and application. One measure of value within the academy is citations, while indications of wider value are now offered by altmetrics. This study investigates research value using a novel design focusing on the World Bank, which illuminates the complex relationship between valuations given by metrics and by peer review. Three theoretical categories, representing the most extreme examples of value, were identified: ‘exceptionals’, highest in both citations and altmetrics; ‘scholars’, highest in citations and lowest in altmetrics; and ‘influencers’, highest in altmetrics and lowest in citations. Qualitative analysis of 18 interviews using abstracts from each category revealed key differences in ascribed characteristics and judgements. This article provides a novel conception of research value across fields.
Keywords: research value; metrics; altmetrics; citations; evaluation; peer review; fields (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (1)
Downloads: (external link)
http://hdl.handle.net/10.1093/scipol/scac004 (application/pdf)
Access to full text is restricted to subscribers.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:oup:scippl:v:49:y:2022:i:3:p:518-531.
Access Statistics for this article
Science and Public Policy is currently edited by Nicoletta Corrocher, Jeong-Dong Lee, Mireille Matt and Nicholas Vonortas
More articles in Science and Public Policy from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().