MEASURING SOCIETAL IMPACTS OF RESEARCH WITH ALTMETRICS? COMMON PROBLEMS AND MISTAKES

Mike Thelwall

Journal of Economic Surveys, 2021, vol. 35, issue 5, 1302-1314

Abstract: The impact agenda in many countries has led to increased attempts to assess the societal impacts of research. Altmetrics, webometrics, and other alternative indicators have been proposed to support this task, and many journal articles have been written that exploit alternative indicators to investigate societal impacts. Nevertheless, methodological studies of many of these indicators have revealed that extreme care must be taken with gathering, aggregating, and interpreting them. This article gives an overview of current alternative indicators, summarizes empirical research, and reports a series of common problems and mistakes to avoid when using them. The main issues are: selecting indicators to match goals; aggregating them in a way sensitive to field and publication year differences; largely avoiding them in formal evaluations; understanding that they reflect a biased fraction of the activity of interest; and understanding the type of impact reflected rather than interpreting them at face value.

Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
https://doi.org/10.1111/joes.12381

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jecsur:v:35:y:2021:i:5:p:1302-1314

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0950-0804

Access Statistics for this article

More articles in Journal of Economic Surveys from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().