Counting what really counts? Assessing the political impact of science

A. Gaunand (), L. Colinet, P.-B. Joly and M. Matt
Additional contact information
A. Gaunand: INRA, Delegation for Evaluation
L. Colinet: INRA
P.-B. Joly: Université Paris Est
M. Matt: Univ. Grenoble-Alpes, GAEL

The Journal of Technology Transfer, 2022, vol. 47, issue 3, No 5, 699-721

Abstract: Abstract The production of scientific knowledge is expected to benefit society in a variety of ways. However, and despite the many theoretical models available in the literature, there are few practical frameworks for assessing the dimensions of the effect of research on society—including its political impacts. As part of the ASIRPA approach, in this paper we propose an ordinal rating scale to allow assessment of the political impact of research, based on a review of the literature, qualitative evidence of political impact gleaned from a collection of case studies, and an expert panel. The resulting metric uses a 1–5 scale to evaluate the intensity of the political impact of research according to generic criteria associated to each rating level. Routine application of this scale in case study research is increasing, and is allowing robust, simple and consistent self-assessments of the political impacts across cases, to complement qualitative case study descriptions. The methodology used to design the rating scale prompted the panel experts to reveal their evaluation rationales and justify their judgments, increasing the transparency of the assessments. We believe that the benefits of assigning an ordinal measure to the political impact of research outweigh the risks of misuse of an impact number. The advantages include influencing political agenda-setting by showing what really matters, the opportunities it provides for scaling-up analyses of multidimensional impacts and identifying impact-generating mechanisms, and learning about and promoting discussion of the value systems reflected in the assessment.

Keywords: Ex-post evaluation; Political impact of science; Metric; Panel experts; ASIRPA (search for similar items in EconPapers)
JEL-codes: A13 H43 H83 O33 O38 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10961-017-9605-9 Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:jtecht:v:47:y:2022:i:3:d:10.1007_s10961-017-9605-9

Ordering information: This journal article can be ordered from
http://www.springer. ... nt/journal/10961/PS2

DOI: 10.1007/s10961-017-9605-9

Access Statistics for this article

The Journal of Technology Transfer is currently edited by Albert N. Link, Donald S. Siegel, Barry Bozeman and Simon Mosey

More articles in The Journal of Technology Transfer from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().