The credibility of research impact statements: A new analysis of REF with Semantic Hypergraphs

Andrea Bonaccorsi, Nicola Melluso, Filippo Chiarello and Gualtiero Fantoni

Science and Public Policy, 2021, vol. 48, issue 2, 212-225

Abstract: When asked to demonstrate the impact of their research, researchers build up statements that have a causal structure. However, as these statements have by nature a historical dimension, their credibility is under question. Historical statements have a genuine causal power only under certain conditions. We derive these conditions from the theory of historical causality and apply them to impact statements in two Medicine and Engineering (STEM) and Social Sciences and Humanities (SSH) areas of Research Excellence Framework. We then process the corpus with a novel text mining methodology called Semantic Hypergraphs. We identify the causal structure of statements and find that it is similar between STEM and SSH, but SSH makes systematically use of a larger number of actors. Making credible statements are more difficult in SSH than in STEM. We derive the policy implications for impact assessment and research policies.

Keywords: impact assessment; research impact; SSH; STEM; REF; semantic hypergraph (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1093/scipol/scab008 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:scippl:v:48:y:2021:i:2:p:212-225.

Access Statistics for this article

Science and Public Policy is currently edited by Nicoletta Corrocher, Jeong-Dong Lee, Mireille Matt and Nicholas Vonortas

More articles in Science and Public Policy from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().