Deconstructing impact: A framework for impact evaluation in grant applications

Evidencing Impact from Art Research: Analysis of Impact Case Studies from the REF 2014

Lai Ma and Rachael Agnew

Science and Public Policy, 2022, vol. 49, issue 2, 289-301

Abstract: Impact assessments in grant applications can be biased, random, or inconsistent. One reason is that there is not a framework to assist the review process. To develop fair and transparent evaluative criteria, it is necessary to understand what kinds of outcome and impact can reasonably be achieved and expected. Using content analysis, 100 UK Research Excellence Framework (REF) 2014 impact case studies were analysed based on the definition of the output, outcome, and impact in the logic model. The analysis shows that (1) outcomes and medium-term impacts, not long-term impacts, are reported in the case studies, (2) impacts can be categorised as use and experience based, and (3) there is a need to recognise the creation and co-creation of impacts. A framework for impact evaluation in grant applications has been developed. In this framework, the criteria for evaluating impact statements focus on process-oriented impacts and that ‘impacts’ can be outputs, outcomes, and medium-term impacts.

Keywords: ex ante impact assessment; impact evaluation; peer review; societal impact (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/scipol/scab080 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:scippl:v:49:y:2022:i:2:p:289-301.

Access Statistics for this article

Science and Public Policy is currently edited by Nicoletta Corrocher, Jeong-Dong Lee, Mireille Matt and Nicholas Vonortas

More articles in Science and Public Policy from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().