Evaluating Transformation – what can we learn from the literature?

Emily Wise () and Erik Arnold ()
Additional contact information
Emily Wise: CIRCLE, Lund University, Postal: CIRCLE - Centre for Innovation Research, Lund University, PO Box 117, SE-22100 Lund, Sweden

No 2022/10, Papers in Innovation Studies from Lund University, CIRCLE - Centre for Innovation Research

Abstract: The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping a response, one can learn from both theory and practice. This brief (produced within the GReaTr initiative ) aims to provide a synthesis of what recent academic research tells us about evaluating transformation, leveraging a set of 11 seminal articles (and other complementary literature) to answer four questions: For whom and why? What to evaluate? How to evaluate? What unit of analysis? The synthesis points to a relative consensus in the academic literature on the main purposes and uses, the recommended principles and approaches, as well as possibilities for delineating and dealing with multiple scopes and units of analysis in evaluating transformation – yet highlights different conceptual framings of system change. The summary provides inputs to planning an evaluative strategy for TIP and highlights the need to consider new questions related to approaches to reporting across funding agencies, and more active roles for funding and policymaking agencies in dialogues about strategic direction and prioritisation of investments.

Keywords: Innovation policy; Evaluation; System evaluation; Transformation; Socio-technical transitions (search for similar items in EconPapers)
JEL-codes: O32 O38 (search for similar items in EconPapers)
Pages: 26 pages
Date: 2022-10-04
New Economics Papers: this item is included in nep-hme, nep-ino and nep-tid
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://wp.circle.lu.se/upload/CIRCLE/workingpapers/202210_wise.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:lucirc:2022_010

Access Statistics for this paper

More papers in Papers in Innovation Studies from Lund University, CIRCLE - Centre for Innovation Research CIRCLE - Centre for Innovation Research, Lund University, PO Box 117, SE-22100 Lund, Sweden. Contact information at EDIRC.
Bibliographic data for series maintained by Torben Schubert ().