AI-Driven Innovation Measurement: Testing the limits of Large Language Models and Knowledge Graphs for Scaling the Mapping of Business Innovations

Mari Rytky (), Arash Hajikhani (), Carolyn Cole () and Matthias Deschryvere ()
Additional contact information
Mari Rytky: VTT Technical Research Center of Finland
Arash Hajikhani: VTT Technical Research Center of Finland
Carolyn Cole: VTT Technical Research Center of Finland
Matthias Deschryvere: VTT Technical Research Center of Finland

A chapter in Technology Management for Intelligent, Open and Responsible Organizations and Ecosystems, 2026, pp 301-305 from Springer

Abstract: Abstract This work investigates the use of Large Language Models (LLMs) to identify innovations from web-scraped content, focusing on AI adaptation in Finland. The primary aim is to explore how advanced AI methods can support innovation measurement through unstructured data analysis. To achieve this, the study uses GPT-4o, a long context LLM, to extract relevant artifacts from web content, with a focus on entity identification and relationship extraction to generate knowledge graph (KG) structures. This research aims to understand how the combination of LLMs and KGs can provide a more comprehensive view of innovation landscapes. Preliminary findings indicate that LLMs effectively capture complex innovation-related information that traditional methods may overlook. However, LLM bias toward over-identifying artifacts poses challenges, which are addressed through additional filtration steps using LLM-as-a-judge evaluations and expert review. The results underscore the potential of LLMs to enhance innovation detection and measurement at scale, while also highlighting the need for human oversight in the process. This study contributes to the growing field of LLM integration in research processes, offering insights into how such data may be evaluated and adopted for use by innovation policymakers and strategic managers.

Keywords: Innovation measurement; Large language models (LLMs); Innovation detection; Web-scraped content; Knowledge graphs (KGs); Scalable innovation analysis (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prbchp:978-3-032-23282-3_36

Ordering information: This item can be ordered from
http://www.springer.com/9783032232823

DOI: 10.1007/978-3-032-23282-3_36

Access Statistics for this chapter

More chapters in Springer Proceedings in Business and Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().