Text vs. citations: A comparative analysis of breakthrough and disruption metrics in patent innovation

Alex J. Yang

Research Policy, 2025, vol. 54, issue 8

Abstract: This study examines two dynamic metrics for assessing technological innovation— the text-based breakthrough index (KI index) and the citation-based disruption index (CD index)—both of which integrate ex-ante (novelty) and ex-post (impact) information. The KI index identifies breakthrough inventions by measuring their novelty (low similarity to prior patents) and impact (high similarity to future patents), whereas the CD index quantifies technological disruption by analyzing shifts in citation patterns. Using a dataset of over six million patents filed with the USPTO between 1980 and 2017, this paper finds that KI and CD indices are highly correlated and both effectively capture technological breakthroughs. Patents with high KI or CD scores typically originate from original and narrowly focused knowledge bases. However, the two indices exhibit distinct patterns: (1) the KI index fluctuates with economic cycles, while the CD index has experienced a steady decline over time; (2) the KI index positively correlates with future patent citation impact, whereas the CD index follows a U-shaped relationship with patent citation impact; and (3) small and remote teams produce higher KI but lower CD scores, potentially because larger teams cite newer, widely recognized references. I discuss innovation concepts—breakthroughs, disruptions, and beyond—to contextualize these findings and explore their implications for understanding technological advancement. These results contribute to the discourse on measuring innovation and underscore the complementary strengths of text-based and citation-based approaches in assessing technological progress.

Keywords: Patent; Breakthrough; Disruption; Team; Natural language processing (search for similar items in EconPapers)
JEL-codes: I23 O31 O33 O38 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0048733325001246
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:respol:v:54:y:2025:i:8:s0048733325001246

DOI: 10.1016/j.respol.2025.105295

Access Statistics for this article

Research Policy is currently edited by Anna Bergek, PhD, Alex Coad, PhD, Maryann Feldman, Elisa Giuliani, Adam B. Jaffe, Martin Kenney, Keun Lee, PhD, Ben Martin, MA, MSc, Kazuyuki Motohashi, Paul Nightingale, Ammon Salter, Maria Savona, Reinhilde Veugelers and John Walsh

More articles in Research Policy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().