Mixed Methods: Performance of OCR, Fuzzy Search, and LLMs with Image-Based Text
Daniel Moulton,
Larry Santucci and
Robyn Smith
Additional contact information
Robyn Smith: https://www.philadelphiafed.org/our-people/robyn-smith
No 26-54, Working Papers from Federal Reserve Bank of Philadelphia
Abstract:
Over time, humans have created vast archives of unstructured textual data that remain largely inaccessible to contemporary researchers. Advances in optical character recognition (OCR), full-text search, and large language models (LLMs) offer unprecedented opportunities to unlock insights from historical source material by making it technically and economically feasible to analyze these data. We present a framework to consider the various costs and trade-offs of different methods for working with a large corpus of images containing unstructured text. We illustrate this framework and present performance statistics via a case study identifying racial restrictions in 5.1 million images of Philadelphia property deeds from 1910–1965. We find 8,395 deed images containing a racial restriction, which we estimate to cover more than 6% of all parcels in Philadelphia.
Keywords: optical character recognition (OCR); large language models (LLMs); artificial intelligence (AI); machine learning (ML); racially restrictive covenants; deeds; property; real estate; housing; digitization (search for similar items in EconPapers)
JEL-codes: C81 G5 N32 R31 R38 (search for similar items in EconPapers)
Pages: 78
Date: 2026-11-16
References: Add references at CitEc
Citations:
Downloads: (external link)
https://www.philadelphiafed.org/-/media/frbp/asset ... ers/2026/wp26-54.pdf (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:fip:fedpwp:104071
Ordering information: This working paper can be ordered from
DOI: 10.21799/frbp.wp.2026.54
Access Statistics for this paper
More papers in Working Papers from Federal Reserve Bank of Philadelphia Contact information at EDIRC.
Bibliographic data for series maintained by Beth Paul ().