How Well Do Automated Linking Methods Perform? Lessons from US Historical Data

Martha Bailey, Connor Cole, Morgan Henderson and Catherine Massey

Journal of Economic Literature, 2020, vol. 58, issue 4, 997-1044

Abstract: This paper reviews the literature in historical record linkage in the United States and examines the performance of widely used record-linking algorithms and common variations in their assumptions. We use two high-quality, hand-linked data sets and one synthetic ground truth to examine the direct effects of linking algorithms on data quality. We find that (i) no algorithm (including hand linking) consistently produces representative samples; (ii) 15 to 37 percent of links chosen by widely used algorithms are classified as errors by trained human reviewers; and (iii) false links are systematically related to baseline sample characteristics, showing that some algorithms may introduce systematic measurement error into analyses. A case study shows that the combined effects of (i)–(iii) attenuate estimates of the intergenerational income elasticity by up to 29 percent, and common variations in algorithm assumptions result in greater attenuation. As current practice moves to automate linking and increase link rates, these results highlight the important potential consequences of linking errors on inferences with linked data. We conclude with constructive suggestions for reducing linking errors and directions for future research.

JEL-codes: C45 C81 J62 N31 N32 (search for similar items in EconPapers)
Date: 2020
References: Add references at CitEc
Citations: View citations in EconPapers (42)

Downloads: (external link)
https://www.aeaweb.org/doi/10.1257/jel.20191526 (application/pdf)
https://doi.org/10.3886/E119932V1 (text/html)
https://www.aeaweb.org/doi/10.1257/jel.20191526.appx (application/pdf)
https://www.aeaweb.org/doi/10.1257/jel.20191526.ds (application/zip)
Access to full text is restricted to AEA members and institutional subscribers.

Related works:
Working Paper: How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aea:jeclit:v:58:y:2020:i:4:p:997-1044

Ordering information: This journal article can be ordered from
https://www.aeaweb.org/journals/subscriptions

DOI: 10.1257/jel.20191526

Access Statistics for this article

Journal of Economic Literature is currently edited by Steven Durlauf

More articles in Journal of Economic Literature from American Economic Association Contact information at EDIRC.
Bibliographic data for series maintained by Michael P. Albert ().