Improved Assessment of the Accuracy of Record Linkage via an Extended MaCSim Approach

Haque Shovanur () and Mengersen Kerrie ()
Additional contact information
Haque Shovanur: School of Mathematical Sciences, Queensland University of Technology, 2 George Street, Brisbane, QLD 4000, Brisbane 4000, Australia.
Mengersen Kerrie: School of Mathematical Sciences, Queensland University of Technology, 2 George Street, Brisbane, QLD 4000, Brisbane 4000, Australia.

Journal of Official Statistics, 2022, vol. 38, issue 2, 429-451

Abstract: Record linkage is the process of bringing together the same entity from overlapping data sources while removing duplicates. Huge amounts of data are now being collected by public or private organizations as well as by researchers and individuals. Linking and analysing relevant information from this massive data reservoir can provide new insights into society. It has become increasingly important to have effective and efficient methods for linking data from different sources. Therefore, it becomes necessary to assess the ability of a linking method to achieve high accuracy or to compare between methods with respect to accuracy. In this article, we improve on a Markov Chain based Monte Carlo simulation approach (MaCSim) for assessing a linking method. The improvement proposed here involves calculation of a similarity weight for every linking variable value for each record pair, which allows partial agreement of the linking variable values. To assess the accuracy of the linking method, correctly linked proportions are investigated for each record. The extended MaCSim approach is illustrated using a synthetic data set provided by the Australian Bureau of Statistics based on realistic data settings. Test results show high accuracy of the assessment of the linkages.

Keywords: Linkage accuracy; Markov Chain Monte Carlo; simulation; similarity weight; agreement threshold; agreement tolerance (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/jos-2022-0021 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:offsta:v:38:y:2022:i:2:p:429-451:n:13

DOI: 10.2478/jos-2022-0021

Access Statistics for this article

Journal of Official Statistics is currently edited by Annica Isaksson and Ingegerd Jansson

More articles in Journal of Official Statistics from Sciendo
Bibliographic data for series maintained by Peter Golla ().