The Keys to Unlocking Public Payments Data

Charles Rahal

Kyklos, 2018, vol. 71, issue 2, 310-337

Abstract: We mechanize some of the richest yet significantly under†utilized data resources within developed, ‘Open Data' economies. We show how it is possible to scrape, parse, clean and merge tens of thousands of disaggregated public payments datasets in an attempt to bridge the methodological gap between newly available data from the administrative sphere and applications in empirical social science research. We outline techniques to unambiguously link records to various freely available institutional registers. In particular, we offer guidance on overcoming the substantial challenges of heterogeneous provision and administrative recording errors in the absence of Uniform Resource Identifiers, namely in the form of an approximate, domain†specific ‘record†linkage' type matching algorithm. As an illuminating example, we construct a cleaned database of 24,581,192 local government payments subject to the Local Transparency Codes which total £169.87bn in value. We overcome various challenges in a detailed examination of the procurement of services by local government from the voluntary sector: an important contemporary issue due to the rise of the ‘Big Society’ political ideology of the early 21st century. Finally, we motivate future work in this area and discuss potential international applications and practical advancements.

Date: 2018
References: Add references at CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://doi.org/10.1111/kykl.12171

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:kyklos:v:71:y:2018:i:2:p:310-337

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0023-5962

Access Statistics for this article

Kyklos is currently edited by Rene L. Frey

More articles in Kyklos from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().