Web-scraping housing prices in real-time: The Covid-19 crisis in the UK

Jean-Charles Bricongne, Baptiste Meunier and Sylvain Pouget

Journal of Housing Economics, 2023, vol. 59, issue PB

Abstract: While official statistics provide lagged and aggregate information on the housing market, extensive information is available publicly on real-estate websites. By web-scraping them for the UK on a daily basis, this paper extracts a large database from which we build timely and highly granular indicators. One originality of the dataset is to focus on the supply side of the housing market, allowing to compute innovative indicators reflecting the sellers' perspective such as the number of new listings posted or how prices fluctuate over time for existing listings. Matching listing prices in our dataset with transacted prices from the notarial database, using machine learning, also measures the negotiation margin of buyers. During the Covid-19 crisis, these indicators demonstrate the freezing of the market and the “wait-and-see” behaviour of sellers. They also show that listing prices after the lockdown experienced a continued decline in London but increased in other regions.

Keywords: Housing; Real time; Big data; Web-scraping; High frequency; United Kingdom (search for similar items in EconPapers)
JEL-codes: E01 R30 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S105113772200078X
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Web-scraping housing prices in real-time: The Covid-19 crisis in the UK (2023)
Working Paper: Web-scraping housing prices in real-time: The Covid-19 crisis in the UK (2023)
Working Paper: Web Scraping Housing Prices in Real-time: the Covid-19 Crisis in the UK (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jhouse:v:59:y:2023:i:pb:s105113772200078x

DOI: 10.1016/j.jhe.2022.101906

Access Statistics for this article

Journal of Housing Economics is currently edited by H. O. Pollakowski

More articles in Journal of Housing Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().