The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review

Oleksii Romanko () and Mary O'Mahony

No ESCOE-TR-19, Economic Statistics Centre of Excellence (ESCoE) Technical Reports from Economic Statistics Centre of Excellence (ESCoE)

Abstract: We explore the use of online job postings as an innovative complementary source of labour demand statistics. The paper concentrates on new developments in the area, including the usage and validation of online data sources, trends, biases and caveats of the data generation and data extraction process. We provide detailed explanations of the data cleansing and data preparation process which proves to be useful for anyone working with raw online data sources. We explore the general data pipeline underpinning continuous data mining and data utilization, that could be beneficial for any organization building its own online data analysis process. We provide detailed discussions of the design of the skills extraction process using word2vec model. We discuss the application of the model and explore some of the skills analysis methods and visualizations, such as job titles, salaries, frequent skills histograms, skills correlation scatterplots, graph analysis of skills co-occurrence, UK regional skills analysis. We applied regression analysis, outlining various effects of person competencies on the salary. We conclude that online job postings provide rich and extensive insights into the labour market and can complement the official statistics.

Keywords: labour demand; skills analysis; skills demand; skills extraction; web scraping (search for similar items in EconPapers)
JEL-codes: J23 J24 J31 (search for similar items in EconPapers)
Date: 2022-05
New Economics Papers: this item is included in nep-big and nep-lma
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://escoe-website.s3.amazonaws.com/wp-content/ ... 5/30133155/TR-19.pdf

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nsr:escoet:escoe-tr-19

Access Statistics for this paper

More papers in Economic Statistics Centre of Excellence (ESCoE) Technical Reports from Economic Statistics Centre of Excellence (ESCoE) King's College London Strand London WC2R 2LS. Contact information at EDIRC.
Bibliographic data for series maintained by ESCoE Centre Manager ().