CAREER: Transfer Learning for Economic Prediction of Labor Sequence Data

Keyon Vafa, Emil Palikot, Tianyu Du, Ayush Kanodia, Susan Athey and David M. Blei
Additional contact information
Keyon Vafa: Columbia U
Emil Palikot: Stanford U
Tianyu Du: Stanford U
Ayush Kanodia: Stanford U
David M. Blei: Columbia U

Research Papers from Stanford University, Graduate School of Business

Abstract: Labor economists regularly analyze employment data by fitting predictive models to small, carefully constructed longitudinal survey datasets. Although modern machine learning methods offer promise for such problems, these survey datasets are too small to take advantage of them. In recent years large datasets of online resumes have also become available, providing data about the career trajectories of millions of individuals. However, standard econometric models cannot take advantage of their scale or incorporate them into the analysis of survey data. To this end we develop CAREER, a transformer-based model that uses transfer learning to learn representations of job sequences. CAREER is first fit to large, passively-collected resume data and then fine-tuned to smaller, better-curated datasets for economic inferences. We fit CAREER to a dataset of 24 million job sequences from resumes, and fine-tune its representations on longitudinal survey datasets. We find that CAREER forms accurate predictions of job sequences on three widely-used economics datasets. We further find that CAREER can be used to form good predictions of other downstream variables; incorporating CAREER into a wage model provides better predictions than the econometric models currently in use.

Date: 2022-10
New Economics Papers: this item is included in nep-big
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.gsb.stanford.edu/faculty-research/work ... -labor-sequence-data

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ecl:stabus:4074

Access Statistics for this paper

More papers in Research Papers from Stanford University, Graduate School of Business Contact information at EDIRC.
Bibliographic data for series maintained by ().