How to deal with machine learning bias in economic history

Torben S. D. Johansen, Julius Koschnick and Christian Vedel
Additional contact information
Torben S. D. Johansen: University of Southern Denmark
Julius Koschnick: University of Southern Denmark
Christian Vedel: University of Southern Denmark

No 306, Working Papers from European Historical Economics Society (EHES)

Abstract: Machine learning (ML) has rapidly transformed economic history, lowering costs of digitization, data linkage, and imputation, and making information in historical text usable at scale. This paper offers a practical guide to using these tools well. However, ML tools have also created new problems. Prediction errors are often systematically correlated with covariates of interest, so even highly accurate models can distort and sometimes reverse coefficients, and standard validation cannot detect this. Given that ML tools often perform worse for historical data, this problem is especially severe for the field of economic history. We also identify a solution to this problem. We show that recent debiasing methods can correct such bias for a wide class of applications, using a small, randomly sampled set of expert-coded labels while retaining the efficiency of large-scale prediction. We organize the field with a taxonomy of three ML tasks, survey the literature along it, and indicate where debiasing applies and where validation against proxies remains the only recourse. We close with best-practice guidance on digitization, model choice, and reproducibility.

Keywords: Machine learning; Large language models; bias correction; economic history (search for similar items in EconPapers)
JEL-codes: C45 C55 C80 C81 C82 N01 (search for similar items in EconPapers)
Date: 2026-07
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ehes.org/wp/EHES_306.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hes:wpaper:0306

Access Statistics for this paper

More papers in Working Papers from European Historical Economics Society (EHES) Contact information at EDIRC.
Bibliographic data for series maintained by Christian Vedel ().