Latent Dirichlet Allocation for Structured Insurance Data

Charlotte Jamotton and Donatien Hainaut
Additional contact information
Charlotte Jamotton: Université catholique de Louvain, LIDAM/ISBA, Belgium
Donatien Hainaut: Université catholique de Louvain, LIDAM/ISBA, Belgium

No 2026019, LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA)

Abstract: This article explores the application of Latent Dirichlet Allocation (LDA) to structured tabular insurance data. LDA is a probabilistic approach initially developed in Natural Language Processing (NLP) to uncover the underlying structure of (unstructured) textual data. It was designed to represent textual documents as a mixture of latent topics, and topics as mixtures of words. This study introduces LDA’s document-topic distribution as a soft clustering tool for unsupervised learning tasks in actuarial science. By defining each topic as a risk profile, each insurance policy as a document, and each modality of categorical covariates as a word, we extend LDA’s application beyond textual data. Our experimental results and analysis highlight how the modelling of policies based on topic cluster membership, and the identification of dominant modalities within each risk profile, can give insights into the prominent risk factors contributing to higher or lower claim frequencies.

Keywords: Latent Dirichlet Allocation; Topic modelling; Soft clustering; Insurance data; Risk profile; Natural language processing (search for similar items in EconPapers)
Pages: 34
Date: 2026-02-23
Note: In: Annals of Data Science, 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://research.dial.uclouvain.be/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aiz:louvar:2026019

DOI: 10.1007/s40745-026-00674-8

Access Statistics for this paper

More papers in LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA) Voie du Roman Pays 20, 1348 Louvain-la-Neuve (Belgium). Contact information at EDIRC.
Bibliographic data for series maintained by Alain Gillis ().