Sparse regression with Multi-type Regularized Feature modeling

Sander Devriendt, Katrien Antonio, Tom Reynkens and Roel Verbelen

Insurance: Mathematics and Economics, 2021, vol. 96, issue C, 248-261

Abstract: Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such as Lasso regression for (continuous) predictors treated as linear effects. However, many predictive problems involve different types of predictors and require a tailored regularization term. We propose a multi-type Lasso penalty that acts on the objective function as a sum of subpenalties, one for each type of predictor. As such, we allow for predictor selection and level fusion within a predictor in a data-driven way, simultaneous with the parameter estimation process. We develop a new estimation strategy for convex predictive models with this multi-type penalty. Using the theory of proximal operators, our estimation procedure is computationally efficient, partitioning the overall optimization problem into easier to solve subproblems, specific for each predictor type and its associated penalty. Earlier research applies approximations to non-differentiable penalties to solve the optimization problem. The proposed SMuRF algorithm removes the need for approximations and achieves a higher accuracy and computational efficiency. This is demonstrated with an extensive simulation study and the analysis of a case-study on insurance pricing analytics.

Keywords: Sparsity; Generalized linear model; Predictor selection; Level fusion; Lasso; Modeling; Insurance pricing (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167668720301608
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:insuma:v:96:y:2021:i:c:p:248-261

DOI: 10.1016/j.insmatheco.2020.11.010

Access Statistics for this article

Insurance: Mathematics and Economics is currently edited by R. Kaas, Hansjoerg Albrecher, M. J. Goovaerts and E. S. W. Shiu

More articles in Insurance: Mathematics and Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().