Structured Additive Regression and Tree Boosting

Michael Mayer, Steven Bourassa, Martin Hoesli and Donato Scognamiglio
Additional contact information
Michael Mayer: Schweizerische Mobiliar Versicherungsgesellschaft
Donato Scognamiglio: IAZI AG and University of Bern

No 21-83, Swiss Finance Institute Research Paper Series from Swiss Finance Institute

Abstract: Structured additive regression (STAR) models are a rich class of regression models that include the generalized linear model (GLM) and the generalized additive model (GAM). STAR models can be fitted by Bayesian approaches, component-wise gradient boosting, penalized least-squares, and deep learning. Using feature interaction constraints, we show that such models can be implemented also by the gradient boosting powerhouses XGBoost and LightGBM, thereby benefiting from their excellent predictive capabilities. Furthermore, we show how STAR models can be used for supervised dimension reduction and explain under what circumstances covariate effects of such models can be described in a transparent way. We illustrate the methodology with case studies pertaining to house price modeling, with very encouraging results regarding both interpretability and predictive performance.

Keywords: machine learning; structured additive regression; gradient boosting; interpretability; transparency (search for similar items in EconPapers)
JEL-codes: C13 C21 C45 C51 C52 C55 R31 (search for similar items in EconPapers)
Pages: 36 pages
Date: 2021-09
New Economics Papers: this item is included in nep-big, nep-cmp, nep-ecm and nep-ore
References: Add references at CitEc
Citations:

Downloads: (external link)
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3924412 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:chf:rpseri:rp2183

Access Statistics for this paper

More papers in Swiss Finance Institute Research Paper Series from Swiss Finance Institute Contact information at EDIRC.
Bibliographic data for series maintained by Ridima Mittal ().