Spline-rule ensemble classifiers with structured sparsity regularization for interpretable customer churn modeling

Koen W. de Bock () and Arno de Caigny ()
Additional contact information
Koen W. de Bock: Audencia Business School
Arno de Caigny: LEM - Lille économie management - UMR 9221 - UA - Université d'Artois - UCL - Université catholique de Lille - Université de Lille - CNRS - Centre National de la Recherche Scientifique

Post-Print from HAL

Abstract: An important business domain that relies heavily on advanced statistical- and machine learning algorithms to support operational decision-making is customer retention management. Customer churn prediction is a crucial tool to support customer retention. It allows an early identification of customers who are at risk to abandon the company and provides the ability to gain insights into why customers are at risk. Hence, customer churn prediction models should complement predictive performance with model insights. Inspired by their ability to reconcile strong predictive performance and interpretability, this study introduces rule ensembles and their extension, spline-rule ensembles, as a promising family of classification algorithms to the customer churn prediction domain. Spline-rule ensembles combine the flexibility of a tree-based ensemble classifier with the simplicity of regression analysis. They do, however, neglect the relatedness between potentially conflicting model components which can introduce unnecessary complexity in the models and compromises model interpretability. To tackle this issue, a novel algorithmic extension, spline-rule ensembles with sparse group lasso regularization (SRE-SGL) is proposed to enhance interpretability through structured regularization. Experiments on fourteen real-world customer churn data sets in different industries (i) demonstrate the superior predictive performance of spline-rule ensembles with sparse group lasso over a set well yet powerful benchmark methods in terms of AUC and top decile lift; (ii) show that spline-rule ensembles with sparse group lasso regularization significantly outperform conventional rule ensembles whilst performing at least as well as conventional spline-rule ensembles; and (iii) illustrate the interpretable nature of a spline-rule ensemble model and the advantage of structured regularization in SRE-SGL by means of a case study on customer churn prediction for a telecommunications company.

Keywords: Customer churn prediction; Predictive analytics; Spline-rule ensemble; Interpretable data science; Sparse group lasso; Regularized regression (search for similar items in EconPapers)
Date: 2021-11
New Economics Papers: this item is included in nep-big, nep-cmp, nep-dem and nep-for
Note: View the original document on HAL open archive server: https://hal.science/hal-03391564
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Published in Decision Support Systems, 2021, 150, pp.113523. ⟨10.1016/j.dss.2021.113523⟩

Downloads: (external link)
https://hal.science/hal-03391564/document (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hal:journl:hal-03391564

DOI: 10.1016/j.dss.2021.113523

Access Statistics for this paper

More papers in Post-Print from HAL
Bibliographic data for series maintained by CCSD ().