Interpretable machine learning for demand modeling with high-dimensional data using Gradient Boosting Machines and Shapley values

Evgeny A. Antipov () and Elena B. Pokryshevskaya
Additional contact information
Evgeny A. Antipov: National Research University Higher School of Economics
Elena B. Pokryshevskaya: National Research University Higher School of Economics

Journal of Revenue and Pricing Management, 2020, vol. 19, issue 5, No 8, 355-364

Abstract: Abstract Forecasting demand and understanding sales drivers are one of the most important tasks in retail analytics. However, traditionally, linear models and/or models with a small number of predictors have been predominantly used in sales modeling. Taking into account that real-world demand is naturally determined by complex substitution and complementation patterns among a large number of interrelated SKUs, nonlinear effects of prices, promotions, seasonality, as well as many other factors, their lagged values, and interactions, a realistic model has to be able to account for all that. We propose a conceptual model for sales modeling based on standard POS data available to any retailer and generate almost 500 potentially useful predictors of a focal SKU’s sales accordingly. In our comparison of three classes of models, Gradient Boosting Machines outperformed Random Forests and Elastic nets. By using interpretable machine learning methods, we came up with actionable insights related to the importance of various groups of predictors from the conceptual model, as well as demonstrated how helpful it can be for marketing managers to decompose predictions into the effects of individual regressors by using an approximation of Shapley values for feature attribution.

Keywords: Sales forecasting; Shapley value; Interpretable machine learning; Random forest; Gradient Boosting Machines; Elastic net (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://link.springer.com/10.1057/s41272-020-00236-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pal:jorapm:v:19:y:2020:i:5:d:10.1057_s41272-020-00236-4

Ordering information: This journal article can be ordered from
https://www.palgrave.com/gp/journal/41272

DOI: 10.1057/s41272-020-00236-4

Access Statistics for this article

Journal of Revenue and Pricing Management is currently edited by Ian Yeoman

More articles in Journal of Revenue and Pricing Management from Palgrave Macmillan
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().