Hidden Variable Models for Market Basket Data. Statistical Performance and Managerial Implications

Harald Hruschka

No 489, University of Regensburg Working Papers in Business, Economics and Management Information Systems from University of Regensburg, Department of Economics

Abstract: We compare the performance of several hidden variable models, namely binary factor analysis, topic models (latent Dirichlet allocation, correlated topic model), the restricted Boltzmann machine and the deep belief net. We shortly present these models and outline their estimation. Performance is measured by log likelihood values of these models for a holdout data set of market baskets. For each model we estimate and evaluate variants with increasing numbers of hidden variables. Binary factor analysis vastly outperforms topic models. The restricted Boltzmann machine and the deep belief net on the other hand attain a similar performance advantage over binary factor analysis. For each model we interpret the relationships between the most important hidden variables and observed category purchases. To demonstrate managerial implications we compute relative basket size increase due to promoting each category for the better performing models. Recommendations based on the restricted Boltzmann machine and the deep belief net not only have lower uncertainty due to their statistical performance, they also have more managerial appeal than those derived for binary factor analysis. The impressive performances of the restricted Boltzmann machine and the deep belief net suggest to continue research by extending these models, e.g., by including marketing variables as predictors.

Keywords: Marketing; Market Basket Analysis; Factor Analysis; Topic Models; Restricted Boltzmann Machine; Deep Belief Net (search for similar items in EconPapers)
Date: 2016-12-15
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://epub.uni-regensburg.de/34994/1/dbn_baksets_diskp_all.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bay:rdwiwi:34994

Access Statistics for this paper

More papers in University of Regensburg Working Papers in Business, Economics and Management Information Systems from University of Regensburg, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Gernot Deinzer ().