Forecasting Count Data With Varying Dispersion: A Latent‐Variable Approach

Easton Huch, Candace Berrett, Mason Ferlic and Kimberly F. Sellers

Journal of Forecasting, 2026, vol. 45, issue 4, 1985-2000

Abstract: Count data, such as product sales and disease case counts, are common in business forecasting and many areas of science. Although the Poisson distribution is the best known model for such data, its use is severely limited by its assumption that the dispersion is a fixed function of the mean, which rarely holds in real‐world scenarios. This assumption is especially problematic in forecasting because it compromises risk assessment with unreliable estimates of predictive uncertainty. While various alternatives exist, they have significant limitations of their own: They may work only in specific settings (such as overdispersed data), lack interpretability, or require extensive computation, rendering them unusable on data sets of moderate to large size. In this paper, we survey the current landscape of count data modeling in the presence of varying dispersion, develop extensions to previously proposed methods, and introduce a computationally efficient latent‐variable approach based on a discrete log‐normal distribution. The method allows for unconstrained dispersion, ranging from underdispersion to overdispersion (relative to the Poisson model), that may vary as a function of covariates. We develop scalable algorithms for fitting this model, resulting in a 98% reduction in computation time in our simulation relative to a leading competitor: a Conway–Maxwell–Poisson regression model. We compare the methods in simulation and a case study in the area of grocery sales forecasting. In the case study, the discrete log‐normal model outperforms the other methods in terms of squared prediction error. Compared to a negative binomial model, it produces prediction intervals that are 24% narrower on average without a commensurate decrease in coverage. In practice, these improvements would enable more precise risk assessment and resource allocation in business, epidemiology, and other domains.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/for.70119

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:jforec:v:45:y:2026:i:4:p:1985-2000

Access Statistics for this article

Journal of Forecasting is currently edited by Derek W. Bunn

More articles in Journal of Forecasting from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().