On the stability of global forecasting models
Marco Zanotti
No 553, Working Papers from University of Milano-Bicocca, Department of Economics
Abstract:
Forecast stability, that is the consistency of predictions over time, is essential in business settings where sudden shifts in forecasts can disrupt planning and erode trust in predictive systems. Despite its importance, stability is often overlooked in favor of accuracy, particularly in global forecasting models. In this study, we evaluate the stability of point and probabilistic forecasts across different retraining frequencies and ensemble strategies using two large retail datasets (M5 and VN1). To do this, we introduce a new metric for probabilistic stability (MQC) and analyze ten different global models and four ensemble configurations. The results show that less frequent retraining not only preserves but often improves forecast stability, while ensembles, especially those combining diverse pool of models, further enhance consistency without sacrificing accuracy. These findings challenge the need for continuous retraining and highlight ensemble diversity as a key factor in reducing forecast stability. The study promotes a shift toward stability-aware forecasting practices, offering practical guidelines for building more robust and sustainable prediction systems.
Keywords: Time series; Demand forecasting; Forecasting competitions; Cross-learning; Global models; Forecast stability; Vertical stability; Machine learning; Deep learning; Conformal predictions. (search for similar items in EconPapers)
JEL-codes: C52 C53 C55 (search for similar items in EconPapers)
Pages: 38
Date: 2025-06
New Economics Papers: this item is included in nep-ets and nep-inv
References: Add references at CitEc
Citations:
Downloads: (external link)
http://repec.dems.unimib.it/repec/pdf/mibwpaper553.pdf (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:mib:wpaper:553
Access Statistics for this paper
More papers in Working Papers from University of Milano-Bicocca, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Matteo Pelagatti ().