The Impact of Sampling Variability on Estimated Combinations of Distributional Forecasts

Ryan Zischke, Gael M. Martin, David T. Frazier and Donald Poskitt
Additional contact information
Ryan Zischke: Department of Econometrics and Business Statistics, Monash University
Gael M. Martin: Department of Econometrics and Business Statistics, Monash University
David T. Frazier: Department of Econometrics and Business Statistics, Monash University

Papers from arXiv.org

Abstract: We investigate the performance and sampling variability of estimated forecast combinations, with particular attention given to the combination of forecast distributions. Unknown parameters in the forecast combination are optimized according to criterion functions based on proper scoring rules, which are chosen to reward the form of forecast accuracy that matters for the problem at hand, and forecast performance is measured using the out-of-sample expectation of said scoring rule. Our results provide novel insights into the behavior of estimated forecast combinations. Firstly, we show that, asymptotically, the sampling variability in the performance of standard forecast combinations is determined solely by estimation of the constituent models, with estimation of the combination weights contributing no sampling variability whatsoever, at first order. Secondly, we show that, if computationally feasible, forecast combinations produced in a single step -- in which the constituent model and combination function parameters are estimated jointly -- have superior predictive accuracy and lower sampling variability than standard forecast combinations -- where constituent model and combination function parameters are estimated in two steps. These theoretical insights are demonstrated numerically, both in simulation settings and in an extensive empirical illustration using a time series of S&P500 returns.

Date: 2022-06
New Economics Papers: this item is included in nep-dem and nep-for
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://arxiv.org/pdf/2206.02376 Latest version (application/pdf)

Related works:
Working Paper: The Impact of Sampling Variability on Estimated Combinations of Distributional Forecasts (2022)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:2206.02376

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators ().