Forecast Combination and Bayesian Model Averaging - A Prior Sensitivity Analysis

Martin Feldkircher ()

No 2010-14, Working Papers in Economics and Finance from University of Salzburg

Abstract: In this study the forecast performance of model averaged forecasts is compared to that of alternative single models. Following Eklund and Karlsson (2007) we form posterior model probabilities - the weights for the combined forecast - based on the predictive likelihood. Extending the work of Fernández et al. (2001a) we carry out a prior sensitivity analysis for a key parameter in Bayesian model averaging (BMA): Zellner's g. The main results based on a simulation study are fourfold: First the predictive likelihood does always better than the traditionally employed 'marginal' likelihood in settings where the true model is not part of the model space. Secondly, and more striking, forecast accuracy as measured by the root mean square error (rmse) is maximized for the median probability model put forward by Barbieri and Berger (2003). On the other hand, model averaging excels in predicting direction of changes, a finding that is in line with Crespo Cuaresma (2007). Lastly, our recommendation concerning the prior on g is to choose the prior proposed by Laud and Ibrahim (1995) with a hold-out sample size of 25% to minimize the rmse (median model) and 75% to optimize direction of change forecasts (model averaging). We finally forecast the monthly industrial production output of six Central Eastern and South Eastern European (CESEE) economies for a one step ahead forecasting horizon. Following the aforementioned forecasting recommendations improves the out-of-sample statistics over a 30-period horizon beating for almost all countries the first order autoregressive benchmark model.

Keywords: Forecast Combination; Bayesian Model Averaging; Median Probability Model; Predictive Likelihood; Industrial Production; Model Uncertainty (search for similar items in EconPapers)
JEL-codes: C11 C15 C53 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-cba, nep-ecm, nep-ets and nep-for
Date: 2010-09-15
References: View references in EconPapers View complete reference list from CitEc
Citations Track citations by RSS feed

Downloads: (external link)
http://www.uni-salzburg.at/pls/portal/docs/1/1515354.PDF Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:ris:sbgwpe:2010_014

Access Statistics for this paper

More papers in Working Papers in Economics and Finance from University of Salzburg
Contact information at EDIRC.
Series data maintained by Harald Oberhofer ().