Dissecting models' forecasting performance

Boriss Siliverstovs

Economic Modelling, 2017, vol. 67, issue C, 294-299

Abstract: The fact that the predictive performance of models used in forecasting stock returns, exchange rates, and macroeconomic variables is not stable and varies over time has been widely documented in the forecasting literature. Under these circumstances excessive reliance on forecast evaluation metrics that ignores this instability in forecasting accuracy, like squared errors averaged over the whole forecast evaluation sample, masks important information regarding the temporal evolution of relative forecasting performance of competing models. In this paper we suggest an approach based on the combination of the Cumulated Sum of Squared Forecast Error Differential (CSSFED) of Welch and Goyal (2008) and the Bayesian change point analysis of Barry and Hartigan (1993) that tracks the contribution of forecast errors to the aggregate measures of forecast accuracy observation by observation. In doing so, it allows one to track the evolution of the relative forecasting performance over time. We illustrate the suggested approach by using forecasts of the GDP growth rate in Switzerland.

Keywords: Forecasting; Forecast evaluation; Change point detection; Bayesian estimation (search for similar items in EconPapers)
JEL-codes: C22 C53 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0264999317300743
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Dissecting Models' Forecasting Performance (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecmode:v:67:y:2017:i:c:p:294-299

DOI: 10.1016/j.econmod.2017.01.008

Access Statistics for this article

Economic Modelling is currently edited by S. Hall and P. Pauly

More articles in Economic Modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().