On Forecast Evaluation
Wilmer Osvaldo Martínez-Rivera (),
Manuel Dario Hernández-Bejarano () and
Juan Julio ()
BORRADORES DE ECONOMIA from BANCO DE LA REPÚBLICA
We propose to assess the performance of k forecast procedures by exploring the distributions of forecast errors and error losses. We argue that non systematic forecast errors minimize when their distributions are symmetric and unimodal, and that forecast accuracy should be assessed through stochastic loss order rather than expected loss order, which is the way it is customarily performed in previous work. Moreover, since forecast performance evaluation can be understood as a one way analysis of variance, we propose to explore loss distributions under two circumstances; when a strict (but unknown) joint stochastic order exists among the losses of all forecast alternatives, and when such order happens among subsets of alternative procedures. In spite of the fact that loss stochastic order is stronger than loss moment order, our proposals are at least as powerful as competing tests, and are robust to the correlation, autocorrelation and heteroskedasticity settings they consider. In addition, since our proposals do not require samples of the same size, their scope is also wider, and provided that they test the whole loss distribution instead of just loss moments, they can also be used to study forecast distributions as well. We illustrate the usefulness of our proposals by evaluating a set of real world forecasts.
Keywords: Forecast evaluation; Stochastic order; Multiple comparison. (search for similar items in EconPapers)
JEL-codes: C53 C12 C14 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-ecm and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations Track citations by RSS feed
Downloads: (external link)
Working Paper: On Forecast Evaluation (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:col:000094:011604
Access Statistics for this paper
More papers in BORRADORES DE ECONOMIA from BANCO DE LA REPÚBLICA
Series data maintained by Clorith Angélica Bahos Olivera ().