Robust Forecast Comparison

Sainan Jin, Valentina Corradi () and Norman Swanson ()
Additional contact information
Valentina Corradi: University of Surrey

Departmental Working Papers from Rutgers University, Department of Economics

Abstract: Forecast accuracy is typically measured in terms of a given loss function. However, as a consequence of the use of misspecified models in multiple model comparisons, relative forecast rankings are loss function dependent. This paper addresses this issue by using a novel criterion for forecast evaluation which is based on the entire distribution of forecast errors. We introduce the concepts of general-loss (GL) forecast superiority and convex-loss (CL) forecast superiority, and we establish a mapping between GL (CL) superiority and first (second) order stochastic dominance. This allows us to develop a forecast evaluation procedure based on an out-of-sample generalization of the tests introduced by Linton, Maasoumi and Whang (2005). The asymptotic null distributions of our test statistics are nonstandard, and resampling procedures are used to obtain the critical values. Additionally, the tests are consistent and have nontrivial local power under a sequence of local alternatives. In addition to the stationary case, we outline theory extending our tests to the case of heterogeneity induced by distributional change over time. Monte Carlo simulations suggest that the tests perform reasonably well in finite samples; and an application to exchange rate data indicates that our tests can help identify superior forecasting models, regardless of loss function.

Keywords: convex loss function; empirical processes; forecast superiority; general loss function (search for similar items in EconPapers)
JEL-codes: C12 C22 (search for similar items in EconPapers)
Pages: 20 pages
Date: 2015-05-13
New Economics Papers: this item is included in nep-ecm, nep-ets, nep-for and nep-sea
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sas.rutgers.edu/virtual/snde/wp/2015-02.pdf (application/pdf)

Related works:
Journal Article: ROBUST FORECAST COMPARISON (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rut:rutres:201502

Access Statistics for this paper

More papers in Departmental Working Papers from Rutgers University, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by ().