Evaluating forecast performance with state dependence

Florens Odendahl, Barbara Rossi () and Tatevik Sekhposyan
Additional contact information
Barbara Rossi: https://www.upf.edu/web/econ/faculty/-/asset_publisher/6aWmmXf28uXT/persona/id/3420583

Economics Working Papers from Department of Economics and Business, Universitat Pompeu Fabra

Abstract: We propose a novel forecast evaluation methodology to assess models' absolute and relative forecasting performance when it is a state-dependent function of economic variables. In our framework, the forecasting performance, measured by a forecast error loss function, is modeled via a hard or smooth threshold model with unknown threshold values. Existing tests either assume a constant out-of-sample forecast performance or use non-parametric techniques robust to time-variation; consequently, they may lack power against state-dependent predictability. Our tests can be applied to relative forecast comparisons, forecast encompassing, forecast efficiency, and, more generally, moment-based tests of forecast evaluation. Monte Carlo results suggest that our proposed tests perform well in finite samples and have better power than existing tests in selecting the best forecast or assessing its efficiency in the presence of state dependence. Our tests uncover "pockets of predictability" in U.S. equity premia; although the term spread is not a useful predictor on average over the sample, it forecasts significantly better than the benchmark forecast when real GDP growth is low. In addition, we find that leading indicators, such as measures of vacancy postings and new orders for durable goods, improve the forecasts of U.S. industrial production when financial conditions are tight.

Keywords: State dependence, forecast evaluation, predictive ability testing, moment-based tests; pockets of predictability (search for similar items in EconPapers)
JEL-codes: C52 C53 E17 G17 (search for similar items in EconPapers)
Date: 2021-07
New Economics Papers: this item is included in nep-ecm, nep-ets, nep-for, nep-isf and nep-mac
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://econ-papers.upf.edu/papers/1800.pdf Whole Paper (application/pdf)

Related works:
Journal Article: Evaluating forecast performance with state dependence (2023)
Working Paper: Evaluating Forecast Performance with State Dependence (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:upf:upfgen:1800

Access Statistics for this paper

More papers in Economics Working Papers from Department of Economics and Business, Universitat Pompeu Fabra
Bibliographic data for series maintained by ( this e-mail address is bad, please contact ).