Evaluating forecast performance with state dependence

Florens Odendahl, Barbara Rossi and Tatevik Sekhposyan

Journal of Econometrics, 2023, vol. 237, issue 2

Abstract: We propose a novel forecast evaluation methodology to assess models’ absolute and relative forecasting performance when it is a state-dependent function of economic variables. In our framework, the forecasting performance, measured by a forecast error loss function, is modeled via a hard or smooth threshold model with unknown threshold values. Existing tests either assume a constant out-of-sample forecast performance or use non-parametric techniques robust to time-variation; consequently, they may lack power against a state-dependent performance. Our tests can be applied to relative forecast comparisons, forecast encompassing, forecast efficiency, and, more generally, moment-based tests of forecast evaluation. Monte Carlo results suggest that our proposed tests perform well in finite samples and have better power than existing tests in selecting the best forecast or assessing its efficiency in the presence of state dependence. Our tests uncover “pockets of predictability” in U.S. equity premia; although the term spread is not a useful predictor on average over the sample, it forecasts significantly better than the benchmark forecast when real GDP growth is low. In addition, we find that leading indicators, such as measures of vacancy postings and new orders for durable goods, improve the forecasts of U.S. industrial production when financial conditions are tight.

Keywords: State dependence; Forecast evaluation; Predictive ability testing; Moment-based tests; Pockets of predictability (search for similar items in EconPapers)
JEL-codes: C52 C53 E17 G17 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304407621002657
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Evaluating Forecast Performance with State Dependence (2021)
Working Paper: Evaluating forecast performance with state dependence (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:econom:v:237:y:2023:i:2:s0304407621002657

DOI: 10.1016/j.jeconom.2021.07.015

Access Statistics for this article

Journal of Econometrics is currently edited by T. Amemiya, A. R. Gallant, J. F. Geweke, C. Hsiao and P. M. Robinson

More articles in Journal of Econometrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().