Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data

Boriss Siliverstovs and Daniel Wochner
Additional contact information
Daniel Wochner: ETH Zurich

No 2020/02, Working Papers from Latvijas Banka

Abstract: This paper re-examines the findings of Stock and Watson (2012b) who assessed the predictive performance of DFMs over AR benchmarks for hundreds of target variables by focusing on possible business cycle performance asymmetries in the spirit of Chauvet and Potter (2013) and Siliverstovs (2017a; 2017b; 2020). Our forecasting experiment is based on a novel big macroeconomic dataset (FRED-QD) comprising over 200 quarterly indicators for almost 60 years (1960–2018; see, e.g. McCracken and Ng (2019b)). Our results are consistent with this nascent state-dependent evaluation literature and generalize their relevance to a large number of indicators. We document systematic model performance differences across business cycles (longitudinal) as well as variable groups (cross-sectional). While the absolute size of prediction errors tend to be larger in busts than in booms for both DFMs and ARs, DFMs relative improvement over ARs is typically large and statistically significant during recessions but not during expansions (see, e.g. Chauvet and Potter (2013)). Our findings further suggest that the widespread practice of relying on full sample forecast evaluation metrics may not be ideal, i.e. for at least two thirds of all 216 macroeconomic indicators full sample rRMSFEs systematically over-estimate performance in expansionary subsamples and under-estimate it in recessionary subsamples (see, e.g. Siliverstovs (2017a; 2020)). These findings are robust to several alternative specifications and have high practical relevance for both consumers and producers of model-based economic forecasts.

Keywords: forecast evaluation; dynamic factor models; business cycle asymmetries; big macroeconomic datasets; US (search for similar items in EconPapers)
JEL-codes: C32 C45 C52 E17 (search for similar items in EconPapers)
Date: 2020-02-11
New Economics Papers: this item is included in nep-big, nep-for and nep-mac
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://datnes.latvijasbanka.lv/papers/wp_2_2020_en.pdf (application/pdf)

Related works:
Working Paper: Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data (2019)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ltv:wpaper:202002

Access Statistics for this paper

More papers in Working Papers from Latvijas Banka Contact information at EDIRC.
Bibliographic data for series maintained by Konstantins Benkovskis ().