Forecast-based model selection in the presence of structural breaks

Todd Clark and Michael McCracken

No RWP 02-05, Research Working Paper from Federal Reserve Bank of Kansas City

Abstract: This paper presents analytical, Monte Carlo, and empirical evidence on the effects of structural breaks on tests for equal forecast accuracy and forecast encompassing. The forecasts are generated from two parametric, linear models that are nested under the null. The alternative hypotheses allow a causal relationship that is subject to breaks during the sample. With this framework, we show that in-sample explanatory power is readily found because the usual F-test will indicate causality if it existed for any portion of the sample. Out-of-sample predictive power can be harder to find because the results of out-of-sample tests are highly dependent on the timing of the predictive ability. Moreover, out-of-sample predictive power is harder to find with some tests than with others: the power of F-type tests of equal forecast accuracy and encompassing often dominates that of the more commonly-used t-type alternatives. Overall, out-of-sample tests are effective at revealing whether one variable has predictive power for another at the end of the sample. Based on these results and additional evidence from two empirical applications, we conclude that structural breaks can explain why researchers often find evidence of in-sample, but not out-of-sample, predictive content.

Keywords: Forecasting (search for similar items in EconPapers)
Date: 2002
New Economics Papers: this item is included in nep-ecm and nep-ets
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
https://www.kansascityfed.org/documents/5402/pdf-RWP02-05.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedkrw:rwp02-05

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Research Working Paper from Federal Reserve Bank of Kansas City Contact information at EDIRC.
Bibliographic data for series maintained by Zach Kastens ().