Forecast evaluation with factor-augmented models

Jack Fosten

No 2016-05, University of East Anglia School of Economics Working Paper Series from School of Economics, University of East Anglia, Norwich, UK.

Abstract: This paper provides an extension of Diebold-Mariano-West (DMW) forecast accuracy tests to allow for factor-augmented models to be compared with non-nested benchmarks. The out-of- sample approach to forecast evaluation requires that both the factors and the forecasting model parameters are estimated in a rolling fashion, which poses several new challenges which we address in this paper. Firstly, we show the convergence rates of factors estimated in different rolling windows, and then give conditions under which the asymptotic distribution of the DMW test statistic is not affected by factor estimation error. Secondly, we draw attention to the issue of "sign-changing" across rolling windows of factor estimates and factor-augmented model coefficients, caused by the lack of sign identification when using Principal Components Analysis to estimate the factors. We show that arbitrary sign-changing does not affect the distribution of the DMW test statistic, but it does prohibit the construction of valid bootstrap critical values using existing procedures. We solve this problem by proposing a novel new normalization for rolling factor estimates, which has the effect of matching the sign of factors estimated in different rolling windows. We establish the first-order validity of a simple-to-implement block bootstrap procedure and illustrate its properties using Monte Carlo simulations and an empirical application to forecasting U.S. CPI inflation.

Keywords: boostrap; diffusion index; factor model; predictive ability (search for similar items in EconPapers)
JEL-codes: C12 C22 C38 C53 (search for similar items in EconPapers)
Date: 2016-01-28
New Economics Papers: this item is included in nep-ecm, nep-ets and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://ueaeco.github.io/working-papers/papers/ueaeco/UEA-ECO-16-05.pdf main text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:uea:ueaeco:2016_05

Ordering information: This working paper can be ordered from
Reception, School of Economics, University of East Anglia, Norwich Research Park, Norwich, NR4 7TJ, UK
eco.reception@uea.ac.uk

Access Statistics for this paper

More papers in University of East Anglia School of Economics Working Paper Series from School of Economics, University of East Anglia, Norwich, UK. Contact information at EDIRC.
Bibliographic data for series maintained by Cara Liggins (eco.reception@uea.ac.uk).