Tests of conditional predictive ability

Raffaella Giacomini () and Halbert White

No 572, Boston College Working Papers in Economics from Boston College Department of Economics

Abstract: We argue that the current framework for predictive ability testing (e.g.,West, 1996) is not necessarily useful for real-time forecast selection, i.e., for assessing which of two competing forecasting methods will perform better in the future. We propose an alternative framework for out-of-sample comparison of predictive ability which delivers more practically relevant conclusions. Our approach is based on inference about conditional expectations of forecasts and forecast errors rather than the unconditional expectations that are the focus of the existing literature. We capture important determinants of forecast performance that are neglected in the existing literature by evaluating what we call the forecasting method (the model and the parameter estimation procedure), rather than just the forecasting model. Compared to previous approaches, our tests are valid under more general data assumptions (heterogeneity rather than stationarity) and estimation methods, and they can handle comparison of both nested and non-nested models, which is not currently possible. To illustrate the usefulness of the proposed tests, we compare the forecast performance of three leading parameter-reduction methods for macroeconomic forecasting using a large number of predictors: a sequential model selection approach, the "diffusion indexes" approach of Stock and Watson (2002), and the use of Bayesian shrinkage estimators.

Keywords: forecasting; predictive ability (search for similar items in EconPapers)
JEL-codes: C22 C53 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-ets
Date: 2003-04-01
View list of references View citations in EconPapers

Downloads: (external link)
http://fmwww.bc.edu/EC-P/WP572.pdf main text (application/pdf)

Related works:
Working Paper: Tests of Conditional Predictive Ability (2004)
Working Paper: Tests of Conditional Predictive Ability (2003)
Journal Article: Tests of Conditional Predictive Ability (2006)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:boc:bocoec:572

Access Statistics for this paper

More papers in Boston College Working Papers in Economics from Boston College Department of Economics
Address: Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA
Contact information at EDIRC.
Series data maintained by Christopher F Baum ().