Time Series Models for Forecasting: Testing or Combining?

Zhuo Chen and Yang Yuhong ()
Additional contact information
Yang Yuhong: University of Minnesota

Studies in Nonlinear Dynamics & Econometrics, 2007, vol. 11, issue 1, 37

Abstract: In this paper we systematically compare forecasting accuracy of hypothesis testing procedures with that of a model combining algorithm. Testing procedures are commonly used in applications to select a model, based on which forecasts are made. However, besides the well-known difficulty in dealing with multiple tests, the testing approach has a potentially serious drawback: controlling the probability of Type I error at a conventional level (e.g., 0.05) often excessively favors the null, which can be problematic for the purpose of forecasting. In addition, as shown in this paper, testing procedures can be very unstable, which results in high variability in the forecasts.Selecting a candidate forecast by testing and combining forecasts are both useful but for complementary situations. Currently, there seems to be little guidance in the literature on when combining should be preferred to selecting. We propose instability measures that are helpful for a forecaster to gauge the difficulty in selecting a single optimal forecast.Based on empirical evidences and theoretical considerations, we advocate the use of forecast combining when there is considerable instability in model selection by testing procedures. On the other hand, when there is little instability, testing procedures could work well or even better than forecast combining in terms of forecast accuracy.

Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://doi.org/10.2202/1558-3708.1385 (text/html)
For access to full text, subscription to the journal or payment for the individual article is required.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:sndecm:v:11:y:2007:i:1:n:3

Ordering information: This journal article can be ordered from
https://www.degruyter.com/journal/key/snde/html

DOI: 10.2202/1558-3708.1385

Access Statistics for this article

Studies in Nonlinear Dynamics & Econometrics is currently edited by Bruce Mizrach

More articles in Studies in Nonlinear Dynamics & Econometrics from De Gruyter
Bibliographic data for series maintained by Peter Golla ().