On Using Predictive-ability Tests in the Selection of Time-series Prediction Models: A Monte Carlo Evaluation

Mauro Costantini and Robert Kunst ()

No 341, Economics Series from Institute for Advanced Studies

Abstract: Comparative ex-ante prediction experiments over expanding subsamples are a popular tool for the task of selecting the best forecasting model class in finite samples of practical relevance. Flanking such a horse race by predictive-accuracy tests,such as the test by Diebold and Mariano (1995), tends to increase support for the simpler structure. We are concerned with the question whether such simplicity boosting actually benefits predictive accuracy in finite samples. We consider two variants of the DM test, one with naive normal critical values and one with bootstrapped critical values, the predictive-ability test by Giacomini and White (2006), which continues to be valid in nested problems, the F test by Clark and McCracken (2001), and also model selection via the AIC as a benchmark strategy. Our Monte Carlo simulations focus on basic univariate time-series specifications, such as linear (ARMA) and nonlinear (SETAR) generating processes.

Keywords: Forecasting; time series; predictive accuracy; model selection (search for similar items in EconPapers)
JEL-codes: C22 C52 C53 (search for similar items in EconPapers)
Pages: 38 pages
Date: 2018-07
New Economics Papers: this item is included in nep-ecm, nep-ets, nep-for and nep-ore
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://irihs.ihs.ac.at/id/eprint/4712 First version, 2018 (application/pdf)

Related works:
Journal Article: On using predictive-ability tests in the selection of time-series prediction models: A Monte Carlo evaluation (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ihs:ihsesp:341

Ordering information: This working paper can be ordered from
Institute for Advanced Studies - Library, Josefstädterstr. 39, A-1080 Vienna, Austria

Access Statistics for this paper

More papers in Economics Series from Institute for Advanced Studies Josefstädterstr. 39, A-1080 Vienna, Austria. Contact information at EDIRC.
Bibliographic data for series maintained by Doris Szoncsitz ().