On Using Predictive-ability Tests in the Selection of Time-series Prediction Models: A Monte Carlo Evaluation
Mauro Costantini and
Robert Kunst ()
No 341, Economics Series from Institute for Advanced Studies
Comparative ex-ante prediction experiments over expanding subsamples are a popular tool for the task of selecting the best forecasting model class in finite samples of practical relevance. Flanking such a horse race by predictive-accuracy tests,such as the test by Diebold and Mariano (1995), tends to increase support for the simpler structure. We are concerned with the question whether such simplicity boosting actually benefits predictive accuracy in finite samples. We consider two variants of the DM test, one with naive normal critical values and one with bootstrapped critical values, the predictive-ability test by Giacomini and White (2006), which continues to be valid in nested problems, the F test by Clark and McCracken (2001), and also model selection via the AIC as a benchmark strategy. Our Monte Carlo simulations focus on basic univariate time-series specifications, such as linear (ARMA) and nonlinear (SETAR) generating processes.
Keywords: Forecasting; time series; predictive accuracy; model selection (search for similar items in EconPapers)
JEL-codes: C22 C52 C53 (search for similar items in EconPapers)
Pages: 38 pages
New Economics Papers: this item is included in nep-ecm, nep-ets, nep-for and nep-ore
References: View references in EconPapers View complete reference list from CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
http://www.ihs.ac.at/publications/eco/es-341.pdf First version, 2018 (application/pdf)
Journal Article: On using predictive-ability tests in the selection of time-series prediction models: A Monte Carlo evaluation (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:ihs:ihsesp:341
Ordering information: This working paper can be ordered from
Institute for Advanced Studies - Library, Josefstädterstr. 39, A-1080 Vienna, Austria
Access Statistics for this paper
More papers in Economics Series from Institute for Advanced Studies Josefstädterstr. 39, A-1080 Vienna, Austria. Contact information at EDIRC.
Bibliographic data for series maintained by Doris Szoncsitz ().