On the Usefulness of the Diebold-Mariano Test in the Selection of Prediction Models

Mauro Costantini and Robert Kunst ()

No 276, Economics Series from Institute for Advanced Studies

Abstract: In evaluating prediction models, many researchers flank comparative ex-ante prediction experiments by significance tests on accuracy improvement, such as the Diebold-Mariano test. We argue that basing the choice of prediction models on such significance tests is problematic, as this practice may favor the null model, usually a simple benchmark. We explore the validity of this argument by extensive Monte Carlo simulations with linear (ARMA) and nonlinear (SETAR) generating processes. For many parameter constellations, we find that utilization of additional significance tests in selecting the forecasting model fails to improve predictive accuracy.

Keywords: Forecsting; time series; predictive accuracy; model selection! (search for similar items in EconPapers)
JEL-codes: C22 C52 C53 (search for similar items in EconPapers)
Pages: 18 pages
Date: 2011-11
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://irihs.ihs.ac.at/id/eprint/2097 First version, 2011 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ihs:ihsesp:276

Ordering information: This working paper can be ordered from
Institute for Advanced Studies - Library, Josefstädterstr. 39, A-1080 Vienna, Austria

Access Statistics for this paper

More papers in Economics Series from Institute for Advanced Studies Josefstädterstr. 39, A-1080 Vienna, Austria. Contact information at EDIRC.
Bibliographic data for series maintained by Doris Szoncsitz ().