Model selection in time series analysis: using information criteria as an alternative to hypothesis testing

R. Scott Hacker and Abdulnasser Hatemi-J

Journal of Economic Studies, 2021, vol. 49, issue 6, 1055-1075

Abstract: Purpose - The issue of model selection in applied research is of vital importance. Since the true model in such research is not known, which model should be used from among various potential ones is an empirical question. There might exist several competitive models. A typical approach to dealing with this is classic hypothesis testing using an arbitrarily chosen significance level based on the underlying assumption that a true null hypothesis exists. In this paper, the authors investigate how successful the traditional hypothesis testing approach is in determining the correct model for different data generating processes using time series data. An alternative approach based on more formal model selection techniques using an information criterion or cross-validation is also investigated. Design/methodology/approach - Monte Carlo simulation experiments on various generating processes are used to look at the response surfaces resulting from hypothesis testing and response surfaces resulting from model selection based on minimizing an information criterion or the leave-one-out cross-validation prediction error. Findings - The authors find that the minimization of an information criterion can work well for model selection in a time series environment, often performing better than hypothesis-testing strategies. In such an environment, the use of an information criterion can help reduce the number of models for consideration, but the authors recommend the use of other methods also, including hypothesis testing, to determine the appropriateness of a model. Originality/value - This paper provides an alternative approach for selecting the best potential model among many for time series data. It demonstrates how minimizing an information criterion can be useful for model selection in a time-series environment in comparison to some standard hypothesis testing strategies.

Keywords: Time series; Model selection; Information criterion; C22; C32; C52 (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.emerald.com/insight/content/doi/10.110 ... d&utm_campaign=repec (text/html)
https://www.emerald.com/insight/content/doi/10.110 ... d&utm_campaign=repec (application/pdf)
Access to full text is restricted to subscribers

Related works:
Working Paper: Model Selection in Time Series Analysis: Using Information Criteria as an Alternative to Hypothesis Testing (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eme:jespps:jes-09-2020-0469

DOI: 10.1108/JES-09-2020-0469

Access Statistics for this article

Journal of Economic Studies is currently edited by Prof Mohsen Bahmani-Oskooee

More articles in Journal of Economic Studies from Emerald Group Publishing Limited
Bibliographic data for series maintained by Emerald Support ().