A Model Validation Procedure

Julia Polak (), Maxwell King and Xibin Zhang ()

No 21/14, Monash Econometrics and Business Statistics Working Papers from Monash University, Department of Econometrics and Business Statistics

Abstract: Statistical models can play a crucial role in decision making. Traditional model validation tests typically make restrictive parametric assumptions about the model under the null and the alternative hypotheses. The majority of these tests examine one type of change at a time. This paper presents a method for determining whether new data continues to support the chosen model. We suggest using simulation and the kernel density estimator instead of assuming a parametric distribution for the data under the hull hypothesis. This leads to a more versatile testing procedure, one that can be applied to test different types of models and look for a variety of different types of divergences from the null hypothesis. Such a flexible testing procedure, in some cases, can also replace a range of tests that each test against particular alternative hypotheses. The procedure’s ability to recognize a change in the underlying model is demonstrated through AR(1) and linear models. We examine the power of our procedure to detect changes in the variance of the error term and the AR coefficient in the AR(1) model. In the linear model, we examine the performance of the procedure when there are changes in the error variance and error distribution, and when an economic cycle is introduced into the model. We find that the procedure has correct empirical size and high power to recognize the changes in the data generating process after 10 to 15 new observations, depending on the type and extent of the change.

Keywords: Chow test; model validation; p-value; multivariate kernel density estimation; structural break (search for similar items in EconPapers)
JEL-codes: C12 C14 C52 C53 (search for similar items in EconPapers)
Date: 2014
New Economics Papers: this item is included in nep-ecm and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://business.monash.edu/econometrics-and-busine ... ions/ebs/wp21-14.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp21-14.pdf [301 Moved Permanently]--> https://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp21-14.pdf [301 Moved Permanently]--> https://www.monash.edu/business/econometrics-and-business-statistics/research/publications/ebs/wp21-14.pdf [301 Moved Permanently]--> https://www.monash.edu/business/econometrics-and-business-statistics-new/research/publications/ebs/wp21-14.pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:msh:ebswps:2014-21

Ordering information: This working paper can be ordered from
http://business.mona ... -business-statistics

Access Statistics for this paper

More papers in Monash Econometrics and Business Statistics Working Papers from Monash University, Department of Econometrics and Business Statistics PO Box 11E, Monash University, Victoria 3800, Australia. Contact information at EDIRC.
Bibliographic data for series maintained by Professor Xibin Zhang ().