Predective Density and Conditional Confidence Interval Accuracy Tests

Valentina Corradi and Norman Swanson ()

Departmental Working Papers from Rutgers University, Department of Economics

Abstract: This paper outlines testing procedures for assessing the relative out-of-sample predictive accuracy of multiple conditional distribution models. The tests that are discussed are based on either the comparison of entire conditional distributions or the comparison of predictive confidence intervals. We also briefly survey existing related methods in the area of predictive density evaluation, including methods based on the probability integral transform and the Kullback-Leibler Information Criterion. The procedures proposed in this paper are similar in many ways to Andrews' (1997) conditional Kolmogorov test and to White's (2000) reality check. In particular, a predictive density test is outlined that involves comparing square (approximation) errors associated with models I, i=1,...,n, by constructing weighted averages over U of E[( F_{i}(u|Z^{t},theta _{i}^\dagger )-F_{0}(u|Z^{t}, theta _{0})) ^{2}] , where F_{0}(. |. ) and F_{i}(.|.)$ are true and model-i distributions, u belongs to U, and U is a possibly unbounded set on the real line. A conditional confidence interval version of this test is also outlined, and appropriate bootstrap procedures for obtaining critical values when predictions used in the formation of the test statistics are obtained via rolling and recursive estimation schemes are developed. An empirical illustration comparing alternative predictive models for U.S. inflation is given for the predictive confidence interval test.

Keywords: block bootstrap; recursive estimation scheme; reality check; nonlinear causality; parameter estimation error (search for similar items in EconPapers)
JEL-codes: C22 C51 (search for similar items in EconPapers)
Pages: 20 pages
Date: 2004-09-17
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sas.rutgers.edu/virtual/snde/wp/2004-23.pdf (application/pdf)

Related works:
Journal Article: Predictive density and conditional confidence interval accuracy tests (2006)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rut:rutres:200423

Access Statistics for this paper

More papers in Departmental Working Papers from Rutgers University, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by ().