Comparing Density Forecsts via Weighted Likelihood Ratio Tests

Gianni Amisano and Raffaella Giacomini ()

Working Papers from University of Brescia, Department of Economics

Abstract: We propose a test for comparing the out-of-sample accuracy of competing density forecasts of a variable. The test is valid under general conditions: the data can be heterogeneous and the forecasts can be based on (nested or non-nested) parametric models or produced by semi- parametric, non-parametric or Bayesian estimation techniques. The evaluation is based on scoring rules, which are loss functions de?ned over the density forecast and the realizations of the variable. We restrict attention to the logarithmic scoring rule and propose an out-of-sample weighted likelihood ratio test that compares weighted averages of the scores for the competing forecasts. The user-defined weights are a way to focus attention on di¤erent regions of the distribution of the variable. For a uniform weight function, the test can be interpreted as an extension of Vuong (1989)'s likelihood ratio test to time series data and to an out-of-sample testing framework. We apply the tests to evaluate density forecasts of US inflation produced by linear and Markov Switching Phillips curve models estimated by either maximum likelihood or Bayesian methods. We conclude that a Markov Switching Phillips curve estimated by maximum likelihood produces the best density forecasts of inflation.

New Economics Papers: this item is included in nep-ecm, nep-ets and nep-for
Date: Written 2005
View list of references View citations in EconPapers

Downloads: (external link)
http://www.unibs.it/on-line/dse/Home/Inevidenza/Pa ... o/documento3421.html

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Access Statistics for this paper

More papers in Working Papers from University of Brescia, Department of Economics
Contact information at EDIRC.
Series data maintained by Matteo Galizzi ().