Comparing Density Forecsts via Weighted Likelihood Ratio Tests

Gianni Amisano and Raffaella Giacomini ()

Working Papers from University of Brescia, Department of Economics

Abstract: We propose a test for comparing the out-of-sample accuracy of competing density forecasts of a variable. The test is valid under general conditions: the data can be heterogeneous and the forecasts can be based on (nested or non-nested) parametric models or produced by semi- parametric, non-parametric or Bayesian estimation techniques. The evaluation is based on scoring rules, which are loss functions de?ned over the density forecast and the realizations of the variable. We restrict attention to the logarithmic scoring rule and propose an out-of-sample weighted likelihood ratio test that compares weighted averages of the scores for the competing forecasts. The user-defined weights are a way to focus attention on di¤erent regions of the distribution of the variable. For a uniform weight function, the test can be interpreted as an extension of Vuong (1989)'s likelihood ratio test to time series data and to an out-of-sample testing framework. We apply the tests to evaluate density forecasts of US inflation produced by linear and Markov Switching Phillips curve models estimated by either maximum likelihood or Bayesian methods. We conclude that a Markov Switching Phillips curve estimated by maximum likelihood produces the best density forecasts of inflation.

Date: 2005
New Economics Papers: this item is included in nep-ecm, nep-ets and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (15)

Downloads: (external link)
http://www.unibs.it/on-line/dse/Home/Inevidenza/Pa ... o/documento3421.html
Our link check indicates that this URL is bad, the error code is: 403 Forbidden

Related works:
Journal Article: Comparing Density Forecasts via Weighted Likelihood Ratio Tests (2007)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ubs:wpaper:ubs0504

Access Statistics for this paper

More papers in Working Papers from University of Brescia, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Matteo Galizzi ( this e-mail address is bad, please contact ).