Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods

Raffaella Giacomini ()

University of California at San Diego, Economics Working Paper Series from Department of Economics, UC San Diego

Abstract: This paper proposes and analyzes tests that can be used to compare the accuracy of alternative conditional density forecasts of a variable. The tests are also valid in the broader context of model selection based on out-of-sample predictive ability. We restrict attention to the case of density forecasts derived from non-nested parametric models, with known or estimated parameters. The evaluation makes use of scoring rules, which are loss functions defined over the density forecast and the realizations of the variable. In particular, we consider the logarithmic scoring rule, which leads to the development of asymptotic and bootstrap 'weighted likelihood ratio' tests. The name comes from the fact that the tests compare weighted averages of the scores over the available sample, as a way to focus attention on different regions of the distribution of the variable. For a uniform weight function, the asymptotic test can be interpreted as an extension of Vuong (1989)' s likelihood ratio test for non-nested hypotheses to time series data and to an out-of-sample testing framework. A Monte Carlo simulation explores the size and power properties of this last test in finite samples. An application using S&P500 daily returns shows how the tests can be used to compare the performance of density forecasts obtained from GARCH models with different distributional assumptions.

Keywords: density forecasting; scoring rules; predictive ability; forecast comparison (search for similar items in EconPapers)
Date: 2002-06-01
References: Add references at CitEc
Citations: View citations in EconPapers (21)

Downloads: (external link)
https://www.escholarship.org/uc/item/59s2g5j5.pdf;origin=repeccitec (application/pdf)

Related works:
Working Paper: Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods (2002)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cdl:ucsdec:qt59s2g5j5

Access Statistics for this paper

More papers in University of California at San Diego, Economics Working Paper Series from Department of Economics, UC San Diego Contact information at EDIRC.
Bibliographic data for series maintained by Lisa Schiff ().