Evaluating Density Forecasts: Forecast Combinations, Model Mixtures, Calibration and Sharpness

Dr. James Mitchell ()

No 320, National Institute of Economic and Social Research (NIESR) Discussion Papers from National Institute of Economic and Social Research

Abstract: In a recent article Gneiting, Balabdaoui and Raftery (JRSSB, 2007) propose the criterion of sharpness for the evaluation of predictive distributions or density forecasts. They motivate their proposal by an example in which standard evaluation procedures based on probability integral transforms cannot distinguish between the ideal forecast and several competing forecasts. In this paper we show that their example has some unrealistic features from the perspective of the time-series forecasting literature, hence it is an insecure foundation for their argument that existing calibration procedures are inadequate in practice. We present an alternative, more realistic example in which relevant statistical methods, including information-based methods, provide the required discrimination between competing forecasts. We conclude that there is no need for a subsidiary criterion of sharpness.

Date: 2008-08
References: Add references at CitEc
Citations: View citations in EconPapers (8)

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nsr:niesrd:320

Access Statistics for this paper

More papers in National Institute of Economic and Social Research (NIESR) Discussion Papers from National Institute of Economic and Social Research 2 Dean Trench Street Smith Square London SW1P 3HE. Contact information at EDIRC.
Bibliographic data for series maintained by Library & Information Manager ().