On the Comparison of Interval Forecasts
Ross Askanazi (),
Francis Diebold (),
Frank Schorfheide () and
Additional contact information
Ross Askanazi: Cornerstone Research
Francis Diebold: Department of Economics, University of Pennsylvania
Minchul Shin: Department of Economics, University of Illinois
PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania
We explore interval forecast comparison when the nominal conï¬ dence level is speciï¬ ed, but the quantiles on which intervals are based are not speciï¬ ed. It turns out that the problem is diï¬ƒcult, and perhaps unsolvable. We ï¬ rst consider a situation where intervals meet the Christoï¬€ersen conditions (in particular, where they are correctly calibrated), in which case the common prescription, which we rationalize and explore, is to prefer the interval of shortest length. We then allow for mis-calibrated intervals, in which case there is a calibration-length tradeoï¬€. We propose two natural conditions that interval forecast loss functions should meet in such environments, and we show that a variety of popular approaches to interval forecast comparison fail them. Our negative results strengthen the case for abandoning interval forecasts in favor of density forecasts: Density forecasts not only provide richer information, but also can be readily compared using known proper scoring rules like the log predictive score, whereas interval forecasts cannot.
Keywords: Forecast accuracy; forecast evaluation; prediction (search for similar items in EconPapers)
JEL-codes: C53 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-ecm and nep-for
Date: 2018-08-02, Revised 2018-08-02
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1) Track citations by RSS feed
Downloads: (external link)
https://economics.sas.upenn.edu/system/files/worki ... per%20Submission.pdf (application/pdf)
Journal Article: On the Comparison of Interval Forecasts (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:pen:papers:18-013
Access Statistics for this paper
More papers in PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania 133 South 36th Street, Philadelphia, PA 19104. Contact information at EDIRC.
Bibliographic data for series maintained by Administrator ().