 Scoring rules and survey density forecastsGianna Boero (gianna.boero@warwick.ac.uk), Jeremy Smith and Kenneth Wallis (k.f.wallis@warwick.ac.uk) International Journal of Forecasting, 2011, vol. 27, issue 2, 379-393 Abstract: This article provides a practical evaluation of some leading density forecast scoring rules in the context of forecast surveys. We analyse the density forecasts of UK inflation obtained from the Bank of England's Survey of External Forecasters, considering both the survey average forecasts published in the Bank's quarterly Inflation Report, and the individual survey responses recently made available to researchers by the Bank. The density forecasts are collected in histogram format, and the ranked probability score (RPS) is shown to have clear advantages over other scoring rules. Missing observations are a feature of forecast surveys, and we introduce an adjustment to the RPS, based on the Yates decomposition, to improve its comparative measurement of forecaster performance in the face of differential non-response. The new measure, denoted RPS*, is recommended to analysts of forecast surveys. Keywords: Density; forecast; evaluation; Brier; (quadratic; probability); score; Epstein; (ranked; probability); score; Logarithmic; score; Bank; of; England; Survey; of; External; Forecasters; Missing; data; Forecast; comparison (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:intfor:v:27:y::i:2:p:379-393 Access Statistics for this article International Journal of Forecasting is currently edited by R. J. Hyndman More articles in International Journal of Forecasting from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to econpapers@oru.se.
EconPapers is hosted by the
School of Business at Örebro University.