Sensitivity to Distance and Baseline Distributions in Forecast Evaluation

Victor Richmond R. Jose (), Robert F. Nau () and Robert L. Winkler ()
Additional contact information
Victor Richmond R. Jose: Fuqua School of Business, Duke University, Durham, North Carolina 27708
Robert F. Nau: Fuqua School of Business, Duke University, Durham, North Carolina 27708
Robert L. Winkler: Fuqua School of Business, Duke University, Durham, North Carolina 27708

Management Science, 2009, vol. 55, issue 4, 582-590

Abstract: Scoring rules can provide incentives for truthful reporting of probabilities and evaluation measures for the probabilities after the events of interest are observed. Often the space of events is ordered and an evaluation relative to some baseline distribution is desired. Scoring rules typically studied in the literature and used in practice do not take account of any ordering of events, and they evaluate probabilities relative to a default baseline distribution. In this paper, we construct rich families of scoring rules that are strictly proper (thereby encouraging truthful reporting), are sensitive to distance (thereby taking into account ordering of events), and incorporate a baseline distribution relative to which the value of a forecast is measured. In particular, we extend the power and pseudospherical families of scoring rules to allow for sensitivity to distance, with or without a specified baseline distribution.

Keywords: forecast verification; ranked categories; scoring rules; sensitivity to distance; baseline distributions (search for similar items in EconPapers)
Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (18)

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.1080.0955 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:55:y:2009:i:4:p:582-590

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().