EconPapers    
Economics at your fingertips  
 

Theory and applications of proper scoring rules

Alexander Dawid (apd@statslab.cam.ac.uk) and Monica Musio (mmusio@unica.it)

METRON, 2014, vol. 72, issue 2, 169-183

Abstract: A scoring rule $$S(x; q)$$ S ( x ; q ) provides a way of judging the quality of a quoted probability density $$q$$ q for a random variable $$X$$ X in the light of its outcome $$x$$ x . It is called proper if honesty is your best policy, i.e., when you believe $$X$$ X has density $$p$$ p , your expected score is optimised by the choice $$q=p$$ q = p . The most celebrated proper scoring rule is the logarithmic score, $$S(x; q)=-\log {q(x)}$$ S ( x ; q ) = - log q ( x ) : this is the only proper scoring rule that is local, in the sense of depending on the density function $$q$$ q only through its value at the observed value $$x$$ x . It is closely connected with likelihood inference, with communication theory, and with minimum description length model selection. However, every statistical decision problem induces a proper scoring rule, so there is a very wide variety of these. Many of them have additional interesting structure and properties. At a theoretical level, any proper scoring rule can be used as a foundational basis for the theory of subjective probability. At an applied level a proper scoring can be used to compare and improve probability forecasts, and, in a parametric setting, as an alternative tool for inference. In this article we give an overview of some uses of proper scoring rules in statistical inference, including frequentist estimation theory and Bayesian model selection with improper priors. Copyright Sapienza Università di Roma 2014

Keywords: Bayesian model selection; Bregman score; Composite score; Homogeneous score; Hyvärinen score; Log score; Robust estimation; Survival score (search for similar items in EconPapers)
Date: 2014
References: Add references at CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://hdl.handle.net/10.1007/s40300-014-0039-y (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metron:v:72:y:2014:i:2:p:169-183

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/40300

DOI: 10.1007/s40300-014-0039-y

Access Statistics for this article

METRON is currently edited by Marco Alfo'

More articles in METRON from Springer, Sapienza Università di Roma
Bibliographic data for series maintained by Sonal Shukla (sonal.shukla@springer.com) and Springer Nature Abstracting and Indexing (indexing@springernature.com).

 
Page updated 2024-12-29
Handle: RePEc:spr:metron:v:72:y:2014:i:2:p:169-183