Sensitivity analysis of a sequential decision problem with learning

Alfred Müller and Marco Scarsini

Mathematical Methods of Operations Research, 2003, vol. 57, issue 2, 327 pages

Abstract: We consider the optimization problem of a decision maker facing a sequence of coin tosses with an initially unknown probability Θ for heads. Before each toss she bets on either heads or tails and she wins one euro if she guesses correctly, otherwise she loses one euro. We investigate the effect of changes in the distribution of Θ on the expected optimal gain of the decision maker. Using techniques from Bayesian dynamic programming we will show that under the assumption of a beta distribution for the prior a riskier prior implies higher expected gains. The rationale for this is that a riskier prior allows better learning and provides higher informational value to the observations. We will also consider the case of a risk-sensitive decision maker in a two-period model. Copyright Springer-Verlag Berlin Heidelberg 2003

Keywords: Key words: Coin tossing; Bayesian dynamic programming; beta distribution; conjugate prior; risk aversion; stochastic comparison (search for similar items in EconPapers)
Date: 2003
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1007/s001860200248 (text/html)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Sensitivity analysis of a sequential decision problem with learning (2003)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:mathme:v:57:y:2003:i:2:p:321-327

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/00186

DOI: 10.1007/s001860200248

Access Statistics for this article

Mathematical Methods of Operations Research is currently edited by Oliver Stein

More articles in Mathematical Methods of Operations Research from Springer, Gesellschaft für Operations Research (GOR), Nederlands Genootschap voor Besliskunde (NGB)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().