Strategic Experimentation with Exponential Bandits

R Keller, Sven Rady and Martin Cripps

Econometrica, 2005, vol. 73, issue 1, 39-68

Abstract: We analyze a game of strategic experimentation with two-armed bandits whose risky arm might yield payoffs after exponentially distributed random times. Free-riding causes an inefficiently low level of experimentation in any equilibrium where the players use stationary Markovian strategies with beliefs as the state variable. We construct the unique symmetric Markovian equilibrium of the game, followed by various asymmetric ones. There is no equilibrium where all players use simple cut-off strategies. Equilibria where players switch finitely often between experimenting and free-riding all yield a similar pattern of information acquisition, greater efficiency being achieved when the players share the burden of experimentation more equitably. When players switch roles infinitely often, they can acquire an approximately efficient amount of information, but still at an inefficient rate. In terms of aggregate payoffs, all these asymmetric equilibria dominate the symmetric one wherever the latter prescribes simultaneous use of both arms. Copyright The Econometric Society 2005.

Date: 2005
References: Add references at CitEc
Citations: View citations in EconPapers (233)

Downloads: (external link)
http://hdl.handle.net/10.1111/j.1468-0262.2005.00564.x link to full text (text/html)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Strategic Experimentation with Exponential Bandits (2003)
Working Paper: Strategic Experimentation with Exponential Bandits (2003)
Working Paper: Strategic Experimentation with Exponential Bandits (2003)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ecm:emetrp:v:73:y:2005:i:1:p:39-68

Ordering information: This journal article can be ordered from
https://www.economet ... ordering-back-issues
econometrica@econometricsociety.org

Access Statistics for this article

Econometrica is currently edited by Guido Imbens

More articles in Econometrica from Econometric Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery (contentdelivery@wiley.com).