Strategic Experimentation with Congestion

Caroline Thomas ()

No 130907, Department of Economics Working Papers from The University of Texas at Austin, Department of Economics

Abstract: We consider a game of strategic experimentation in the presence of competition between two agents. Each agent faces a two-armed bandit problem in which she continually chooses between her private, risky arm and a common, safe arm. An agent has exclusive access to her private arm. However, only one of the agents can activate the common arm at any point in time, imposing a negative payoff externality on her opponent. The quality of the risky arms is independent across agents. We show that an agent attaches a strategic option value to being able to return to her private arm after having used the common arm. As a result, the common arm is more attractive than in the absence of competition. By occupying it an agent increases the likelihood of ending the payoff externality imposed by her opponent. We analyse the interesting and counter-intuitive behaviour that ensues in the unique Markov perfect equilibrium of this game. The first agent to occupy the common arm is the one who is more optimistic about her private arm. She does so in a state where even a myopic single decision-maker would prefer her private arm. She eventually returns to her private arm, even if this means forgoing her access to the common arm forever. We show that the common arm also carries a strategic option value when it is risky.

Keywords: Strategic Experimentation; Multi-Armed Bandit; Bayesian Learning; Poisson Process; Congestion; Payoff Externalities (search for similar items in EconPapers)
JEL-codes: C72 C73 D83 (search for similar items in EconPapers)
Date: 2010-10, Revised 2014-11-04
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://sites.google.com/site/carotho14/research/congestion_141103.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found

Related works:
Journal Article: Strategic Experimentation with Congestion (2021)
Working Paper: Strategic Experimentation with Congestion (2013)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tex:wpaper:130907

Access Statistics for this paper

More papers in Department of Economics Working Papers from The University of Texas at Austin, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Caroline Thomas ().