Stochastic Adaptive Dynamics of a Simple Market as a Non-Stationary Multi-Armed Bandit Problem

Yann Braouezec

European Journal of Economic and Social Systems, 2009, vol. 22, issue 1, 19-41

Abstract: We develop a dynamic monopoly pricing model as a non-stationary multi-armed bandit problem. At each time, the monopolist chooses a price in a finite set and each customer decides stochastically but independently to visit or not his store. Each customer is characterized by two parameters, an ability-to-pay and a probability to visit. Our problem is non-stationary for the monopolist because each customer modifies his probability with experience. We define an ex-ante optimal price for our problem and then look at two different ways of learning this optimal price. In the first part, assuming the monopolist knows everything but the ability-topay, we suggest a simple counting rule based on purchase behavior which allows him to obtain enough information to compute the optimal price. In the second part, assuming no particular knowledge, we consider the case in which the monopolist uses an adaptive stochastic algorithm. When learning is easy (difficult), our simulations suggest that the monopolist (does not) choose the optimal price on each sample path.

Keywords: Multi-armed Bandit Problem; Adaptive Learning; Stochastic Market Dynamics; Exploration-exploitation Trade-off; Non-stationarity (search for similar items in EconPapers)
JEL-codes: D42 D83 (search for similar items in EconPapers)
Date: 2009
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://ejess.revuesonline.com/article.jsp?articleId=13879 Full text (text/html)

Related works:
Working Paper: Stochastic Adaptive Dynamics of a Simple Market as a Non-Stationary Multi-Armed Bandit Problem (2009)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ris:ejessy:0060

Access Statistics for this article

European Journal of Economic and Social Systems is currently edited by Bernard Paulré and Stefano Lucarelli

More articles in European Journal of Economic and Social Systems from Lavoisier
Bibliographic data for series maintained by Stefano Lucarelli ( this e-mail address is bad, please contact ).