A note on the advantage of context in Thompson sampling

Michael Byrd () and Ross Darrow ()
Additional contact information
Michael Byrd: Yum! Brands

Journal of Revenue and Pricing Management, 2021, vol. 20, issue 3, No 8, 316-321

Abstract: Abstract Personalization has become a focal point of modern revenue management. However, it is often the case that minimal data are available to appropriately make suggestions tailored to each customer. This has led to many products making use of reinforcement learning-based algorithms to explore sets of offerings to find the best suggestions to improve conversion and revenue. Arguably the most popular of these algorithms are built on the foundation of the multi-arm bandit framework, which has shown great success across a variety of use cases. A general multi-arm bandit algorithm aims to trade-off adaptively exploring available, but under observed, recommendations, with the current known best offering. While much success has been achieved with these relatively understandable procedures, much of the airline industry is losing out on better personalized offers by ignoring the context of the transaction, as is the case in the traditional multi-arm bandit setup. Here, we explore a popular exploration heuristic, Thompson sampling, and note implementation details for multi-arm and contextual bandit variants. While the contextual bandit requires greater computational and technical complexity to include contextual features in the decision process, we illustrate the value it brings by the improvement in overall expected

Keywords: Bandit algorithms; Online learning; E-commerce (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1057/s41272-021-00314-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pal:jorapm:v:20:y:2021:i:3:d:10.1057_s41272-021-00314-1

Ordering information: This journal article can be ordered from
https://www.palgrave.com/gp/journal/41272

DOI: 10.1057/s41272-021-00314-1

Access Statistics for this article

Journal of Revenue and Pricing Management is currently edited by Ian Yeoman

More articles in Journal of Revenue and Pricing Management from Palgrave Macmillan
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().