The Sequential Design of Bernoulli Experiments Including Switching Costs

Michael Kolonko and Harald Benzing
Additional contact information
Michael Kolonko: Institut für Mathematische Statistik, Universität Karlsruhe, Karlsruhe, West Germany
Harald Benzing: Institut für Mathematische Statistik, Universität Karlsruhe, Karlsruhe, West Germany

Operations Research, 1985, vol. 33, issue 2, 412-426

Abstract: We consider a sequence of N trials, each of which must be performed on one of two given Bernoulli experiments. We assume the success probability of one experiment is known and the other is unknown. Performing two successive trials on different experiments incurs a switching cost. The problem is to choose an experiment for each trial in order to maximize the expected number of successes minus the expected switching costs. We show that an optimal design shares some well-known monotonicity properties, such as the “stopping-rule” and the “stay-on-a-winner” rule. We also show how to use these results to derive a simple algorithm for calculating the optimal design. Since the model contains the one-armed bandit problem as a special case, we also obtain new proofs for known results.

Keywords: 111 structured policies; 113 two-armed bandit; 798 sequential design of Bernoulli experiments (search for similar items in EconPapers)
Date: 1985
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/opre.33.2.412 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:33:y:1985:i:2:p:412-426

Access Statistics for this article

More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().