Decision Processes with Monotone Hysteretic Policies

Sabine K. Hipp and Ulrich D. Holzbaur
Additional contact information
Sabine K. Hipp: AEG, Ulm, West Germany
Ulrich D. Holzbaur: AEG, Ulm, West Germany

Operations Research, 1988, vol. 36, issue 4, 585-588

Abstract: Queueing models play an important role in the optimization of dynamic processes, especially in serving problems. For example, dynamic processor or storage allocation for computers, working intensity in a shop or in a service industry, and staff policy in the order-dependent industry may be modeled by optimizing the service levels of a queue. The goal is to minimize the cost that occurs from serving and from customers waiting in the queue. Changing the service levels creates switching costs, e.g., for resource reallocation, personnel increase or reduction. When switching costs are considered, the optimal service level depends on the current service level as well as on the number of customers in the queue. Of special interest are the structural properties of the optimal policies because structured policies are easier to determine and to implement. We give conditions for two properties of optimal policies: (1) monotone policies where the service level increases with the number of customers, and (2) hysteretic policies that change the service level only under some switching condition.

Keywords: dynamic programming: Markov decision processes with switching costs; queues; multichannel: monotone hysteretic optimal policies (search for similar items in EconPapers)
Date: 1988
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://dx.doi.org/10.1287/opre.36.4.585 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:36:y:1988:i:4:p:585-588

Access Statistics for this article

More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().