Admission Control Policies in a Finite Capacity Geo/Geo/1 Queue Under Partial State Observations

Apostolos Burnetas () and Christos Kokaliaris ()
Additional contact information
Apostolos Burnetas: University of Athens
Christos Kokaliaris: University of Athens

A chapter in Applications of Mathematics and Informatics in Science and Engineering, 2014, pp 59-75 from Springer

Abstract: Abstract We consider the problem of admission control in a discrete time Markovian queue with a finite capacity, a single server, and a geometric arrival and departure processes. We prove the threshold structure of the optimal admission policy under full information on the number of customers in the system. We also consider the admission control problem under partial state information, where the decision maker is only informed whether the system is empty, full, or in some intermediate state. We formulate this problem as a Markov Decision Process with the state representing the posterior distribution of the number of customers and apply a heuristic algorithm from the literature to approximate the optimal policy. In numerical experiments we demonstrate that the pair of the mean and variance of the posterior distribution may be effectively used instead of the full distribution, to implement the optimal policy. We also explore the behavior of the profit function and the value of information with respect to several system parameters.

Keywords: Optimal Policy; Admission Control; Markov Decision Process; Infinite Horizon; Optimality Equation (search for similar items in EconPapers)
Date: 2014
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-3-319-04720-1_4

Ordering information: This item can be ordered from
http://www.springer.com/9783319047201

DOI: 10.1007/978-3-319-04720-1_4

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().