Importance sampling for a Markov modulated queuing network

Ali Devin Sezer

Stochastic Processes and their Applications, 2009, vol. 119, issue 2, 491-517

Abstract: Importance sampling (IS) is a variance reduction method for simulating rare events. A recent paper by Dupuis, Wang and Sezer [Paul Dupuis, Ali Devin Sezer, Hui Wang, Dynamic importance sampling for queueing networks, Annals of Applied Probability 17 (4) (2007) 1306-1346] exploits connections between IS and stochastic games and optimal control problems to show how to design and analyze simple and efficient IS algorithms for various overflow events of tandem Jackson Networks. The present paper carries out a program parallel to the paper by Dupuis et al. for a two node tandem network whose arrival and service rates are modulated by an exogenous finite state Markov process. The overflow event we study is the following: the number of customers in the system reaches n without the system ever becoming empty, given that initially the system is empty.

Keywords: Dynamic; importance; sampling; Rare; event; simulation; Tandem; queues; Queuing; networks; Markov; modulated; Regime; switch; Overflow; probability; Large; deviations; Isaacs; equation; Optimal; control (search for similar items in EconPapers)
Date: 2009
References: View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304-4149(08)00037-9
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:119:y:2009:i:2:p:491-517

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().