Lyapunov Conditions for Differentiability of Markov Chain Expectations

Chang-Han Rhee () and Peter W. Glynn ()
Additional contact information
Chang-Han Rhee: Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208
Peter W. Glynn: Management Science and Engineering, Stanford University, Stanford, California 94305

Mathematics of Operations Research, 2023, vol. 48, issue 4, 2019-2042

Abstract: We consider a family of Markov chains whose transition dynamics are affected by model parameters. Understanding the parametric dependence of (complex) performance measures of such Markov chains is often of significant interest. The derivatives and their continuity of the performance measures w.r.t. the parameters play important roles, for example, in numerical optimization of the performance measures, and quantification of the uncertainties in the performance measures when there are uncertainties in the parameters from the statistical estimation procedures. In this paper, we establish conditions that guarantee the smoothness of various types of intractable performance measures—such as the stationary and random horizon discounted performance measures—of general state space Markov chains and provide probabilistic representations for the derivatives.

Keywords: 60J05; Markov chain; sensitivity analysis; derivative estimation (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/moor.2022.1328 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormoor:v:48:y:2023:i:4:p:2019-2042

Access Statistics for this article

More articles in Mathematics of Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().