Controlled Discrete-Time Semi-Markov Random Evolutions and Their Applications

Anatoliy Swishchuk and Nikolaos Limnios
Additional contact information
Anatoliy Swishchuk: Department of Mathematics and Statistics, Faculty of Science, University of Calgary, Calgary, AB T2N 1N4, Canada
Nikolaos Limnios: Applied Mathematics Lab, Université de Technologie de Compiègne, Sorbonne University Alliance, 60203 Compiègne, France

Mathematics, 2021, vol. 9, issue 2, 1-26

Abstract: In this paper, we introduced controlled discrete-time semi-Markov random evolutions. These processes are random evolutions of discrete-time semi-Markov processes where we consider a control. applied to the values of random evolution. The main results concern time-rescaled weak convergence limit theorems in a Banach space of the above stochastic systems as averaging and diffusion approximation. The applications are given to the controlled additive functionals, controlled geometric Markov renewal processes, and controlled dynamical systems. We provide dynamical principles for discrete-time dynamical systems such as controlled additive functionals and controlled geometric Markov renewal processes. We also produce dynamic programming equations (Hamilton–Jacobi–Bellman equations) for the limiting processes in diffusion approximation such as controlled additive functionals, controlled geometric Markov renewal processes and controlled dynamical systems. As an example, we consider the solution of portfolio optimization problem by Merton for the limiting controlled geometric Markov renewal processes in diffusion approximation scheme. The rates of convergence in the limit theorems are also presented.

Keywords: semi-Markov chain; controlled discrete-time semi-Markov random evolutions; averaging; diffusion approximation; diffusion approximation with equilibrium; rates of convergence; controlled additive functional; controlled dynamical systems; controlled geometric Markov renewal processes; HJB equation; Merton problem; Banach space (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/9/2/158/pdf (application/pdf)
https://www.mdpi.com/2227-7390/9/2/158/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:9:y:2021:i:2:p:158-:d:479781

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().