Minimising the expected commute time

Saul Jacka and Ma. Elena Hernández-Hernández

Stochastic Processes and their Applications, 2022, vol. 150, issue C, 729-751

Abstract: Motivated in part by a problem in simulated tempering (a form of Markov chain Monte Carlo) we seek to minimise, in a suitable sense, the time it takes a (regular) diffusion with instantaneous reflection at 0 and 1 to travel from the origin to 1 and then return (the so-called commute time from 0 to 1). We consider the static and dynamic versions of this problem where the control mechanism is related to the diffusion’s drift via the corresponding scale function. In the static version the diffusion’s drift can be chosen at each point in [0,1], whereas in the dynamic version we are only able to choose the drift at each point at the time of first visiting that point. The dynamic version leads to a novel type of stochastic control problem.

Keywords: Commute-time; Diffusion; Birth and death process; MCMC; Stochastic control; Simulated tempering (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304414918307464
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:150:y:2022:i:c:p:729-751

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.spa.2019.04.010

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().