A leavable bounded-velocity stochastic control problem

Ioannis Karatzas and Daniel Ocone

Stochastic Processes and their Applications, 2002, vol. 99, issue 1, 31-51

Abstract: This paper studies bounded-velocity control of a Brownian motion when discretionary stopping, or 'leaving', is allowed. The goal is to choose a control law and a stopping time in order to minimize the expected sum of a running and a termination cost, when both costs increase as a function of distance from the origin. There are two versions of this problem: the fully observed case, in which the control multiplies a known gain, and the partially observed case, in which the gain is random and unknown. Without the extra feature of stopping, the fully observed problem originates with Benes (Stochastic Process. Appl. 2 (1974) 127-140), who showed that the optimal control takes the 'bang-bang' form of pushing with maximum velocity toward the origin. We show here that this same control is optimal in the case of discretionary stopping; in the case of power-law costs, we solve the variational equation for the value function and explicitly determine the optimal stopping policy. We also discuss qualitative features of the solution for more general cost structures. When no discretionary stopping is allowed, the partially observed case has been solved by Benes et al. (Stochastics Monographs, Vol. 5, Gordon & Breach, New York and London, pp. 121-156) and Karatzas and Ocone (Stochastic Anal. Appl. 11 (1993) 569-605). When stopping is allowed, we obtain lower bounds on the optimal stopping region using stopping regions of related, fully observed problems.

Keywords: Stochastic; control; Optimal; stopping; Partial; observations; Control; with; discretionary; stopping (search for similar items in EconPapers)
Date: 2002
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304-4149(01)00157-0
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:99:y:2002:i:1:p:31-51

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().