Stochastic Optimal Control

Suresh Sethi

Chapter 12 in Optimal Control Theory, 2021, pp 345-365 from Springer

Abstract: Abstract When a dynamic system is subject to uncertainty, the state of the system is modeled as a stochastic process. In Sect. 12.1, we consider stochastic optimal control problems when the state equations are stochastic differential equations involving Wiener processes, known as Itô equations. Our goal will be to synthesize optimal feedback controls for such systems in a way that maximizes the expected value of a given objective function. In Sect. 12.2, we treat a stochastic production planning model in which the inventory is subject to uncertain disturbances such as sales returns and spoilage. We aim to obtain an optimal production policy that minimizes the expected total cost of inventories and backlogs over a finite horizon. In Sect. 12.3, we will solve an infinite-horizon optimal stochastic advertising problem with the sales-advertising dynamics is given by the Sethi advertising model explicitly. In Sect. 12.4, we formulate a classical consumption-investment problem. The objective is to find the optimal allocation of investment in risk-free and risky assets and consumption rate over time to maximize the discounted value of the utility of consumption over an infinite horizon. In Sect. 12.5, we will conclude the chapter by mentioning other types of stochastic optimal control problems that arise in practice. There are many exercises at the end of the chapter.

Date: 2021
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sptchp:978-3-030-91745-6_12

Ordering information: This item can be ordered from
http://www.springer.com/9783030917456

DOI: 10.1007/978-3-030-91745-6_12

Access Statistics for this chapter

More chapters in Springer Texts in Business and Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().