The Next Generation of Optimization: A Unified Framework for Dynamic Resource Allocation Problems

Warren B. Powell ()
Additional contact information
Warren B. Powell: Princeton University

A chapter in Optimization in Large Scale Problems, 2019, pp 47-52 from Springer

Abstract: Abstract Sequential decision problems arise in a vast range of applications where decisions are followed by new information that was not known when earlier decisions were made. Applications arise in energy, transportation, health, finance, engineering and the sciences. Problem settings may involve managing resources (inventories for vaccines, financial investments, people and equipment), pure learning problems (laboratory testing, computer simulations, field tests) and combinations of the two. The range of problems is so wide that they have been studied by over a dozen distinct academic communities using names such as dynamic programming, reinforcement learning, stochastic control, stochastic programming, active learning, and multiarmed bandit problems. We bring these fields together into a single framework that involves searching for policies which are functions for making decisions. We then identify four classes of policies that span all the approaches used in the academic literature, or in practice. We claim that these four classes of policies are universal – any solution of a sequential decision problem will consist of one of these four classes, or a hybrid of several.

Date: 2019
References: Add references at CitEc
Citations: View citations in EconPapers (1)

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-3-030-28565-4_9

Ordering information: This item can be ordered from
http://www.springer.com/9783030285654

DOI: 10.1007/978-3-030-28565-4_9

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().