Solving high-dimensional Hamilton–Jacobi–Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path space

Nikolas Nüsken () and Lorenz Richter ()
Additional contact information
Nikolas Nüsken: Universität Potsdam
Lorenz Richter: Freie Universität Berlin

Partial Differential Equations and Applications, 2021, vol. 2, issue 4, 1-48

Abstract: Abstract Optimal control of diffusion processes is intimately connected to the problem of solving certain Hamilton–Jacobi–Bellman equations. Building on recent machine learning inspired approaches towards high-dimensional PDEs, we investigate the potential of iterative diffusion optimisation techniques, in particular considering applications in importance sampling and rare event simulation, and focusing on problems without diffusion control, with linearly controlled drift and running costs that depend quadratically on the control. More generally, our methods apply to nonlinear parabolic PDEs with a certain shift invariance. The choice of an appropriate loss function being a central element in the algorithmic design, we develop a principled framework based on divergences between path measures, encompassing various existing methods. Motivated by connections to forward-backward SDEs, we propose and study the novel log-variance divergence, showing favourable properties of corresponding Monte Carlo estimators. The promise of the developed approach is exemplified by a range of high-dimensional and metastable numerical examples.

Keywords: Hamilton–Jacobi–Bellman PDEs; Forward-backward SDEs; Optimal control of diffusions; Divergences between probability measures; Rare event simulation; Deep learning (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s42985-021-00102-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:pardea:v:2:y:2021:i:4:d:10.1007_s42985-021-00102-x

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/42985/

DOI: 10.1007/s42985-021-00102-x

Access Statistics for this article

Partial Differential Equations and Applications is currently edited by Zhitao Zhang

More articles in Partial Differential Equations and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().