Hamiltonian and Langevin Monte Carlo

Adrian Barbu and Song-Chun Zhu
Additional contact information
Adrian Barbu: Florida State University, Department of Statistics
Song-Chun Zhu: University of California, Los Angeles, Departments of Statistics and Computer Science

Chapter 9 in Monte Carlo Methods, 2020, pp 281-325 from Springer

Abstract: Abstract Hamiltonian Monte Carlo (HMC) is a powerful framework for sampling from high-dimensional continuous distributions. Langevin Monte Carlo (LMC) is a special case of HMC that is widely used in Deep Learning applications. Given an n-dimensional continuous density P(X), the only requirement for implementing HMC is the differentiability of the energy U ( X ) = − log P ( X ) $$U(X) = - \log P(X)$$ . Like other MCMC methods (e.g. slice sampling, Swendsen-Wang cuts), HMC introduces auxiliary variables to facilitate movement in the original space. In HMC, the original variables represent position, and the auxiliary variables represent momentum. Each position dimension has a single corresponding momentum variable, so the joint space of the original and auxiliary variables has dimension 2n, twice the size of the original space. Once the momentum variables are introduced, Hamilton’s Equations are used to simulate the time evolution of a physical system with potential energy U. The properties of Hamilton’s Equations ensure that movement in the joint space preserves the distribution of P in the original space.

Date: 2020
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-981-13-2971-5_9

Ordering information: This item can be ordered from
http://www.springer.com/9789811329715

DOI: 10.1007/978-981-13-2971-5_9

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().