Sampling from Non-smooth Distributions Through Langevin Diffusion

Tung Duy Luu (), Jalal Fadili () and Christophe Chesneau ()
Additional contact information
Tung Duy Luu: Normandie University, ENSICAEN, UNICAEN, CNRS, GREYC
Jalal Fadili: Normandie University, ENSICAEN, UNICAEN, CNRS, GREYC
Christophe Chesneau: Normandie University, UNICAEN, CNRS, LMNO

Methodology and Computing in Applied Probability, 2021, vol. 23, issue 4, 1173-1201

Abstract: Abstract In this paper, we propose proximal splitting-type algorithms for sampling from distributions whose densities are not necessarily smooth nor log-concave. Our approach brings together tools from, on the one hand, variational analysis and non-smooth optimization, and on the other hand, stochastic diffusion equations, and in particular the Langevin diffusion. We establish in particular consistency guarantees of our algorithms seen as discretization schemes in this context. These algorithms are then applied to compute the exponentially weighted aggregates for regression problems involving non-smooth penalties that are commonly used to promote some notion of simplicity/complexity. Some popular penalties are detailed and implemented on some numerical experiments.

Keywords: Langevin diffusion; Monte-Carlo; Non-smooth distributions; Proximal splitting; Exponentially weighted aggregation; 65C05; 65C30; 65C50; 65C60 (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11009-020-09809-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metcap:v:23:y:2021:i:4:d:10.1007_s11009-020-09809-7

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/11009

DOI: 10.1007/s11009-020-09809-7

Access Statistics for this article

Methodology and Computing in Applied Probability is currently edited by Joseph Glaz

More articles in Methodology and Computing in Applied Probability from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().