A third-order Langevin MCMC algorithm is proven to sample from smooth log-concave distributions in O(d^(1/4)/epsilon^(1/2)) iterations for generalized linear model potentials, improving on the earlier d^(1/3) barrier.
On sampling from a log-concave density using kinetic Langevin diffusions
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave densities defined on $\mathbb R^p$. The present work focuses on this framework and studies the behavior of Monte Carlo algorithms based on discretizations of the kinetic Langevin diffusion. We first prove the geometric mixing property of the kinetic Langevin diffusion with a mixing rate that is, in the overdamped regime, optimal in terms of its dependence on the condition number. We then use this result for obtaining improved guarantees of sampling using the kinetic Langevin Monte Carlo method, when the quality of sampling is measured by the Wasserstein distance. We also consider the situation where the Hessian of the log-density of the target distribution is Lipschitz-continuous. In this case, we introduce a new discretization of the kinetic Langevin diffusion and prove that this leads to a substantial improvement of the upper bound on the sampling error measured in Wasserstein distance.
citation-role summary
citation-polarity summary
fields
stat.ML 1years
2019 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithm
A third-order Langevin MCMC algorithm is proven to sample from smooth log-concave distributions in O(d^(1/4)/epsilon^(1/2)) iterations for generalized linear model potentials, improving on the earlier d^(1/3) barrier.