REVIEW 3 cited by
Tamed Langevin sampling under weaker conditions
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Motivated by applications to deep learning which often fail standard Lipschitz smoothness requirements, we examine the problem of sampling from distributions that are not log-concave and are only weakly dissipative, with log-gradients allowed to grow superlinearly at infinity. In terms of structure, we only assume that the target distribution satisfies either a log-Sobolev or a Poincar\'e inequality and a local Lipschitz smoothness assumption with modulus growing possibly polynomially at infinity. This set of assumptions greatly exceeds the operational limits of the "vanilla" unadjusted Langevin algorithm (ULA), making sampling from such distributions a highly involved affair. To account for this, we introduce a taming scheme which is tailored to the growth and decay properties of the target distribution, and we provide explicit non-asymptotic guarantees for the proposed sampler in terms of the Kullback-Leibler (KL) divergence, total variation, and Wasserstein distance to the target distribution.
Forward citations
Cited by 3 Pith papers
-
A Computable Measure of Suboptimality for Entropy-Regularised Variational Objectives
Kernel gradient discrepancy gives a computable, theory-backed measure of suboptimality for entropy-regularised variational objectives, and it reduces to kernel Stein discrepancy in the standard Bayesian case.
-
Deterministic Denominator Design for Localized Tamed Stochastic Gradient Langevin Dynamics
Develops proxy-quantile deterministic denominator designs for localized tamed SGLD that track errors via a conditional perturbation bridge and outperform basic deterministic taming in experiments.
-
kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradients
kTULA achieves a non-asymptotic KL convergence of order lambda^(2-epsilon) for non-log-concave targets with super-linear log-gradients under a Log-Sobolev inequality, improving prior order-lambda KL bounds.
Discussion (0). Continue with ORCID to comment.