REVIEW 6 cited by
The Stein-log-Sobolev inequality and the exponential rate of convergence for the continuous Stein variational gradient descent method
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
The Stein-log-Sobolev inequality and the exponential rate of convergence for the continuous Stein variational gradient descent method
read the original abstract
The Stein Variational Gradient Descent method is a variational inference method in statistics that has recently received a lot of attention. The method provides a deterministic approximation of the target distribution, by introducing a nonlocal interaction with a kernel. Despite the significant interest, the exponential rate of convergence for the continuous method has remained an open problem, due to the difficulty of establishing the related so-called Stein-log-Sobolev inequality. Here, we prove that the inequality is satisfied for each space dimension and every kernel whose Fourier transform has a quadratic decay at infinity and is locally bounded away from zero and infinity. Moreover, we construct weak solutions to the related PDE satisfying exponential rate of decay towards the equilibrium. The main novelty in our approach is to interpret the Stein-Fisher information, also called the squared Stein discrepancy, as a duality pairing between $H^{-1}(\mathbb{R}^d)$ and $H^{1}(\mathbb{R}^d)$, which allows us to employ the Fourier transform. We also provide several examples of kernels for which the Stein-log-Sobolev inequality fails, partially showing the necessity of our assumptions.
Forward citations
Cited by 6 Pith papers
-
Global solutions to cross-diffusion systems with independent advections in one dimension
Global existence of weak solutions is established for 1D cross-diffusion systems with arbitrary advections via vanishing-viscosity limit and a three-entropy compensated-compactness argument that exploits oscillation c...
-
Riesz-Kernel Stein Variational Gradient Descent: Renormalized Entropy and Long-Time Particle Limits
For singular Riesz-kernel SVGD with self-interaction removed, the time-averaged empirical measure converges weakly to the target as particle number and averaging horizon diverge, with an explicit N^{-1+σ/d} correction...
-
Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descent
Uniform-in-time propagation-of-chaos bounds for SVGD are obtained via cutoff for distributional metrics (logarithmic rates) and via finite-dimensional closure plus conjugacy for Gaussian targets (parametric N^{-1/2} rates).
-
Non-uniqueness of weak solutions to cross-diffusion systems with advection
Constructs multiple weak solutions to a cross-diffusion-advection system on the line, proving non-uniqueness by exhibiting both segregated and mixing behaviors from complementary half-line supports.
-
Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flow
Mean-field SVGD flow converges locally at explicit polynomial L2 rates to the target on the torus for Riesz kernels, with rates depending on dimension and regularity, sharpness in some regimes, and recovery of global ...
-
Stein Variational Gradient Descent dynamics for highly concentrated kernels
SVGD dynamics with concentrating kernels converge to a local Wasserstein gradient flow with quadratic mobility.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.