KL divergence bounds show stochasticity in diffusion sampling contracts error with exact scores, but for learned scores it can help or hurt depending on the time profile of the score error.
Poincar\'e and log-Sobolev inequalities for mixtures
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
This work studies mixtures of probability measures on $\mathbb{R}^n$ and gives bounds on the Poincar\'e and the log-Sobolev constant of two-component mixtures provided that each component satisfies the functional inequality, and both components are close in the $\chi^2$-distance. The estimation of those constants for a mixture can be far more subtle than it is for its parts. Even mixing Gaussian measures may produce a measure with a Hamiltonian potential possessing multiple wells leading to metastability and large constants in Sobolev type inequalities. In particular, the Poincar\'e constant stays bounded in the mixture parameter whereas the log-Sobolev may blow up as the mixture ratio goes to $0$ or $1$. This observation generalizes the one by Chafa\"i and Malrieu to the multidimensional case. The behavior is shown for a class of examples to be not only a mere artifact of the method.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysis
KL divergence bounds show stochasticity in diffusion sampling contracts error with exact scores, but for learned scores it can help or hurt depending on the time profile of the score error.