REVIEW 3 cited by
On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation is made of Lipschitz continuous functions avoiding any Lipschitzness assumption on the score function. We demonstrate via a motivating example, sampling from a Gaussian distribution with unknown mean, the powerfulness of our approach. In this case, explicit estimates are provided for the associated optimization problem, i.e. score approximation, while these are combined with the corresponding sampling estimates. As a result, we obtain the best known upper bound estimates in terms of key quantities of interest, such as the dimension and rates of convergence, for the Wasserstein-2 distance between the data distribution (Gaussian with unknown mean) and our sampling algorithm. Beyond the motivating example and in order to allow for the use of a diverse range of stochastic optimizers, we present our results using an $L^2$-accurate score estimation assumption, which crucially is formed under an expectation with respect to the stochastic optimizer and our novel auxiliary process that uses only known information. This approach yields the best known convergence rate for our sampling algorithm.
Forward citations
Cited by 3 Pith papers
-
Diffusion Bootstrap for High-Dimensional Linear Models
A diffusion pairs bootstrap recovers correct OLS variance in proportional high-dimensional linear models under score approximation, while terminal Wasserstein consistency alone does not.
-
Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds
Denoising diffusion models achieve Wasserstein-2 sampling error of order √D/K up to logarithmic factors for a broad class of distributions, matching the Gaussian lower bound, and score-evaluation noise vanishes as the...
-
Convergence of empirical subgradients for optimal transport-based objectives
Under smooth unit costs and models, empirical subdifferentials of parameterized transport objectives converge graphically almost surely to the population subdifferential, so subgradient methods approach population cri...
Discussion (0). Sign in to comment.