REVIEW 9 cited by
An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible high-dimensional data modeling, and act as a sampler for generating new samples under active guidance towards task-desired properties. Despite the significant empirical success, theory of diffusion models is very limited, potentially slowing down principled methodological innovations for further harnessing and improving diffusion models. In this paper, we review emerging applications of diffusion models, understanding their sample generation under various controls. Next, we overview the existing theories of diffusion models, covering their statistical properties and sampling capabilities. We adopt a progressive routine, beginning with unconditional diffusion models and connecting to conditional counterparts. Further, we review a new avenue in high-dimensional structured optimization through conditional diffusion models, where searching for solutions is reformulated as a conditional sampling problem and solved by diffusion models. Lastly, we discuss future directions about diffusion models. The purpose of this paper is to provide a well-rounded theoretical exposure for stimulating forward-looking theories and methods of diffusion models.
Forward citations
Cited by 9 Pith papers
-
Fast Score-Based Sampling via Log-Concave Reductions
Score-based sampling reduces to a short sequence of strongly log-concave sampling problems, giving √d polylog(1/ε) complexity bounds and logarithmic dependence on the condition number for log-concave targets.
-
Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds
Denoising diffusion models achieve Wasserstein-2 sampling error of order √D/K up to logarithmic factors for a broad class of distributions, matching the Gaussian lower bound, and score-evaluation noise vanishes as the...
-
Self-Supervised Representation-Guided Generative Dataset Distillation
SRG guides diffusion-based dataset distillation with self-supervised representation prototypes, beating generative baselines for frozen pretrained encoders.
-
From Score Learning to Discretized Sampling: An End-to-End Generalization Analysis of Diffusion Models
An end-to-end TV bound for score-based diffusion models that decomposes generative error into forward truncation, reverse discretization, finite-sample generalization, and optimization gap.
-
From Similarity to Feasibility: Diffusion-Refined Retrieval-Augmented Generation for Distribution Network Optimization
A retrieval-and-diffusion warm-start pipeline cuts solve times for distribution-network optimization on most tested benchmarks while keeping solution quality near-optimal, but it is slower than direct solving on one c...
-
Conditional Diffusion Guidance under Hard Constraint: A Stochastic Analysis Approach
By adding drift g(t)^2 ∇log h(t,y) with h estimated via martingale and covariation losses, diffusion samples can be hard-conditioned on an event.
-
Likelihood Matching for Diffusion Models
Likelihood Matching trains diffusion models by maximizing a Gaussian quasi-likelihood of reverse transitions driven by score and Hessian estimates, with consistency and total-variation convergence guarantees.
-
Non-Identical Diffusion Models in MIMO-OFDM Channel Generation
A diffusion model with an element-wise time matrix, rather than one global time, improves MIMO-OFDM channel recovery from unevenly reliable pilots, but the proof of correctness has gaps.
-
Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization
This review organizes machine-learning-assisted photonic device development into a five-step Bayesian framework spanning theory, simulation, design, fabrication, and characterization.
Discussion (0). Sign in to comment.