REVIEW 3 cited by
Implicit Diffusion: Efficient Optimization through Stochastic Sampling
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a general framework for first-order optimization of these processes, that performs jointly, in a single loop, optimization and sampling steps. This approach is inspired by recent advances in bilevel optimization and automatic implicit differentiation, leveraging the point of view of sampling as optimization over the space of probability distributions. We provide theoretical guarantees on the performance of our method, as well as experimental results demonstrating its effectiveness. We apply it to training energy-based models and finetuning denoising diffusions.
Forward citations
Cited by 3 Pith papers
-
Bayesian Experimental Design via Score Matching
SCOREBED isolates EIG double intractability in a policy-independent score-matching stage, then trains design policies with a singly intractable gradient estimator, enabling cheap multi-policy selection.
-
A First-order Generative Bilevel Optimization Framework for Diffusion Models
A bilevel first-order method tunes entropy-regularization strength and noise schedules in diffusion models without backpropagating through sampling, improving FID and CLIP over hyperparameter search baselines.
-
Direct Distributional Optimization for Provable Alignment of Diffusion Models
A distribution-level optimization framework, dual averaging plus Doob's h-transform, aligns diffusion models with provable convergence and isoperimetry-free sampling.
Discussion (0). Continue with ORCID to comment.