REVIEW 5 cited by
Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost that is orthogonal to sampling time. We tackle the question of how to improve diversity and sample efficiency by moving beyond the common assumption of independent samples. We propose particle guidance, an extension of diffusion-based generative sampling where a joint-particle time-evolving potential enforces diversity. We analyze theoretically the joint distribution that particle guidance generates, how to learn a potential that achieves optimal diversity, and the connections with methods in other disciplines. Empirically, we test the framework both in the setting of conditional image generation, where we are able to increase diversity without affecting quality, and molecular conformer generation, where we reduce the state-of-the-art median error by 13% on average.
Forward citations
Cited by 5 Pith papers
-
Provable Maximum Entropy Manifold Exploration via Diffusion Models
S-MEME iteratively fine-tunes a diffusion model using its own score as the exploration reward, provably converging to the maximum-entropy distribution on the learned manifold.
-
Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup Functional
Transition path sampling can be performed zero-shot by minimizing the Onsager-Machlup action under the score function of a pre-trained generative model.
-
Scaling Group Inference for Diverse and High-Quality Generation
Groups of generated images become more diverse while staying high-quality when K outputs are chosen from M candidates via a quadratic integer program with progressive pruning.
-
Applications of Modular Co-Design for De Novo 3D Molecule Generation
A new transformer architecture with joint continuous and discrete denoising improves 3D molecule generation and moves generated structures closer to low-energy physical minima.
-
Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generation
Starting diffusion sampling from variance-boosted noise and skipping early timesteps generates minority samples at guided-method quality with far less compute.
Discussion (0). Continue with ORCID to comment.