REVIEW 9 cited by
Simple Guidance Mechanisms for Discrete Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not directly apply to discrete diffusion. Here, we provide a straightforward derivation of classifier-free and classifier-based guidance for discrete diffusion, as well as a new class of diffusion models that leverage uniform noise and that are more guidable because they can continuously edit their outputs. We improve the quality of these models with a novel continuous-time variational lower bound that yields state-of-the-art performance, especially in settings involving guidance or fast generation. Empirically, we demonstrate that our guidance mechanisms combined with uniform noise diffusion improve controllable generation relative to autoregressive and diffusion baselines on several discrete data domains, including genomic sequences, small molecule design, and discretized image generation.
Forward citations
Cited by 9 Pith papers
-
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
CO2Jump couples text and image denoising through cross-modal attention and remasking, achieving best joint accuracy on three concurrent-generation tasks.
-
CANDI: Hybrid Discrete-Continuous Diffusion Models
CANDI combines masked and Gaussian corruption in one noising process, letting discrete diffusion models use continuous gradients for joint updates and guidance.
-
Predicting and generating antibiotics against future pathogens with ApexOracle
ApexOracle fuses genomic and literature-derived pathogen embeddings with a diffusion language model to predict antimicrobial activity and generate new candidate molecules for unseen bacterial strains.
-
Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces
A unified diffusion framework with per-modality noise clocks lets one model generate images, text, and tabular data jointly or conditionally in their native spaces.
-
Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generation
NSD adds iterative constraint projection to both continuous and discrete diffusion sampling, achieving near-zero constraint violations across molecular, robotic, material, and language generation tasks.
-
On the Design Space of Discrete Diffusion Online Adaptation for Molecular Optimization
Online fine-tuning of discrete diffusion models with complementary acquisition, CVaR shaping, density-entropy debiasing, replay, and validity control finds better molecules under fixed oracle budgets than offline fine...
-
Exploring More to Solve More: Boosting Diversity in Text Diffusion Models via Entropy-Based Guidance
A kernel-entropy guidance signal, linearized into logit space, shifts the fidelity-diversity frontier of text diffusion models and lifts LLaDA-8B pass@32 on HumanEval and MBPP by 8-15 absolute points.
-
Rethinking Visual Autoregressive Sampling with Information-Grounding Guidance
IGG, an attention-based reweighting of classifier-free guidance, concentrates guidance on important tokens and modestly improves FID/IS in scale-wise autoregressive image generation.
-
Tabular Diffusion Counterfactual Explanations
TDCE guides a tabular diffusion reverse process with Gumbel-softmax classifier gradients to produce counterfactual explanations, achieving high validity on four benchmarks.
Discussion (0). Sign in to comment.