REVIEW 4 cited by
Dirichlet Flow Matching with Applications to DNA Sequence Design
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
Discrete diffusion or flow models could enable faster and more controllable sequence generation than autoregressive models. We show that na\"ive linear flow matching on the simplex is insufficient toward this goal since it suffers from discontinuities in the training target and further pathologies. To overcome this, we develop Dirichlet flow matching on the simplex based on mixtures of Dirichlet distributions as probability paths. In this framework, we derive a connection between the mixtures' scores and the flow's vector field that allows for classifier and classifier-free guidance. Further, we provide distilled Dirichlet flow matching, which enables one-step sequence generation with minimal performance hits, resulting in $O(L)$ speedups compared to autoregressive models. On complex DNA sequence generation tasks, we demonstrate superior performance compared to all baselines in distributional metrics and in achieving desired design targets for generated sequences. Finally, we show that our classifier-free guidance approach improves unconditional generation and is effective for generating DNA that satisfies design targets. Code is available at https://github.com/HannesStark/dirichlet-flow-matching.
Forward citations
Cited by 4 Pith papers
-
What Exactly Does Guidance Do in Masked Discrete Diffusion Models
With exact scores and no discretization error, CFG in 1D masked discrete diffusion samples exactly the tilted distribution; in 2D it does not, and the TV convergence rate is double-exponential in guidance strength.
-
Should the Boundary Term Be Learned in Reflected Diffusion? Conormal Trace and Reflection Masking
For reflected diffusion on bounded domains, the no-flux condition fixes one scalar per boundary point, the conormal trace of the score, and the paper gives an exact box parametrization, proves a misspecification floor...
-
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
CO2Jump couples text and image denoising through cross-modal attention and remasking, achieving best joint accuracy on three concurrent-generation tasks.
-
MolPIF: A Parameter Interpolation Flow Model for Molecule Generation
MolPIF generates 3D ligands by interpolating the parameters of Gaussian coordinate and Dirichlet atom-type distributions, reporting stronger docking scores and geometric fidelity than prior flow and diffusion models o...
Discussion (0). Sign in to comment.