Analytic-Precond derives preconditioning coefficients for consistency distillation from a generalized teacher ODE and accelerates multi-step consistency trajectory model training by 2-3x.
For CIFAR-10 (unconditional), we train the model with a batch size of 256 for 200K iterations, which takes 5 days on 4 GPU cards
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Elucidating the Preconditioning in Consistency Distillation
Analytic-Precond derives preconditioning coefficients for consistency distillation from a generalized teacher ODE and accelerates multi-step consistency trajectory model training by 2-3x.