REVIEW 3 major objections 6 minor 90 references
Signed Rectified Flow turns a signed measure (positive minus negative distributions) into a valid sampling process that provably avoids the negative regions.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 15:09 UTC pith:MHDOIZK4
load-bearing objection Signed RF is a genuinely new way to put negative distributions into flow guidance, with a clean theory for the idealized dynamics; the practical method is plausible but the exact exclusion guarantee does not transfer to the implemented sampler. the 3 major comments →
Signed Rectified Flow: Negativity-Controlled Generation
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The paper's central claim is Theorem B.4: for the exact Signed RF dynamics (under local C1 regularity and nondegenerate zero set), the law of the source-initialized ODE satisfies πsignRF_t(x)=πsign_t(x) 1{x∈Ωr_t}. The flow rectifies a signed density into a valid probability: on the reachable region Ωr_t it preserves the signed density exactly; outside it (ghost and negative regions) it places zero mass. Proposition B.3 shows trajectories never cross the zero set. The same construction gives guidance-form velocity v+_t + λα_t(v+_t−v−_t) with λα_t = α rt/((1+α)−α rt), so the effective guidance scale is a local function of the density ratio rt=π−_t/π+_t. The paper provides two estimators for rt
What carries the argument
The central object is the signed marginal πsign_t = (1+α)π+_t − απ−_t, obtained by writing the usual rectified-flow mixture with a negative coefficient, together with the Signed RF velocity field formed by dividing the signed flux by πsign_t. Because both branches share a Gaussian source, the Tweedie identity shows the signed flux at the zero set points toward the positive side, so the zero set acts as a repulsive barrier. The paper interprets the dynamics as charged particles: positive and negative particles annihilate at the moving zero set, while backward from t=1 only particles from the reachable region connect to the source at t=0. A Liouville/continuity-equation argument along the flow
Load-bearing premise
The load-bearing premise is that the signed density's zero set is always a smooth boundary (nonzero gradient wherever it vanishes), so the signed flux points into the positive region and trajectories can never cross it.
What would settle it
Construct a Gaussian-mixture target where the positive and negative components meet tangentially so that πsign_t(x)=0 and ∇πsign_t(x)=0 at some point, simulate Signed RF with the closed-form ratio, and check whether any trajectory reaches a negative region; any crossing would falsify nonpenetration under degenerate zero sets. In practical settings, measuring signed-density violations along sampled trajectories with finite Euler steps and a learned classifier would test the robustness of the exact guarantee.
If this is right
- If the central theorem holds, negative information enters generation exactly: the induced sampling law is a total-variation-optimal nonnegative approximation of the signed target, equal to the signed density on the reachable region.
- The guidance scale is locally determined by the density ratio π−_t/π+_t, so repulsion is automatically weak where the state looks positive and strong where it looks negative, replacing fixed guidance schedules with a state-dependent rule.
- Taking the training set as the negative distribution yields a training-free analytic negative flow; repelling from it shifts nearest-neighbor similarity upward while keeping FID and inception score close to baseline.
- In safety and concept-suppression settings, subtracting a model of unsafe outputs from a model of safe outputs lowers attack success rates while preserving CLIP and aesthetic scores.
- Explicitly modeling invalid regions as π− resolves the missing-negative-data problem for planning, removing wall crossings while retaining broad path diversity.
Where Pith is reading between the lines
- If the nondegeneracy assumption (nonzero gradient wherever πsign_t vanishes) fails in high-dimensional learned models, sharp exclusion boundaries may become degenerate, and the exact nonpenetration guarantee weakens to approximate exclusion; this is worth testing in learned latent spaces.
- Because the guidance scale is a density-ratio function, the same construction could be applied to preference data by treating dispreferred examples as π−, connecting sampling-time suppression to preference-based training objectives.
- The ghost region means Signed RF silently discards some positive mass; a testable extension is to characterize when the reachable region covers the modes of π+, since diversity depends on this dynamically determined subset.
- A direct falsification experiment would use an exactly computable ratio in a 2D Gaussian mixture whose zero set has a degenerate tangency and check whether any trajectory crosses into a negative region.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Signed Rectified Flow (Signed RF), a generalization of Rectified Flow that replaces the target distribution by the signed measure π^sign = (1+α)π^+ − απ^−, where π^+ is promoted and π^− is suppressed. By linearity of the RF marginal and flux, the authors derive a signed velocity field that is well defined away from the zero set of π^sign. They prove that, under Assumption B.2 (C1 regularity and nondegenerate zero set), source-initialized trajectories remain in the positive region and the sampling law coincides with π^sign on a dynamically reachable subset Ω^r_t, while negative and ghost regions are never visited. The paper also derives a guidance-form implementation whose local strength is the density ratio π^−_t/π^+_t, estimated either by a classifier or by online ODE tracking. Experiments cover 2D toys, PointMaze, ImageNet-256 class-conditional generation, anti-memorization via an analytic negative flow, and concept/nudity suppression in Stable Diffusion 3.5, reporting improvements over constant-guidance baselines.
Significance. If the result holds, Signed RF provides a principled way to inject negative information into flow-based generative models, with a clear target-level construction and a nontrivial theoretical characterization of the induced sampling law. The proofs in Appendix B are coherent and the TV-optimality interpretation (Proposition B.1) is a nice contribution. The paper is also strong on the empirical side: the ImageNet, anti-memorization, and safety experiments are extensive and include useful ablations (classifier checkpoint stability, guidance-cap sensitivity, runtime measurements). The main caveat is that the 'provable exclusion' guarantee is established only for the exact Signed RF ODE under Assumption B.2, whereas the implemented pipeline uses estimated ratios, clipping, and caps; the manuscript should make this distinction much more prominent.
major comments (3)
- [Assumption B.2 / Proposition B.3 / Remark B.5] The nonpenetration guarantee relies critically on the nondegeneracy condition ∇π^sign_t(x) ≠ 0 whenever π^sign_t(x) = 0. For π^sign_t = (1+α)π^+_t − απ^−_t where π^±_t are learned densities or empirical Gaussian mixtures, this condition is not enforced and can fail at degenerate points; Remark B.5 explicitly concedes such cases are not covered. The abstract and Sec. 2.2 state 'provably excluding' without this qualification. Please add the regularity condition to the main-text claims, or provide a generic-perturbation argument showing degenerate zero sets are negligible, or empirically test nondegeneracy in the evaluated settings.
- [Sec. 2.3 / Eq. (5) and stabilization] The implemented sampler replaces the exact velocity with a classifier- or online-estimated density ratio, then applies the denominator lower bound max((1+α)−α r_t, ε) and the guidance cap λ_max. These modifications mean the simulated trajectories are not governed by the signed flux, so the density identity and nonpenetration results (Prop. B.3, Thm. B.4) do not apply to the evaluated algorithm. The main text should state this explicitly in Sec. 2.3 and soften the abstract/conclusion accordingly. It would strengthen the paper to quantify the effect of clipping (e.g., bound on the distance from the zero set, or a post-hoc check that no samples land in Ω^−_1).
- [Sec. 3.2 / Fig. 6 / Table 1] The ImageNet FID numbers are reported as best-FID after sweeping α (and ω for CFG) on the same 50K evaluation set. Selecting the best hyperparameter on the test set can overestimate improvements because FID has sampling variance. The stability tables (Tables 2 and 3) are helpful, but they do not address the selection-bias issue. Please report a held-out hyperparameter selection procedure, or give mean±std over multiple seeds for a fixed α chosen on a validation split, and include the full sweep curves so readers can assess the operating points.
minor comments (6)
- [Sec. 2.2 / Figure 2] The text says 'the black curve shows the signed marginal', but the figure is in color; please adjust the color reference or label the curves directly.
- [Sec. 2.3 / Eq. (6)] In the online ratio-tracking ODE, λ^α_t(z_t) is used before its definition at the tracked ratio; clarify that λ^α_t is evaluated at r_t(z_t)=exp(u_t).
- [Sec. 3.2] The negative distribution for the ImageNet classifier is a mixture of low-quality and wrong-class samples, not a fixed π^− as in the theory. The density-ratio interpretation is therefore approximate; please state this explicitly in the main text.
- [Tables 2 and 3] The header 'Step α' is ambiguous; rename it to 'α' and clarify that FID is computed on the same 50K sample set.
- [Figure 8] The legend 'RF Ours' is unclear; it should be split into distinct labels for the base model and the proposed method.
- [Appendix A] The sentence 'under the stated assumptions, the strict nonpenetration result applies to the exact Signed RF dynamics' is an important caveat that should appear in Sec. 2.3 or 2.2, not only in the related-work appendix.
Circularity Check
No circular derivation: Signed RF's sampling-law theorem follows from the continuity equation and flow-map mass conservation; the only self-citations are standard background, and the flagged caveats are assumptions, not input–output identification.
full rationale
Walked the paper's derivation chain. The signed marginal πsign_t and signed flux are defined by linear combination of the two branch RF marginals/fluxes (Eqs. 8–9), and the Signed RF velocity is defined as flux divided by signed density (Eq. 10). The central identity πsignRF_t(x) = πsign_t(x) 1{x∈Ωr_t} (Eq. 4 / Theorem B.4) is not definitional: Ωr_t is defined as the image of the source-initialized flow map, and the equality of densities is proved via the continuity equation plus Liouville's formula, using πsign_0 = π0. This is a genuine transport calculation, not a restatement of the input. The nonpenetration result (Proposition B.3) is a separate flux-sign argument using the Gaussian-source identity (∇πsign_t)ᵀ jsign_t = ((1−t)/t)‖∇πsign_t‖² > 0 on the zero set; it does not assume the conclusion. Assumption B.2's nondegenerate zero-set condition is a real premise, and Remark B.5 explicitly concedes that degenerate zero sets are 'not covered by the present result,' so the limitation is disclosed rather than hidden. The empirical machinery (classifier-based ratio estimation, online ratio tracking, clipping/capping, α sweeps) is standard estimation and hyperparameter tuning; no fitted parameter is renamed as a prediction. In anti-memorization, the nearest-neighbor SSCD metric is aligned with the method's explicit objective of repelling from the training set, so improvements on that metric are unsurprising, but the paper also reports an independent latent-L2 metric and does not frame the experiment as a first-principles prediction. Self-citations (Rectified Flow [20,21], lecture notes [24], Momentum Guidance [8]) supply standard background or baselines and are not invoked to rule out alternatives. No circular step meeting the quoted-reduction standard was found.
Axiom & Free-Parameter Ledger
free parameters (4)
- α (suppression strength) =
swept per task; e.g., ImageNet α≈0.07–0.10, anti-memorization α=0.1–7.5
- λ_max (guidance cap) =
e.g., 10, 5, 3 in ImageNet
- ε (denominator lower bound) =
1e-3
- negative prompt / negative distribution choice =
manually selected per concept (e.g., 'Mickey Mouse, Disney character')
axioms (5)
- standard math Rectified Flow marginal preservation and linearity of marginals/flux for convex mixtures
- domain assumption Common Gaussian source π0=N(0,I) and Tweedie identity s±_t=(t v±_t − x)/(1−t)
- ad hoc to paper Assumption B.2: local C1 regularity of πsign_t and signed flux, and nondegeneracy ∇πsign_t≠0 on the zero set
- standard math ODE well-posedness on compact intervals [0,T]⊂[0,1)
- domain assumption Both RF branches share the same source distribution
invented entities (3)
-
Ghost region Ωg_t
no independent evidence
-
Signed measure / negative mass
no independent evidence
-
Exclusion barrier (zero set Ω0_t)
no independent evidence
read the original abstract
We introduce Signed Rectified Flow (Signed RF), a generalization of Rectified Flow that targets the signed measure $\pi^{sign} = (1+\alpha)\pi^+ - \alpha\pi^-$, where $\alpha>0$, $\pi^+$ is the distribution to promote, and $\pi^-$ is the distribution to suppress. Although direct sampling from a signed measure is not well-defined, Signed RF induces a valid generative process that concentrates probability in regions where the signed measure is positive while provably excluding regions dominated by its negative component. It therefore provides a principled framework for incorporating negative information and exclusion constraints into generative modeling. We analyze the signed continuity equation underlying Signed RF and use a charged-particle interpretation to explain how negative mass forms exclusion barriers. This theory further motivates practical adaptive guidance algorithms. Across several applications, Signed RF improves the fidelity-diversity trade-off on ImageNet, reduces nearest-neighbor similarity in anti-memorization experiments, and reduces nudity induced by adversarial prompts in Stable Diffusion 3.5 while preserving CLIP and aesthetic scores.
Figures
Reference graph
Works this paper leans on
-
[1]
Finetuned language models are zero-shot learners.arXiv preprint arXiv:2109.01652, 2021
Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. Finetuned language models are zero-shot learners.arXiv preprint arXiv:2109.01652, 2021
Pith/arXiv arXiv 2021
-
[2]
Victor Sanh, Albert Webson, Colin Raffel, Stephen H Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, et al. Multitask prompted training enables zero-shot task generalization.arXiv preprint arXiv:2110.08207, 2021
Pith/arXiv arXiv 2021
-
[3]
Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022
Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022
Pith/arXiv arXiv 2022
-
[4]
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780–8794, 2021
2021
-
[5]
High- resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High- resolution image synthesis with latent diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022
2022
-
[6]
Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. Glide: Towards photorealistic image generation and editing with text-guided diffusion models.arXiv preprint arXiv:2112.10741, 2021
Pith/arXiv arXiv 2021
-
[7]
Photorealistic text-to-image diffusion models with deep language understanding.Advances in neural information processing systems, 35:36479–36494, 2022
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding.Advances in neural information processing systems, 35:36479–36494, 2022
2022
-
[8]
Momentum guidance: Plug-and-play guidance for flow models.arXiv preprint arXiv:2602.20360, 2026
Runlong Liao, Jian Yu, Baiyu Su, Chi Zhang, Lizhang Chen, and Qiang Liu. Momentum guidance: Plug-and-play guidance for flow models.arXiv preprint arXiv:2602.20360, 2026
Pith/arXiv arXiv 2026
-
[9]
Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. Training a helpful and harmless assistant with reinforcement learning from human feedback.arXiv preprint arXiv:2204.05862, 2022
Pith/arXiv arXiv 2022
-
[10]
Constitutional ai: Harmlessness from ai feedback.arXiv preprint arXiv:2212.08073, 2022
Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al. Constitutional ai: Harmlessness from ai feedback.arXiv preprint arXiv:2212.08073, 2022
Pith/arXiv arXiv 2022
-
[11]
Safe latent diffusion: Mitigating inappropriate degeneration in diffusion models
Patrick Schramowski, Manuel Brack, Björn Deiseroth, and Kristian Kersting. Safe latent diffusion: Mitigating inappropriate degeneration in diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 22522–22531, 2023
2023
-
[12]
Training language models to follow instructions with human feedback.Advances in neural information processing systems, 35:27730–27744, 2022
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. Training language models to follow instructions with human feedback.Advances in neural information processing systems, 35:27730–27744, 2022
2022
-
[13]
Direct preference optimization: Your language model is secretly a reward model
Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. Advances in neural information processing systems, 36:53728–53741, 2023
2023
-
[14]
Training diffusion models with reinforcement learning
Kevin Black, Michael Janner, Yilun Du, Ilya Kostrikov, and Sergey Levine. Training diffusion models with reinforcement learning. InThe Twelfth International Conference on Learning Representations, 2024. 10
2024
-
[15]
Diffusion model alignment using direct preference optimization
Bram Wallace, Meihua Dang, Rafael Rafailov, Linqi Zhou, Aaron Lou, Senthil Purushwalkam, Stefano Ermon, Caiming Xiong, Shafiq Joty, and Nikhil Naik. Diffusion model alignment using direct preference optimization. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8228–8238, 2024
2024
-
[16]
Aligning text-to-image models using human feedback.arXiv preprint arXiv:2302.12192, 2023
Kimin Lee, Hao Liu, Moonkyung Ryu, Olivia Watkins, Yuqing Du, Craig Boutilier, Pieter Abbeel, Mohammad Ghavamzadeh, and Shixiang Shane Gu. Aligning text-to-image models using human feedback.arXiv preprint arXiv:2302.12192, 2023
Pith/arXiv arXiv 2023
-
[17]
Denoising diffusion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020
2020
-
[18]
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations.arXiv preprint arXiv:2011.13456, 2020
Pith/arXiv arXiv 2011
-
[19]
Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502, 2020
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502, 2020
Pith/arXiv arXiv 2010
-
[20]
Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022
Pith/arXiv arXiv 2022
-
[21]
Qiang Liu. Rectified flow: A marginal preserving approach to optimal transport.arXiv preprint arXiv:2209.14577, 2022
Pith/arXiv arXiv 2022
-
[22]
Flow matching for generative modeling.arXiv preprint arXiv:2210.02747, 2022
Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling.arXiv preprint arXiv:2210.02747, 2022
Pith/arXiv arXiv 2022
-
[23]
Building normalizing flows with stochastic interpolants.arXiv preprint arXiv:2209.15571, 2022
Michael S Albergo and Eric Vanden-Eijnden. Building normalizing flows with stochastic interpolants.arXiv preprint arXiv:2209.15571, 2022
Pith/arXiv arXiv 2022
-
[24]
Let Us Flow Together
Qiang Liu. Let Us Flow Together. Lecture notes, https://www.cs.utexas.edu/~lqiang/ PDF/flow_book.pdf, 2024. Version dated December 24, 2024
2024
-
[25]
A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines.Communications in Statistics-Simulation and Computation, 18(3):1059– 1076, 1989
Michael F Hutchinson. A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines.Communications in Statistics-Simulation and Computation, 18(3):1059– 1076, 1989
1989
-
[26]
Younis, Rodrigo Perez-Vicente, John U
Omar G. Younis, Rodrigo Perez-Vicente, John U. Balis, Will Dudley, Alex Davey, and Jordan K Terry. Minari, September 2024
2024
-
[27]
D4rl: Datasets for deep data-driven reinforcement learning.arXiv preprint arXiv:2004.07219, 2020
Justin Fu, Aviral Kumar, Ofir Nachum, George Tucker, and Sergey Levine. D4rl: Datasets for deep data-driven reinforcement learning.arXiv preprint arXiv:2004.07219, 2020
Pith/arXiv arXiv 2004
-
[28]
Imagenet: A large- scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large- scale hierarchical image database. In2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009
2009
-
[29]
Pytorch rectifiedflow, 2024
Qiang Liu, Runlong Liao, Bo Liu, and Xixi Hu. Pytorch rectifiedflow, 2024
2024
-
[30]
Gans trained by a two time-scale update rule converge to a local nash equilibrium.Advances in neural information processing systems, 30, 2017
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilibrium.Advances in neural information processing systems, 30, 2017
2017
-
[31]
Improved techniques for training gans.Advances in neural information processing systems, 29, 2016
Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training gans.Advances in neural information processing systems, 29, 2016
2016
-
[32]
As- sessing generative models via precision and recall.Advances in neural information processing systems, 31, 2018
Mehdi SM Sajjadi, Olivier Bachem, Mario Lucic, Olivier Bousquet, and Sylvain Gelly. As- sessing generative models via precision and recall.Advances in neural information processing systems, 31, 2018
2018
-
[33]
Improving rectified flow with boundary conditions
Xixi Hu, Runlong Liao, Keyang Xu, Bo Liu, Yeqing Li, Eugene Ie, Hongliang Fei, and Qiang Liu. Improving rectified flow with boundary conditions. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 18177–18186, 2025. 11
2025
-
[34]
A self- supervised descriptor for image copy detection
Ed Pizzi, Sreya Dutta Roy, Sugosh Nagavara Ravindra, Priya Goyal, and Matthijs Douze. A self- supervised descriptor for image copy detection. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14532–14542, 2022
2022
-
[35]
Shielded diffusion: Generating novel and diverse images using sparse repellency
Michael Kirchhof, James Thornton, Louis Béthune, Pierre Ablin, Eugene Ndiaye, and Marco Cuturi. Shielded diffusion: Generating novel and diverse images using sparse repellency. InProceedings of the 42nd International Conference on Machine Learning, volume 267 of Proceedings of Machine Learning Research, pages 30911–30942, 2025
2025
-
[36]
Scaling rectified flow trans- formers for high-resolution image synthesis
Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling rectified flow trans- formers for high-resolution image synthesis. InForty-first international conference on machine learning, 2024
2024
-
[37]
Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models
Samuele Poppi, Tobia Poppi, Federico Cocchi, Marcella Cornia, Lorenzo Baraldi, and Rita Cucchiara. Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models. In Proceedings of the European Conference on Computer Vision, 2024
2024
-
[38]
Yu-Lin Tsai, Chia-Yi Hsu, Chulin Xie, Chih-Hsun Lin, Jia-You Chen, Bo Li, Pin-Yu Chen, Chia-Mu Yu, and Chun-Ying Huang. Ring-a-bell! how reliable are concept removal methods for diffusion models?arXiv preprint arXiv:2310.10012, 2023
Pith/arXiv arXiv 2023
-
[39]
SAFREE: Training- free and adaptive guard for safe text-to-image and video generation
Jaehong Yoon, Shoubin Yu, Vaidehi Patil, Huaxiu Yao, and Mohit Bansal. SAFREE: Training- free and adaptive guard for safe text-to-image and video generation. InThe Thirteenth Interna- tional Conference on Learning Representations, 2025
2025
-
[40]
Training-free safe denoisers for safe use of diffusion models
Mingyu Kim, Dongjun Kim, Amman Yusuf, Stefano Ermon, and Mijung Park. Training-free safe denoisers for safe use of diffusion models. InAdvances in Neural Information Processing Systems, volume 38, 2025
2025
-
[41]
Z-Image Team, Huanqia Cai, Sihan Cao, Ruoyi Du, Peng Gao, Aiming Hao, Steven C. H. Hoi, Zhaohui Hou, Shijie Huang, Dengyang Jiang, Yuming Jiang, Xin Jin, Liangchen Li, et al. Z-Image: An efficient image generation foundation model with single-stream diffusion transformer.arXiv preprint arXiv:2511.22699, 2025
Pith/arXiv arXiv 2025
-
[42]
Classifier-free guidance is a predictor-corrector.Trans- actions on Machine Learning Research, 2025
Arwen Bradley and Preetum Nakkiran. Classifier-free guidance is a predictor-corrector.Trans- actions on Machine Learning Research, 2025
2025
-
[43]
Badr Moufad, Yazid Janati, Alain Durmus, Ahmed Ghorbel, Eric Moulines, and Jimmy Ols- son. Conditional diffusion models with classifier-free gibbs-like guidance.arXiv preprint arXiv:2505.21101, 2025
Pith/arXiv arXiv 2025
-
[44]
Guiding a diffusion model with a bad version of itself.Advances in Neural Information Processing Systems, 37:52996–53021, 2024
Tero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen, Timo Aila, and Samuli Laine. Guiding a diffusion model with a bad version of itself.Advances in Neural Information Processing Systems, 37:52996–53021, 2024
2024
-
[45]
Applying guidance in a limited interval improves sample and distribution quality in diffusion models
Tuomas Kynkäänniemi, Miika Aittala, Tero Karras, Samuli Laine, Timo Aila, and Jaakko Lehtinen. Applying guidance in a limited interval improves sample and distribution quality in diffusion models. InAdvances in Neural Information Processing Systems, 2024
2024
-
[46]
Cfg++: Manifold-constrained classifier free guidance for diffusion models
Hyungjin Chung, Jeongsol Kim, Geon Yeong Park, Hyelin Nam, and Jong Chul Ye. Cfg++: Manifold-constrained classifier free guidance for diffusion models. InThe Thirteenth Interna- tional Conference on Learning Representations, 2025
2025
-
[47]
Seyedmorteza Sadat, Otmar Hilliges, and Romann M. Weber. Eliminating oversaturation and artifacts of high guidance scales in diffusion models. InThe Thirteenth International Conference on Learning Representations, 2025
2025
-
[48]
Weichen Fan, Amber Yijia Zheng, Raymond A. Yeh, and Ziwei Liu. Cfg-zero*: Improved classifier-free guidance for flow matching models.arXiv preprint arXiv:2503.18886, 2025
Pith/arXiv arXiv 2025
-
[49]
Angle domain guidance: Latent diffusion requires rotation rather than extrapolation
Cheng Jin, Zhenyu Xiao, Chutao Liu, and Yuantao Gu. Angle domain guidance: Latent diffusion requires rotation rather than extrapolation. InInternational Conference on Machine Learning, pages 28187–28212. PMLR, 2025. 12
2025
-
[50]
Dynamic negative guidance of diffusion models
Felix Koulischer, Johannes Deleu, Gabriel Raya, Thomas Demeester, and Luca Ambrogioni. Dynamic negative guidance of diffusion models. InThe Thirteenth International Conference on Learning Representations, 2025
2025
-
[51]
Compositional visual generation with energy-based models
Yilun Du, Shuang Li, and Igor Mordatch. Compositional visual generation with energy-based models. InAdvances in Neural Information Processing Systems, 2020
2020
-
[52]
Tenenbaum
Nan Liu, Shuang Li, Yilun Du, Antonio Torralba, and Joshua B. Tenenbaum. Compositional visual generation with composable diffusion models. InEuropean Conference on Computer Vision, 2022
2022
-
[53]
Sega: Instructing text-to-image models using semantic guidance
Manuel Brack, Felix Friedrich, Dominik Hintersdorf, Lukas Struppek, Patrick Schramowski, and Kristian Kersting. Sega: Instructing text-to-image models using semantic guidance. In Advances in Neural Information Processing Systems, 2023
2023
-
[54]
Erasing concepts from diffusion models
Rohit Gandikota, Joanna Materzynska, Jaden Fiotto-Kaufman, and David Bau. Erasing concepts from diffusion models. InProceedings of the IEEE/CVF International Conference on Computer Vision, 2023
2023
-
[55]
Unified concept editing in diffusion models
Rohit Gandikota, Hadas Orgad, Yonatan Belinkov, Joanna Materzynska, and David Bau. Unified concept editing in diffusion models. InWinter Conference on Applications of Computer Vision (WACV), 2024
2024
-
[56]
Mace: Mass concept erasure in diffusion models
Shilin Lu, Zilan Wang, Leyang Li, Yanzhu Liu, and Adams Wai-Kin Kong. Mace: Mass concept erasure in diffusion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024
2024
-
[57]
Defensive unlearning with adversarial training for robust concept erasure in diffusion models
Yimeng Zhang, Xin Chen, Jinghan Jia, Yihua Zhang, Chongyu Fan, Jiancheng Liu, Mingyi Hong, Ke Ding, and Sijia Liu. Defensive unlearning with adversarial training for robust concept erasure in diffusion models. InAdvances in Neural Information Processing Systems, 2024
2024
-
[58]
SAeuron: Interpretable concept unlearning in diffusion models with sparse autoencoders
Bartosz Cywi´nski and Kamil Deja. SAeuron: Interpretable concept unlearning in diffusion models with sparse autoencoders. InForty-Second International Conference on Machine Learning, 2025
2025
-
[59]
Extracting training data from diffusion models
Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, and Eric Wallace. Extracting training data from diffusion models. In32nd USENIX Security Symposium (USENIX Security 23), pages 5253–5270, 2023
2023
-
[60]
Diffu- sion art or digital forgery? investigating data replication in diffusion models
Gowthami Somepalli, Vasu Singla, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Diffu- sion art or digital forgery? investigating data replication in diffusion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023
2023
-
[61]
Understanding and mitigating copying in diffusion models
Gowthami Somepalli, Vasu Singla, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Understanding and mitigating copying in diffusion models. InAdvances in Neural Information Processing Systems, 2023
2023
-
[62]
Detecting, explaining, and mitigating memorization in diffusion models
Yuxin Wen, Yuchen Liu, Chen Chen, and Lingjuan Lyu. Detecting, explaining, and mitigating memorization in diffusion models. InThe Twelfth International Conference on Learning Representations, 2024
2024
-
[63]
Differentially private diffusion models.Transactions on Machine Learning Research, 2023
Tim Dockhorn, Tianshi Cao, Arash Vahdat, and Karsten Kreis. Differentially private diffusion models.Transactions on Machine Learning Research, 2023
2023
-
[64]
Dimakis, and Adam Klivans
Giannis Daras, Kulin Shah, Yuval Dagan, Aravind Gollakota, Alexandros G. Dimakis, and Adam Klivans. Ambient diffusion: Learning clean distributions from corrupted data. In Advances in Neural Information Processing Systems, 2023
2023
-
[65]
Classifier-free guidance inside the attraction basin may cause memorization
Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir Memon, Julian Togelius, and Yuki Mitsufuji. Classifier-free guidance inside the attraction basin may cause memorization. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025. 13
2025
-
[66]
Seyedmorteza Sadat, Jakob Buhmann, Derek Bradley, Otmar Hilliges, and Romann M. Weber. Cads: Unleashing the diversity of diffusion models through condition-annealed sampling. In The Twelfth International Conference on Learning Representations, 2024
2024
-
[67]
Cambridge University Press, 2012
Masashi Sugiyama, Taiji Suzuki, and Takafumi Kanamori.Density Ratio Estimation in Machine Learning. Cambridge University Press, 2012
2012
-
[68]
Gutmann and Aapo Hyvärinen
Michael U. Gutmann and Aapo Hyvärinen. Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics.Journal of Machine Learning Research, 13:307–361, 2012
2012
-
[69]
Density ratio estimation via infinitesimal classification
Kristy Choi, Chenlin Meng, Yang Song, and Stefano Ermon. Density ratio estimation via infinitesimal classification. InInternational Conference on Artificial Intelligence and Statistics, 2022
2022
-
[70]
Refining generative process with discriminator guidance in score-based diffusion models
Dongjun Kim, Yeongmin Kim, Se Jung Kwon, Wanmo Kang, and Il-Chul Moon. Refining generative process with discriminator guidance in score-based diffusion models. InInternational Conference on Machine Learning, 2023
2023
-
[71]
Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. Neural ordinary differential equations. InAdvances in Neural Information Processing Systems, 2018
2018
-
[72]
Will Grathwohl, Ricky T. Q. Chen, Jesse Bettencourt, Ilya Sutskever, and David Duvenaud. Ffjord: Free-form continuous dynamics for scalable reversible generative models. InInterna- tional Conference on Learning Representations, 2019
2019
-
[73]
Diffusion-npo: Negative preference optimization for better preference-aligned generation of diffusion models
Fu-Yun Wang, Yunhao Shui, Jingtan Piao, Keqiang Sun, and Hongsheng Li. Diffusion-npo: Negative preference optimization for better preference-aligned generation of diffusion models. InThe Thirteenth International Conference on Learning Representations, 2025
2025
-
[74]
Michael S Albergo, Nicholas M Boffi, and Eric Vanden-Eijnden. Stochastic interpolants: A unifying framework for flows and diffusions.arXiv preprint arXiv:2303.08797, 2023
Pith/arXiv arXiv 2023
-
[75]
Adam: A method for stochastic optimization.arXiv preprint arXiv:1412.6980, 2014
Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization.arXiv preprint arXiv:1412.6980, 2014
Pith/arXiv arXiv 2014
-
[76]
Representation alignment for generation: Training diffusion transformers is easier than you think
Sihyun Yu, Sangkyung Kwak, Huiwon Jang, Jongheon Jeong, Jonathan Huang, Jinwoo Shin, and Saining Xie. Representation alignment for generation: Training diffusion transformers is easier than you think. InThe Thirteenth International Conference on Learning Representations, 2025
2025
-
[77]
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale.arXiv preprint arXiv:2010.11929, 2020
Pith/arXiv arXiv 2010
-
[78]
Scalable diffusion models with transformers
William Peebles and Saining Xie. Scalable diffusion models with transformers. InProceedings of the IEEE/CVF international conference on computer vision, pages 4195–4205, 2023
2023
-
[79]
Decoupled weight decay regularization.arXiv preprint arXiv:1711.05101, 2017
Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization.arXiv preprint arXiv:1711.05101, 2017. A Related Work Inference-time guidance and its target distribution.Classifier guidance augments the diffusion score with the gradient of an external classifier, whereas classifier-free guidance (CFG) forms an affine combination of conditional and...
Pith/arXiv arXiv 2017
-
[80]
3.3, we construct a separate analytic negative branch for each ImageNet class
/ one_minus_t[:, None] 53velocity = velocity_flat.reshape(x_shape) 54 55if not return_logp: 56return velocity, None 57 58log_mixture = ( 59torch.logsumexp(log_weights.float(), dim=1) 60- math.log(float(num_data)) 61) 62log_normalizer = ( 63-0.5 * latent_dim * math.log(2.0 * math.pi) 64- latent_dim * torch.log(one_minus_t.float()) 65) 66logp = log_mixture ...
2048
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.