REVIEW 11 cited by
Steering Rectified Flow Models in the Vector Field for Controlled Image Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Steering Rectified Flow Models in the Vector Field for Controlled Image Generation
read the original abstract
Diffusion models (DMs) excel in photorealism, image editing, and solving inverse problems, aided by classifier-free guidance and image inversion techniques. However, rectified flow models (RFMs) remain underexplored for these tasks. Existing DM-based methods often require additional training, lack generalization to pretrained latent models, underperform, and demand significant computational resources due to extensive backpropagation through ODE solvers and inversion processes. In this work, we first develop a theoretical and empirical understanding of the vector field dynamics of RFMs in efficiently guiding the denoising trajectory. Our findings reveal that we can navigate the vector field in a deterministic and gradient-free manner. Utilizing this property, we propose FlowChef, which leverages the vector field to steer the denoising trajectory for controlled image generation tasks, facilitated by gradient skipping. FlowChef is a unified framework for controlled image generation that, for the first time, simultaneously addresses classifier guidance, linear inverse problems, and image editing without the need for extra training, inversion, or intensive backpropagation. Finally, we perform extensive evaluations and show that FlowChef significantly outperforms baselines in terms of performance, memory, and time requirements, achieving new state-of-the-art results. Project Page: \url{https://flowchef.github.io}.
Forward citations
Cited by 11 Pith papers
-
Do Unified Multimodal Models Think in One Space? A Lens Through Cross-Branch Steering
Steering vectors from the understanding branch can control image generation, but vectors from the generation branch cannot control understanding, showing UMMs are architecturally unified but representationally asymmetric.
-
Garment Particles: A 2D--3D Symmetric Garment Representation for Generation and Editing
Garment Particles is a 5D point cloud representation jointly encoding 2D sewing patterns and 3D geometry, supporting rectified flow generation from high-level inputs and diffusion-based editing of patterns or shapes.
-
Efficient Zero-Shot Inpainting with Decoupled Diffusion Guidance
A new decoupled diffusion guidance method enables efficient zero-shot inpainting by avoiding backpropagation through the denoiser while maintaining observation consistency and quality.
-
Delta Rectified Flow Sampling for Text-to-Image Editing
DRFS is a new inversion-free editing technique for rectified flow models that models source-target velocity discrepancies and applies a time-dependent shift to improve fidelity and unify prior methods like DDS and FlowEdit.
-
UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Models
UniEdit-Flow presents tuning-free Uni-Inv and Uni-Edit methods for inversion and editing in flow models that achieve accurate reconstruction and robust region-preserving edits across generative models.
-
PG-MAP: Joint MAP Optimization for Inference-Time Alignment of Diffusion and Flow-Matching Models
PG-MAP formulates inference-time alignment as joint MAP optimization over conditioning c and latent z_t via forward-consistency coupling for diffusion and flow-matching models, reporting gains in PickScore and HPS metrics.
-
RL-RIG: A Generative Spatial Reasoner via Intrinsic Reflection
RL-RIG uses a generate-reflect-edit loop with reinforcement learning to improve spatial accuracy in image generation, reporting up to 11% gains over prior open-source models on scene-graph metrics.
-
FlowLPS: Langevin-Proximal Sampling for Flow-based Inverse Problem Solvers
FlowLPS perturbs flow-model estimates with Langevin steps then applies proximal refinement to balance fidelity and perceptual quality on linear inverse problems.
-
Saving Foundation Flow-Matching Priors for Inverse Problems
FMPlug adapts foundation flow-matching models into practical priors for inverse problems by combining instance-guided warm-start with sharp Gaussianity regularization, showing superior results on image restoration and...
-
DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models
Noise-perturbed condition injection plus contrastive trajectory refinement improves training-free conditional diffusion sampling across style transfer, super-resolution and deblurring.
-
Stochastic Optimal Control Sampling for Diffusion Inverse Problems
SOCS derives per-step closed-form control signals from stochastic optimal control to steer diffusion sampling trajectories toward measurements while preserving the generative prior.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.