REVIEW 7 cited by
A Variational Perspective on Solving Inverse Problems with Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-training for each task. Most inverse tasks can be formulated as inferring a posterior distribution over data (e.g., a full image) given a measurement (e.g., a masked image). This is however challenging in diffusion models since the nonlinear and iterative nature of the diffusion process renders the posterior intractable. To cope with this challenge, we propose a variational approach that by design seeks to approximate the true posterior distribution. We show that our approach naturally leads to regularization by denoising diffusion process (RED-Diff) where denoisers at different timesteps concurrently impose different structural constraints over the image. To gauge the contribution of denoisers from different timesteps, we propose a weighting mechanism based on signal-to-noise-ratio (SNR). Our approach provides a new variational perspective for solving inverse problems with diffusion models, allowing us to formulate sampling as stochastic optimization, where one can simply apply off-the-shelf solvers with lightweight iterates. Our experiments for image restoration tasks such as inpainting and superresolution demonstrate the strengths of our method compared with state-of-the-art sampling-based diffusion models.
Forward citations
Cited by 7 Pith papers
-
Solving Inverse Problems with Flow-based Models via Model Predictive Control
MPC-Flow applies model predictive control to guide pretrained flow models through inverse problems, with a single-step variant that avoids backpropagation and scales to 32B-parameter models on consumer hardware.
-
Jacobian-Aware Posterior Sampling for Inverse Problems
AdaPS adaptively scales likelihood guidance in DDIM posterior sampling via agreement between two surrogates, improving LPIPS/PSNR trade-offs on image restoration tasks without task-specific tuning.
-
PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models
PnP-DA combines a lightweight variational observation update with a pretrained conditional flow-matching denoiser to reduce analysis error in chaotic data assimilation, outperforming 3D-Var on Lorenz 63, Lorenz 96, an...
-
Advancing Text-to-3D Generation with Linearized Lookahead Variational Score Distillation
Updating the LoRA score model one step ahead of the 3D model and keeping only the first-order correction term yields L2-VSD, a stable and higher-quality variant of VSD for text-to-3D generation.
-
Provable diffusion-based posterior sampling for linear inverse problems via DDIM
A SVD-based, coordinate-wise DDIM sampler is claimed to asymptotically sample from the posterior for noisy linear inverse problems, but the proof's posterior identification step does not follow from the stated updates.
-
Towards Realistic Hand-Object Interaction with Gravity-Field Based Diffusion Bridge
A gravity-field and diffusion-based optimization refines hand-object contacts to reduce interpenetration and gaps while LLM text prompts guide contact regions.
-
Local MAP Sampling for Diffusion Models
LMAPS frames reverse-diffusion inverse-problem solving as repeated local MAP estimation, unifying existing optimization-based solvers, and achieves strong PSNR gains on tasks like motion deblurring, JPEG restoration, ...
Discussion (0). Sign in to comment.