REVIEW 57 cited by
Pseudo Numerical Methods for Diffusion Models on Manifolds
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quality samples such as image and audio samples. However, DDPMs require hundreds to thousands of iterations to produce final samples. Several prior works have successfully accelerated DDPMs through adjusting the variance schedule (e.g., Improved Denoising Diffusion Probabilistic Models) or the denoising equation (e.g., Denoising Diffusion Implicit Models (DDIMs)). However, these acceleration methods cannot maintain the quality of samples and even introduce new noise at a high speedup rate, which limit their practicability. To accelerate the inference process while keeping the sample quality, we provide a fresh perspective that DDPMs should be treated as solving differential equations on manifolds. Under such a perspective, we propose pseudo numerical methods for diffusion models (PNDMs). Specifically, we figure out how to solve differential equations on manifolds and show that DDIMs are simple cases of pseudo numerical methods. We change several classical numerical methods to corresponding pseudo numerical methods and find that the pseudo linear multi-step method is the best in most situations. According to our experiments, by directly using pre-trained models on Cifar10, CelebA and LSUN, PNDMs can generate higher quality synthetic images with only 50 steps compared with 1000-step DDIMs (20x speedup), significantly outperform DDIMs with 250 steps (by around 0.4 in FID) and have good generalization on different variance schedules. Our implementation is available at https://github.com/luping-liu/PNDM.
Forward citations
Cited by 57 Pith papers
-
Generalization through variance: how noise shapes inductive biases in diffusion models
Diffusion model generalization is explained by the covariance of the noisy score-matching target, which adds state-dependent noise to sampling and fills gaps in the training distribution.
-
Structured Local Differential Modeling for AI-Generated Image Detection
RippleNet detects AI-generated images by encoding multi-directional, multi-scale local pixel differences and using attention over those differences, achieving state-of-the-art cross-generator accuracy in the reported ...
-
XYZFlow:Scaling Multi dimensional Shortcut Flows for Efficient Generative Modeling
Conditioning each patch's denoising on the full trajectories of earlier patches lets XYZFlow generate ImageNet images with FID 1.22 to 1.63 in only 2 to 5 steps per patch, at 7.2 to 8.5x teacher speedups.
-
LHSDet: High-Resolution AI-Generated Image Detection via Visual Question Answering
LHSDet detects AI-generated images by fusing low-level texture features, SigLIP2 global features, and BLIP-2 captions in a visual question answering framework, reaching 96% average cross-model accuracy.
-
FARI: Robust One-Step Inversion for Watermarking in Diffusion Models
One-step adversarially LoRA-tuned inversion exploits low-curvature reverse trajectories to beat 50-step DDIM on watermark robustness after ~20 minutes of fine-tuning.
-
Importance-Aware OBS Pruning for Diffusion Models
Injecting spatial importance maps (e.g., CFG delta) into the OBS Hessian improves subject preservation in pruned diffusion models at high sparsity, but gains over the baseline are small and without error bars.
-
RoughNet: Mapping Arctic Sea Ice Roughness Using Diffusion-Based Super-Resolution of Satellite Imagery
A conditional diffusion model maps Sentinel-2 optical imagery to 1 m sea-ice roughness residuals with ~9 cm RMSE on an unseen region, though pointwise correlation is weak (ZNCC≈0.11).
-
OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction
Ontology-aware contrastive pretraining plus note-to-vitals distillation improves MIMIC ICU risk and length-of-stay prediction using only vital signs at inference.
-
Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
Grouping related text prompts into a tree and sharing early denoising steps with averaged embeddings saves 50 to 74 percent of diffusion compute on image-embedding-conditioned models while keeping VQA quality essentia...
-
CEIDM: A Controlled Entity and Interaction Diffusion Model for Enhanced Text-to-Image Generation
A training-free extension of InteractDiffusion that uses LLM-mined relations, action feature offsets, and entity masks to improve entity and interaction control in generated images.
-
MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation
MPQ-DMv2 adds binary residual quantization, temporal relation distillation, and SVD-initialized LoRA to mixed-precision quantization, improving low-bit diffusion model generation quality.
-
Domain Generalizable Portrait Style Transfer
A diffusion-based portrait style transfer method that uses semantic face alignment and an AdaIN-Wavelet latent blend to transfer style across photo, cartoon, sketch, and animation domains while preserving identity.
-
Dual-Expert Consistency Model for Efficient and High-Quality Video Generation
By training a semantic expert and a LoRA-based detail expert, DCM reaches nearly teacher-level VBench scores with 4-step video sampling on HunyuanVideo and CogVideoX.
-
Efficiently Access Diffusion Fisher: Within the Outer Product Span Space
The diffusion Fisher matrix of a Gaussian-perturbed distribution is expressed in the span of data outer products, enabling two faster approximation algorithms for trace and matrix-vector access.
-
Pioneering 4-Bit FP Quantization for Diffusion Models: Mixup-Sign Quantization and Timestep-Aware Fine-Tuning
A mix of signed and unsigned 4-bit floating-point formats, timestep-aware LoRA experts, and a denoising-weighted loss keeps diffusion-model image quality close to full precision.
-
DiSA: Diffusion Step Annealing in Autoregressive Image Generation
Autoregressive image diffusion models can use far fewer denoising steps for later tokens without losing quality, yielding 1.4-2.5x speedup from step annealing and up to 10x when combined with fewer autoregressive steps.
-
MaRS: A Fast Sampler for Mean Reverting Diffusion based on ODE and SDE Solvers
MR Sampler derives semi-analytical solutions to the reverse-time SDE and PF-ODE of Mean Reverting Diffusion, enabling 5-10 step high-quality sampling instead of hundreds.
-
Masked Generative Nested Transformers with Decode Time Scaling
MaGNeTS schedules progressively larger nested transformer sub-models over decode iterations and caches key-value pairs of unmasked tokens, achieving 2.5-3.7x compute reduction with competitive FID/FVD.
-
Ditto: Accelerating Diffusion Model via Temporal Value Similarity
Diffusion model inference can be accelerated by computing only the small differences between adjacent time steps, with reduced bit-width and zero-skipping, at moderate accuracy loss.
-
MObI: Multimodal Object Inpainting Using Diffusion Models
MObI jointly inpaints camera and lidar views of driving scenes, inserting objects from a single reference image at a user-specified 3D bounding box.
-
Dissecting Bit-Level Scaling Laws in Quantizing Vision Generative Models
Token-based language-style vision models (VAR, LlamaGen) tolerate quantization better than diffusion models, and a custom TopKLD distillation loss pushes their low-bit scaling roughly one precision level higher.
-
Token Pruning for Caching Better: 9 Times Acceleration on Stable Diffusion for Free
DaTo combines dynamics-aware token pruning with feature caching and a searched per-step schedule, reaching 9x faster Stable Diffusion inference without FID loss.
-
An Ordinary Differential Equation Sampler with Stochastic Start for Diffusion Bridge Models
A stochastic-start ODE sampler for diffusion bridge models avoids the singular start of the probability-flow ODE and beats prior samplers with fewer neural network evaluations.
-
PixelMan: Consistent Object Editing with Diffusion Models via Pixel Manipulation and Generation
An inversion-free, training-free diffusion editing method that anchors output latents to a pixel-manipulated copy of the image achieves consistent object repositioning, resizing, and pasting in 16 steps.
-
The Unreasonable Effectiveness of Gaussian Score Approximation for Diffusion Models and its Applications
Learned diffusion score fields behave like Gaussian score fields at high noise, enabling an analytical 'teleportation' that skips early sampling steps without hurting FID.
-
UniPaint: Unified Space-time Video Inpainting via Mixture-of-Experts
UniPaint unifies video inpainting, outpainting, and frame interpolation in a single diffusion-based model with MoE attention and mixed-mask training.
-
BiDM: Pushing the Limit of Quantization for Diffusion Models
BiDM achieves the first fully binarized (W1A1) diffusion model, with FID 22.74 on LSUN-Bedrooms, by adding timestep-aware binary structures and patch-based distillation.
-
BudgetFusion: Perceptually-Guided Adaptive Diffusion Models
A prompt-adaptive model selects the minimum denoising step count that reaches perceptual quality saturation, saving about 5 seconds per image with no detectable quality loss.
-
Cross-Attention Head Position Patterns Can Align with Human Visual Concepts in Text-to-Image Generative Models
Head Relevance Vectors, built by counting which attention head best matches each of 34 concept words, reveal concept-specific cross-attention head patterns and enable targeted concept steering in Stable Diffusion.
-
Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient
CoDe speeds up Visual Auto-Regressive image generation by using a 2B model for early coarse scales and a 0.3B model for later fine scales, with 1.7x-2.9x speedup and only a small FID increase.
-
Importance-Based Token Merging for Efficient Image and Video Generation
A token-merging method that anchors computation on high-CFG-importance tokens improves generation quality at fixed inference speedups.
-
Gradient-Free Classifier Guidance for Diffusion Model Sampling
A gradient-free diffusion sampler that selects a reference class from a pretrained classifier's predictions and adapts guidance strength improves class-conditional fidelity, but its Precision gains are measured with t...
-
Generating Compositional Scenes via Text-to-image RGBA Instance Generation
A multi-stage text-to-image approach that generates individual objects as RGBA images and composes them scene-by-scene via noise blending, enabling fine-grained layout and attribute control.
-
DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models
Noise-perturbed condition injection plus contrastive trajectory refinement improves training-free conditional diffusion sampling across style transfer, super-resolution and deblurring.
-
VarDiU: A Variational Diffusive Upper Bound for One-Step Diffusion Distillation
VarDiU optimizes a variational upper bound on the diffusive KL divergence with an unbiased gradient estimator, improving one-step generation on a 2D 40-Gaussian toy benchmark compared with Diff-Instruct.
-
TimeMachine: Fine-Grained Facial Age Editing with Identity Preservation
TimeMachine proposes a diffusion model with age-aware cross-attention and a latent age classifier, plus a 1M-image HFFA dataset, claiming SOTA age editing with identity preservation.
-
SD-Acc: Accelerating Stable Diffusion through Phase-aware Sampling and Hardware Co-Optimizations
Phase-aware sampling cuts Stable Diffusion's compute by roughly 2.4x to 5.7x with only small CLIP-score changes, and the accompanying FPGA accelerator turns this into 2.7x to 6.0x energy savings over an Nvidia V100 GPU.
-
Cost-Aware Routing for Efficient Text-To-Image Generation
A cost-aware router selects per prompt the best among nine pre-trained text-to-image models, beating every single model on the quality-versus-cost frontier.
-
Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
A weighted-particle sampler evolves the posterior through the diffusion model's reverse dynamics, with theoretical error bounds and improved image reconstructions.
-
Unleashing High-Quality Image Generation in Diffusion Sampling Using Second-Order Levenberg-Marquardt-Langevin
A training-free 'Levenberg-Marquardt-Langevin' diffusion sampler is claimed to improve image FID, but its update rule collapses to that of the baseline DPM-Solver for the parameter values used in the paper.
-
Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Models
Training a diffusion model on reversed preference pairs and using it as the negative CFG predictor improves human-preference alignment over standard preference-tuned models.
-
Towards Generalized and Training-Free Text-Guided Semantic Manipulation
GTF is a training-free, projection-based noise composition rule that enables text-driven addition, removal, and style transfer in diffusion models across image, video, and 3D generation.
-
D$^2$-DPM: Dual Denoising for Quantized Diffusion Probabilistic Models
Modeling quantization noise in compressed diffusion models as a time-step-dependent joint Gaussian, then correcting its mean and variance during sampling, improves FID over prior PTQ methods and can beat the full-prec...
-
Cached Adaptive Token Merging: Dynamic Token Reduction and Redundant Computation Elimination in Diffusion Model
CA-ToMe speeds up Stable Diffusion inference by adaptively merging similar tokens and caching merge pairs, reaching 6.09s average generation time with FID 34.05 on ImageNet.
-
LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers
LazyDiT learns small gates that decide when to reuse cached layer outputs, cutting diffusion transformer compute by up to half while matching or beating DDIM quality.
-
A Survey on the Applications of Generative Artificial Intelligence in Automated Driving Systems Test Scenario Generation Methods
A literature survey of scenario-generation methods for ADS testing that adds an unvalidated AII/RAS/OCS metric suite and ODD-difficulty schema, undermined by inconsistent calculations in the worked examples.
-
Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Models
Joint training of autoencoders with diffusion models in latent space gives stochastic turbulence closure accuracy close to physical-space diffusion models at roughly 5-7x lower cost.
-
Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
Dive3D shows that replacing KL divergence with score implicit matching in text-to-3D distillation, together with a reward term, produces more diverse and higher-fidelity 3D assets than SDS and ProlificDreamer baselines.
-
SynBoost: A Synergistic Framework for Fast Sampling of Diffusion Models
A training-free correction that blends each step's noise estimate with the initial noise estimate improves few-step diffusion sampling across DDIM, DPM-Solver, and DPM-Solver++.
-
Latent Behavior Diffusion for Sequential Reaction Generation in Dyadic Setting
A latent diffusion model with a context-aware autoencoder generates more diverse and synchronized listener facial reactions on REACT2024 than four comparison methods, at the cost of a slightly worse reaction-distance score.
-
Image Watermarking of Generative Diffusion Models
A new watermarking scheme for diffusion models trains an autoencoder to embed and recover image watermarks through the generation process, but the reported robustness is undermined by flawed evaluation and an unjustif...
-
Grounding Text-to-Image Diffusion Models for Controlled High-Quality Image Generation
Combining ControlNet and GLIGEN, ObjectDiffusion conditions Stable Diffusion on bounding boxes and open-ended object names, reporting improved AP50, AR, and FID on COCO2017.
-
Efficiency Meets Fidelity: A Novel Quantization Framework for Stable Diffusion
A serial-to-parallel distillation pipeline with per-timestep activation quantization makes W4A8 quantized Stable Diffusion models generate images much closer to the full-precision model than prior PTQ methods.
-
Towards Chunk-Wise Generation for Long Videos
A k-step search over initial noises reduces quality drift in autoregressive chunk-by-chunk video generation, especially for small image-to-video models.
-
Pretrained Diffusion Models Are Inherently Skipped-Step Samplers
A DDPM-trained noise predictor can denoise across several time steps in one update because the multi-step posterior is Gaussian and uses the same network.
-
Diffusion Model Quantization: A Review
A structured review and benchmark of methods for quantizing diffusion models, with a taxonomy of post-training and quantization-aware approaches and an analysis of quantization artifacts.
- SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models
Discussion (0). Continue with ORCID to comment.