REVIEW 4 cited by
Noise-Free Score Distillation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Score Distillation Sampling (SDS) has emerged as the de facto approach for text-to-content generation in non-image domains. In this paper, we reexamine the SDS process and introduce a straightforward interpretation that demystifies the necessity for large Classifier-Free Guidance (CFG) scales, rooted in the distillation of an undesired noise term. Building upon our interpretation, we propose a novel Noise-Free Score Distillation (NFSD) process, which requires minimal modifications to the original SDS framework. Through this streamlined design, we achieve more effective distillation of pre-trained text-to-image diffusion models while using a nominal CFG scale. This strategic choice allows us to prevent the over-smoothing of results, ensuring that the generated data is both realistic and complies with the desired prompt. To demonstrate the efficacy of NFSD, we provide qualitative examples that compare NFSD and SDS, as well as several other methods.
Forward citations
Cited by 4 Pith papers
-
A Lesson in Splats: Teacher-Guided Diffusion for 3D Gaussian Splats Generation with 2D Supervision
A 3D Gaussian Splat diffusion model trained with only 2D image supervision, using deterministic reconstruction models as noisy teachers, improves single-image 3D reconstruction over those teachers.
-
PixSDS: Why Latent SDS Makes Noisy Pixels
Pixel artifacts in latent SDS are caused by VAE-induced pixel drift, and decoding the latent SDS lookahead provides a clean gradient direction that reduces them.
-
StochSync: Stochastic Diffusion Synchronization for Image Generation in Arbitrary Spaces
StochSync generates images on arbitrary surfaces such as spheres and meshes by alternating non-overlapping denoised views, maximum stochasticity, and multi-step clean-image prediction from a pretrained diffusion model.
-
DreamDPO: Aligning Text-to-3D Generation with Human Preferences via Direct Preference Optimization
Applying pairwise direct preference optimization to score distillation makes text-to-3D outputs better aligned with human preferences and more controllable.
Discussion (0). Continue with ORCID to comment.