REVIEW 6 cited by
Wuerstchen: An Efficient Architecture for Large-Scale Text-to-Image Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce W\"urstchen, a novel architecture for text-to-image synthesis that combines competitive performance with unprecedented cost-effectiveness for large-scale text-to-image diffusion models. A key contribution of our work is to develop a latent diffusion technique in which we learn a detailed but extremely compact semantic image representation used to guide the diffusion process. This highly compressed representation of an image provides much more detailed guidance compared to latent representations of language and this significantly reduces the computational requirements to achieve state-of-the-art results. Our approach also improves the quality of text-conditioned image generation based on our user preference study. The training requirements of our approach consists of 24,602 A100-GPU hours - compared to Stable Diffusion 2.1's 200,000 GPU hours. Our approach also requires less training data to achieve these results. Furthermore, our compact latent representations allows us to perform inference over twice as fast, slashing the usual costs and carbon footprint of a state-of-the-art (SOTA) diffusion model significantly, without compromising the end performance. In a broader comparison against SOTA models our approach is substantially more efficient and compares favorably in terms of image quality. We believe that this work motivates more emphasis on the prioritization of both performance and computational accessibility.
Forward citations
Cited by 6 Pith papers
-
Importance-Aware OBS Pruning for Diffusion Models
Injecting spatial importance maps (e.g., CFG delta) into the OBS Hessian improves subject preservation in pruned diffusion models at high sparsity, but gains over the baseline are small and without error bars.
-
Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformer
Expressing all RoPE positions on the query's grid ('one attention, one scale') plus a small boundary content-exchange step restores mixed-resolution diffusion generation that naive position interpolation destroys.
-
Exploring Probabilistic Modeling Beyond Domain Generalization for Semantic Segmentation
PDAF estimates a latent domain prior with a lightweight diffusion model and uses it to condition segmentation features, improving domain-generalized semantic segmentation on four unseen urban datasets.
-
Efficient and Robust Semantic Image Communication via Stable Cascade
A Stable Cascade based semantic image communication system transmits a compact image embedding (0.29% of original size) over noisy channels and reconstructs images faster and with better perceptual quality than GESCO,...
-
Instant Preference Alignment for Text-to-Image Diffusion Models
An MLLM-driven, training-free pipeline extracts preference keywords from a reference image and modulates diffusion cross-attention at global and regional levels for instant, multi-round preference-aligned image generation.
-
Practical, Generalizable and Robust Backdoor Attacks on Text-to-Image Diffusion Models
The abstract claims that 10 poisoned samples can backdoor multiple text-to-image models with over 90% attack success and resistance to defenses, but the supplied body is a different paper.
Discussion (0). Sign in to comment.