REVIEW 5 cited by
LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Layout-to-image generation refers to the task of synthesizing photo-realistic images based on semantic layouts. In this paper, we propose LayoutDiffuse that adapts a foundational diffusion model pretrained on large-scale image or text-image datasets for layout-to-image generation. By adopting a novel neural adaptor based on layout attention and task-aware prompts, our method trains efficiently, generates images with both high perceptual quality and layout alignment, and needs less data. Experiments on three datasets show that our method significantly outperforms other 10 generative models based on GANs, VQ-VAE, and diffusion models.
Forward citations
Cited by 5 Pith papers
-
FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation
A frequency-guided layout-to-image generation framework, FICGen, improves fidelity, layout alignment, and detector trainability on degraded scenes across five benchmarks.
-
DIVE: Inverting Conditional Diffusion Models for Discriminative Tasks
A frozen conditional diffusion model can be inverted via gradient-based discrete optimization, plus a learned layout prior, to perform object detection and faster classification without training a discriminative head.
-
ComposeAnyone: Controllable Layout-to-Human Generation with Decoupled Multimodal Conditions
ComposeAnyone generates human images by conditioning a diffusion model on hand-drawn color-block layouts together with decoupled text or reference-image descriptions for each body part.
-
Why Settle for Mid: A Probabilistic Viewpoint to Spatial Relationship Alignment in Text-to-image Models
A probabilistic overlap measure for object positions yields a human-aligned spatial relationship metric and a training-free generation guidance method for text-to-image models.
-
Dense-Face: Personalized Face Generation Model via Dense Annotation Prediction
Dense-Face is a personalized face generation model that adds a pose-controllable adapter and dense face annotation prediction to Stable Diffusion, improving identity preservation and text alignment.
Discussion (0). Continue with ORCID to comment.