REVIEW 5 cited by
Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distribution. This significantly refines the search space in a zero-shot paradigm to focus on the image sampling process adhering to the spatial layout conditions. To precisely control the spatial layouts of multiple visual concepts with the employment of vision guidance, we propose a universal framework, Layered Rendering Diffusion (LRDiff), which constructs an image-rendering process with multiple layers, each of which applies the vision guidance to instructively estimate the denoising direction for a single object. Such a layered rendering strategy effectively prevents issues like unintended conceptual blending or mismatches while allowing for more coherent and contextually accurate image synthesis. The proposed method offers a more efficient and accurate means of synthesising images that align with specific layout and contextual requirements. Through experiments, we demonstrate that our method outperforms existing techniques, both quantitatively and qualitatively, in two specific layout-to-image tasks: bounding box-to-image and instance maskto-image. Furthermore, we extend the proposed framework to enable spatially controllable editing
Forward citations
Cited by 5 Pith papers
-
Appearance Pointers -- Multimodal Region Control of Diffusion Transformers
Appearance pointers are compact tokens that let a diffusion transformer apply text, image, or combined prompts to specific image regions in a single pass.
-
Test-time Controllable Image Generation by Explicit Spatial Constraint Enforcement
A test-time, training-free diffusion method that enforces layout conditions by matching attention maps to prompt words and explicitly moving and refilling latent regions.
-
Generating Compositional Scenes via Text-to-image RGBA Instance Generation
A multi-stage text-to-image approach that generates individual objects as RGBA images and composes them scene-by-scene via noise blending, enabling fine-grained layout and attribute control.
-
A Simple and Efficient Baseline for Zero-Shot Generative Classification
GDC classifies images by fitting one Gaussian per class to DINOv2 embeddings of diffusion-generated reference images, reaching 71.4% on ImageNet at 0.03 seconds per image.
-
Efficient Semantic Splatting for Remote Sensing Multi-view Segmentation
A Gaussian splatting framework with per-point semantic features, SAM2 boundary pseudo-labels, and two aggregation losses gives fast, view-consistent multi-view segmentation for remote sensing under sparse labels.
Discussion (0). Continue with ORCID to comment.