REVIEW 16 cited by
Transparent Image Layer Diffusion using Latent Transparency
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a "latent transparency" that encodes alpha channel transparency into the latent manifold of a pretrained latent diffusion model. It preserves the production-ready quality of the large diffusion model by regulating the added transparency as a latent offset with minimal changes to the original latent distribution of the pretrained model. In this way, any latent diffusion model can be converted into a transparent image generator by finetuning it with the adjusted latent space. We train the model with 1M transparent image layer pairs collected using a human-in-the-loop collection scheme. We show that latent transparency can be applied to different open source image generators, or be adapted to various conditional control systems to achieve applications like foreground/background-conditioned layer generation, joint layer generation, structural control of layer contents, etc. A user study finds that in most cases (97%) users prefer our natively generated transparent content over previous ad-hoc solutions such as generating and then matting. Users also report the quality of our generated transparent images is comparable to real commercial transparent assets like Adobe Stock.
Forward citations
Cited by 16 Pith papers
-
LiWi: Layering in the Wild
Introduces LiWi-100k dataset via agent-orchestrated synthesis and a decomposition model with shadow-guided learning and boundary correction that claims state-of-the-art RGB L1 and Alpha IoU on natural images.
-
LiWi: Layering in the Wild
LiWi uses an agent-driven data synthesis pipeline to build the LiWi-100k dataset and a model with shadow-guided and degradation-restoration objectives that achieves SoTA performance on RGB L1 and Alpha IoU for natural...
-
RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decomposition
RevealLayer decomposes natural images into multiple RGBA layers using diffusion models with region-aware attention, occlusion-guided adaptation, and a composite loss, outperforming prior methods on a new benchmark dataset.
-
The Garden of Forking Paths: Narrative Arc-Conditioned Gameplay Planning
Forking Garden generates branching dungeon graphs from user-provided storylines by creating a pool of independent nodes and assembling them via arc-guided constraint algorithms that enforce multimodal alignment of gam...
-
A Unified and Controllable Framework for Layered Image Generation with Visual Effects
LASAGNA produces layered images with integrated visual effects in a single pass, enabling drift-free edits via alpha compositing while releasing a 48K dataset and a 242-sample benchmark.
-
LaRender: Training-Free Occlusion Control in Image Generation via Latent Rendering
LaRender replaces cross-attention layers in a pretrained diffusion model with a latent alpha-compositing operation that renders object features in occlusion order, giving training-free occlusion control.
-
UniWorld-Design: From Pixel Generation to Layer-Native Design
A two-model framework generates images as transparent layers and decomposes finished designs into ordered, complete semantic layers, outperforming prior decomposition models on per-layer fidelity and editability.
-
Parallax Portrait Matting
Parallax from a casually captured second view, fused asymmetrically (background-aligned pixels plus foreground-aligned cross-attention), yields finer portrait mattes and cleaner foreground colors than strong single-im...
-
Lighting-Consistent Object Transfer Across Radiance Fields
Diffusion-based per-view harmonization for lighting-consistent object transfer between 3DGS scenes, using heterogeneous training data and final 3D consolidation.
-
PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion
PAI-Studio reformulates cinematic background replacement as in-context conditional generation inside a Diffusion Transformer with bidirectional attention, trained on a new 30K film-sourced dataset, and reports better ...
-
LiWi: Layering in the Wild
Presents LiWi-100k dataset generated via agent-driven decomposition and a model achieving SoTA on RGB L1 and Alpha IoU for natural image layering.
-
LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency
LimeCross enables text-guided editing of individual layers in composite images by conditioning on cross-layer context via bi-stream attention while preserving layer integrity and introducing the LayerEditBench benchmark.
-
CatalogStitch: Dimension-Aware and Occlusion-Preserving Object Compositing for Catalog Image Generation
CatalogStitch provides dimension-aware mask computation and occlusion-aware hybrid restoration to automate corrections in generative object compositing for catalog images.
-
BLK-Assist: A Methodological Framework for Artist-Led Co-Creation with Generative AI Models
BLK-Assist is a three-part framework (Conceptor for sketches, Stencil for transparent assets, Upscale for high-res outputs) that fine-tunes public diffusion models on one artist's proprietary corpus for style-faithful...
-
Text-Conditioned Background Generation for Editable Multi-Layer Documents
A training-free system combines soft latent masking, WCAG-contrast-optimized semi-transparent text backings, and recursive LLM summaries to generate readable, style-consistent backgrounds for multi-page documents.
-
All Stories Are One Story: Emotional Arc Guided Procedural Game Level Generation
A procedural game generation system that uses Rise/Fall emotional arcs to shape LLM-written branching stories and entity difficulty showed higher player enjoyment in a small ARPG user study.
Discussion (0). Sign in to comment.