REVIEW 7 cited by
LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Model
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Designing 3D indoor layouts is a crucial task with significant applications in virtual reality, interior design, and automated space planning. Existing methods for 3D layout design either rely on diffusion models, which utilize spatial relationship priors, or heavily leverage the inferential capabilities of proprietary Large Language Models (LLMs), which require extensive prompt engineering and in-context exemplars via black-box trials. These methods often face limitations in generalization and dynamic scene editing. In this paper, we introduce LLplace, a novel 3D indoor scene layout designer based on lightweight fine-tuned open-source LLM Llama3. LLplace circumvents the need for spatial relationship priors and in-context exemplars, enabling efficient and credible room layout generation based solely on user inputs specifying the room type and desired objects. We curated a new dialogue dataset based on the 3D-Front dataset, expanding the original data volume and incorporating dialogue data for adding and removing objects. This dataset can enhance the LLM's spatial understanding. Furthermore, through dialogue, LLplace activates the LLM's capability to understand 3D layouts and perform dynamic scene editing, enabling the addition and removal of objects. Our approach demonstrates that LLplace can effectively generate and edit 3D indoor layouts interactively and outperform existing methods in delivering high-quality 3D design solutions. Code and dataset will be released.
Forward citations
Cited by 7 Pith papers
-
ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
A progressive reasoning framework where a VLM generates or edits 3D layouts one reasoned object placement at a time, trained on 224,757 GPT-4o-annotated placement pairs plus tier-decoupled GDPO.
-
EventOD: Event-Aware OD Flow Generation via LLM-Guided Semantic Modulation
EventOD adapts frozen OD generators to disruptive events by modulating inputs with LLM-derived semantic direction vectors and learned magnitude factors, improving hurricane and pandemic flow reconstruction.
-
TabletopGen: Tabletop Scene Generation and Interactive Simulation for Robotic Manipulation
A training-free pipeline generates instance-level, physically interactive 3D tabletop scenes from text or one image, with a differentiable rotation optimizer and top-view spatial alignment for collision-free layouts.
-
Video Perception Models for 3D Scene Synthesis
VIPScene synthesizes 3D scenes by generating a video with Cosmos, reconstructing it with Fast3R, extracting objects with Grounded-SAM and MASt3R, and assembling them from Objaverse assets.
-
ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
ReSpace is an autoregressive LLM framework for text-driven 3D indoor scene editing and synthesis, using a structured JSON scene representation and a voxelization-based layout metric.
-
ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediary
A training-free pipeline that generates editable 3D scenes from text by using a generated 2D image as an intermediary to extract object shapes, appearances, positions, and poses.
-
Spatial 3D-LLM: Exploring Spatial Awareness in 3D Vision-Language Models
Spatial 3D-LLM adds a progressive spatial awareness scheme to a 3D vision-language model, improving several 3D understanding and grounding metrics and introducing new distance and layout-editing tasks.
Discussion (0). Continue with ORCID to comment.