The reviewed record of science sign in
Pith

arxiv: 2403.16993 · v1 · pith:3D5HRLFL · submitted 2024-03-25 · cs.CV

Comp4D: LLM-Guided Compositional 4D Scene Generation

Dejia Xu , Hanwen Liang , Neel P. Bhatt , Hezhen Hu , Hanxue Liang , Konstantinos N. Plataniotis , Zhangyang Wang This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:3D5HRLFLrecord.jsonopen to challenge →

classification cs.CV
keywords scenecompositionalcomp4dcontentgenerationmodelsconstructscreation
0
0 comments X
read the original abstract

Recent advancements in diffusion models for 2D and 3D content creation have sparked a surge of interest in generating 4D content. However, the scarcity of 3D scene datasets constrains current methodologies to primarily object-centric generation. To overcome this limitation, we present Comp4D, a novel framework for Compositional 4D Generation. Unlike conventional methods that generate a singular 4D representation of the entire scene, Comp4D innovatively constructs each 4D object within the scene separately. Utilizing Large Language Models (LLMs), the framework begins by decomposing an input text prompt into distinct entities and maps out their trajectories. It then constructs the compositional 4D scene by accurately positioning these objects along their designated paths. To refine the scene, our method employs a compositional score distillation technique guided by the pre-defined trajectories, utilizing pre-trained diffusion models across text-to-image, text-to-video, and text-to-3D domains. Extensive experiments demonstrate our outstanding 4D content creation capability compared to prior arts, showcasing superior visual quality, motion fidelity, and enhanced object interactions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. SV-GS: Sparse View 4D Reconstruction with Skeleton-Driven Gaussian Splatting

    cs.CV 2026-01 unverdicted novelty 7.0

    SV-GS estimates a time-dependent skeleton pose plus fine deformations to enable 4D Gaussian splatting from sparse views, outperforming prior sparse methods by up to 34% PSNR on synthetic data and matching dense monocu...

  2. SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

    cs.AI 2026-07 unverdicted novelty 6.0

    SimWorlds presents a multi-agent system with planner-coder-reviewer workflow, layered scene protocol, and runtime inspection tools to create dynamic 4D scenes from text, plus the 4DBuildBench benchmark showing outperf...

  3. Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling

    cs.CV 2025-07 unverdicted novelty 6.0

    Geometry Forcing aligns video diffusion representations with geometric foundation model features via angular cosine and scale regression objectives to improve 3D consistency in generated videos.

  4. CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

    cs.CV 2024-06 unverdicted novelty 6.0

    CamCo equips image-to-video generators with Plücker-coordinate camera inputs and epipolar attention to improve 3D consistency and camera controllability.

  5. CP4D: Compositional Physics-aware 4D Scene Generation

    cs.CV 2026-06 unverdicted novelty 5.0

    CP4D generates physically consistent 4D scenes via compositional integration of pre-trained 3D models, hybrid simulator-diffusion motion synthesis, and automated scene composition.