REVIEW 8 cited by
VolumeDiffusion: Flexible Text-to-3D Generation with Efficient Volumetric Encoder
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
VolumeDiffusion: Flexible Text-to-3D Generation with Efficient Volumetric Encoder
read the original abstract
This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view images. The 3D volumes are then trained on a diffusion model for text-to-3D generation using a 3D U-Net. This research further addresses the challenges of inaccurate object captions and high-dimensional feature volumes. The proposed model, trained on the public Objaverse dataset, demonstrates promising outcomes in producing diverse and recognizable samples from text prompts. Notably, it empowers finer control over object part characteristics through textual cues, fostering model creativity by seamlessly combining multiple concepts within a single object. This research significantly contributes to the progress of 3D generation by introducing an efficient, flexible, and scalable representation methodology.
Forward citations
Cited by 8 Pith papers
-
Structured 3D Latents for Scalable and Versatile 3D Generation
SLAT provides a unified 3D latent representation enabling versatile high-quality generation across multiple output formats from text or image inputs.
-
ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation
ROAR-3D adds a token-wise view router and dual-stream attention to pretrained single-view 3D generators so they can use arbitrary unposed images for higher-fidelity output.
-
Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers
Sculpt4D generates temporally coherent 4D shapes by integrating a block sparse attention mechanism with time-decaying mask into a pretrained 3D diffusion transformer, achieving SOTA results with 56% less computation.
-
GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance
GaussianGrow grows 3D Gaussians from point clouds by enforcing geometric accuracy through text-guided consistent view synthesis and iterative diffusion-based inpainting of hard-to-observe areas.
-
GaussianGPT: Towards Autoregressive 3D Gaussian Scene Generation
A causal transformer with 3D RoPE generates vector-quantized 3D Gaussian latent grids autoregressively, enabling unconditional synthesis, completion, and open-ended outpainting of indoor scenes.
-
Native and Compact Structured Latents for 3D Generation
Introduces O-Voxel omni-voxel representation and Sparse Compression VAE for structured native 3D latents, enabling efficient training of large flow-matching models that produce higher-quality geometry and materials th...
-
Incorporating Pre-trained Diffusion Models in Solving the Schr\"odinger Bridge Problem
Schrödinger Bridge models can be trained with diffusion-style mean, terminus, and flow-matching losses and initialized from pretrained diffusion models, improving image generation and unpaired translation.
-
MOC-3D: Manifold-Order Consistency for Text-to-3D Generation
MOC-3D adds a semantic view-order constraint using CLIP monotonicity and a manifold-based feature continuity module on SPD Riemannian space to reduce macro-topological and micro-geometric inconsistencies in SDS-based ...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.