Pith. sign in

REVIEW 11 cited by

DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.09217 v1 pith:4OMAOM4M submitted 2023-11-15 cs.CV

Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli
show 3 more authors
Gordon Wetzstein Zexiang Xu Kai Zhang
This is my paper
classification cs.CV
keywords reconstructiondmv3dmulti-viewdiffusiongenerationmodeldenoisediverse
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise noisy multi-view images via NeRF reconstruction and rendering, achieving single-stage 3D generation in $\sim$30s on single A100 GPU. We train \textbf{DMV3D} on large-scale multi-view image datasets of highly diverse objects using only image reconstruction losses, without accessing 3D assets. We demonstrate state-of-the-art results for the single-image reconstruction problem where probabilistic modeling of unseen object parts is required for generating diverse reconstructions with sharp textures. We also show high-quality text-to-3D generation results outperforming previous 3D diffusion models. Our project website is at: https://justimyhxu.github.io/projects/dmv3d/ .

Discussion (0). Sign in to comment.

Forward citations

Cited by 11 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning

    cs.GR 2026-05 unverdicted novelty 7.0 of 10

    QuadLink generates anisotropic quad-dominant meshes from point clouds via anchor prediction, centroid-conditioned linking, and quad-first assembly, supporting hybrid n-gon topology.

  2. QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning

    cs.GR 2026-05 unverdicted novelty 6.0 of 10

    QuadLink generates anisotropic quad-dominant meshes from point clouds via a hybrid centroid-conditioned vertex linking model and a Tri-to-Quad data conversion operator.

  3. Droplet3D: Commonsense Priors from Videos Facilitate 3D Generation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A video diffusion backbone fine-tuned on 4M densely captioned 360-degree renderings generates spatially consistent multi-view images for 3D assets from image plus detailed text input.

  4. DualMat: PBR Material Estimation via Coherent Dual-Path Diffusion

    cs.CV 2025-08 conditional novelty 6.0 of 10

    DualMat is a dual-path diffusion model combining an albedo-optimized pretrained latent path with a material-specialized compact latent path, using feature distillation and rectified flow to estimate PBR materials from...

  5. Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Can3Tok tokenizes scene-level 3D Gaussian splats into canonical latent tokens with normalization and saliency filtering, enabling reconstruction and text/image-to-3D generation.

  6. TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models

    cs.CV 2025-02 unverdicted novelty 6.0 of 10

    TripoSG generates high-fidelity 3D meshes from input images via a large-scale rectified flow transformer and hybrid-trained 3D VAE on a custom 2-million-sample dataset, claiming state-of-the-art fidelity and generalization.

  7. Efficient 3D Content Reconstruction and Generation

    cs.CV 2026-05 unverdicted novelty 5.0 of 10

    Presents Instant3D for rapid text/image-to-3D generation via multi-view diffusion plus feed-forward reconstruction, and FastMap for 10x faster structure-from-motion with comparable accuracy.

  8. DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generation

    cs.CV 2025-09 unverdicted novelty 5.0 of 10

    LGAA is a modular adapter framework that lifts multi-view diffusion models to produce 2D Gaussian Splats with PBR channels for high-quality relightable 3D mesh extraction using data-efficient finetuning on 69k instances.

  9. ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation

    cs.CV 2025-04 unverdicted novelty 5.0 of 10

    ConsDreamer refines conditional and unconditional terms in score distillation via view disentanglement and geometric consistency loss to reduce the Janus problem in zero-shot text-to-3D.

  10. TripoSR: Fast 3D Object Reconstruction from a Single Image

    cs.CV 2024-03 unverdicted novelty 5.0 of 10

    TripoSR generates 3D meshes from single images in under 0.5 seconds using an improved transformer architecture over LRM.

  11. QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning

    cs.GR 2026-05 unverdicted novelty 4.0 of 10

    QuadLink generates anisotropic quad-dominant meshes from point clouds via autoregressive anchor prediction and centroid-conditioned linking, with a Tri-to-Quad data converter and quad-first assembly.

Pith tools