Pith. sign in

REVIEW 15 cited by

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.06974 v1 pith:6N5GSPBG submitted 2024-12-09 cs.CV cs.AI

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

classification cs.CV cs.AI
keywords viewviewsmulti-viewreconstructionmv-dust3rreferenceacrossblocks
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Recent sparse multi-view scene reconstruction advances like DUSt3R and MASt3R no longer require camera calibration and camera pose estimation. However, they only process a pair of views at a time to infer pixel-aligned pointmaps. When dealing with more than two views, a combinatorial number of error prone pairwise reconstructions are usually followed by an expensive global optimization, which often fails to rectify the pairwise reconstruction errors. To handle more views, reduce errors, and improve inference time, we propose the fast single-stage feed-forward network MV-DUSt3R. At its core are multi-view decoder blocks which exchange information across any number of views while considering one reference view. To make our method robust to reference view selection, we further propose MV-DUSt3R+, which employs cross-reference-view blocks to fuse information across different reference view choices. To further enable novel view synthesis, we extend both by adding and jointly training Gaussian splatting heads. Experiments on multi-view stereo reconstruction, multi-view pose estimation, and novel view synthesis confirm that our methods improve significantly upon prior art. Code will be released.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 15 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. CasaMaestro: Multi-View Panoramas for House-Scale 3D Reconstruction

    cs.CV 2026-06 unverdicted novelty 7.0

    CasaMaestro predicts metric depth and poses from sparse multi-view panoramas to enable fast house-scale 3D reconstruction.

  2. $\pi^3$: Permutation-Equivariant Visual Geometry Learning

    cs.CV 2025-07 conditional novelty 7.0

    π³ is a feed-forward network with full permutation equivariance that outputs affine-invariant poses and scale-invariant local point maps without reference frames, reaching state-of-the-art on camera pose, depth, and d...

  3. What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility

    cs.CV 2026-07 accept novelty 6.5

    Frozen VGGT layers contain hierarchical co-visibility signals that a <7.5M MoE head extracts to raise Co-VisiON pairwise IoU* by >25% and multiview by ~10% over prior work.

  4. TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction

    cs.CV 2026-05 unverdicted novelty 6.0

    TriSplat predicts oriented triangle primitives from images in one forward pass to produce simulation-ready 3D meshes with competitive rendering quality.

  5. Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective

    cs.CV 2026-04 unverdicted novelty 6.0

    The paper proposes a problem-driven taxonomy for feed-forward 3D scene modeling that groups methods by five core challenges: feature enhancement, geometry awareness, model efficiency, augmentation strategies, and temp...

  6. Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstruction

    cs.CV 2026-04 unverdicted novelty 6.0

    Scal3R achieves better accuracy and consistency in large-scale 3D scene reconstruction by maintaining a compressed global context through test-time adaptation of lightweight neural networks on long video sequences.

  7. Self-Improving 4D Perception via Self-Distillation

    cs.CV 2026-04 unverdicted novelty 6.0

    SelfEvo enables pretrained 4D perception models to self-improve on unlabeled videos via self-distillation, delivering up to 36.5% relative gains in video depth estimation and 20.1% in camera estimation across eight be...

  8. OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer

    cs.CV 2026-03 conditional novelty 6.0

    OVGGT achieves constant O(1) memory and compute for streaming 3D geometry reconstruction by using FFN-residual-based KV cache compression and dynamic anchor protection, matching state-of-the-art accuracy on long sequences.

  9. PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception

    cs.CV 2025-10 unverdicted novelty 6.0

    PAGE-4D is a feedforward extension of VGGT that uses a dynamics-aware aggregator and mask to disentangle pose estimation from geometry reconstruction in videos with moving objects.

  10. PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception

    cs.CV 2025-10 conditional novelty 6.0

    A fine-tuned VGGT with a learned dynamics mask improves camera pose, depth, and point-cloud reconstruction on dynamic-scene benchmarks over the original static-scene model.

  11. OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations

    cs.CV 2025-08 conditional novelty 6.0

    A single-stage image-based detector that, trained with pseudo boxes from SAM segments and CLIP features, detects and classifies arbitrary indoor objects in 3D at 0.3 seconds per scene.

  12. VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction

    cs.CV 2025-05 unverdicted novelty 6.0

    VLM-3R augments VLMs with implicit 3D tokens from monocular video via geometry encoding and 200K+ 3D reconstructive QA pairs, plus a new 138K-pair temporal benchmark, to support spatial and embodied reasoning.

  13. Bundle Adjustment in the Eager Mode

    cs.RO 2024-09 unverdicted novelty 6.0

    Introduces an eager-mode PyTorch BA library with GPU-accelerated sparse ops claiming 18.5-23x speedups over GTSAM, g2o, and Ceres.

  14. QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer

    cs.CV 2026-05 unverdicted novelty 5.0

    QVGGT uses per-block mixed-precision analysis, outlier token filtering with PCA compensation, and task-aware scale search to achieve near-lossless W4A16 quantization of VGGT with 3-4.9x memory savings and 2.8x speedup.

  15. FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones

    cs.HC 2025-08 conditional novelty 5.0

    A commodity-drone, RGB-only pipeline with human-AI annotation produces 3D indoor maps with localized points of interest, evaluated in 11 of 12 scanned buildings.