REVIEW 10 cited by
MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recent sparse multi-view scene reconstruction advances like DUSt3R and MASt3R no longer require camera calibration and camera pose estimation. However, they only process a pair of views at a time to infer pixel-aligned pointmaps. When dealing with more than two views, a combinatorial number of error prone pairwise reconstructions are usually followed by an expensive global optimization, which often fails to rectify the pairwise reconstruction errors. To handle more views, reduce errors, and improve inference time, we propose the fast single-stage feed-forward network MV-DUSt3R. At its core are multi-view decoder blocks which exchange information across any number of views while considering one reference view. To make our method robust to reference view selection, we further propose MV-DUSt3R+, which employs cross-reference-view blocks to fuse information across different reference view choices. To further enable novel view synthesis, we extend both by adding and jointly training Gaussian splatting heads. Experiments on multi-view stereo reconstruction, multi-view pose estimation, and novel view synthesis confirm that our methods improve significantly upon prior art. Code will be released.
Forward citations
Cited by 10 Pith papers
-
Rig3R: Rig-Aware Conditioning for Learned 3D Reconstruction
Rig3R conditions learned 3D reconstruction on optional rig metadata and predicts rig-relative raymaps, enabling state-of-the-art pose estimation and rig calibration discovery from images.
-
What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility
Frozen VGGT layers contain hierarchical co-visibility signals that a <7.5M MoE head extracts to raise Co-VisiON pairwise IoU* by >25% and multiview by ~10% over prior work.
-
PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception
PAGE-4D is a feedforward extension of VGGT that uses a dynamics-aware aggregator and mask to disentangle pose estimation from geometry reconstruction in videos with moving objects.
-
OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations
A single-stage image-based detector that, trained with pseudo boxes from SAM segments and CLIP features, detects and classifies arbitrary indoor objects in 3D at 0.3 seconds per scene.
-
LONG3R: Long Sequence Streaming 3D Reconstruction
LONG3R improves streaming 3D reconstruction over long image sequences by adding attention-based memory gating, a dual-source refined decoder, and adaptive 3D spatial memory pruning.
-
PanSt3R: Multi-view Consistent Panoptic Segmentation
A single network jointly reconstructs 3D scene geometry and predicts multi-view consistent panoptic segmentation from unposed images in one forward pass, without test-time optimization.
-
Co-VisiON: Co-Visibility ReasONing on Sparse Image Sets of Indoor Scenes
Co-VisiON is a new sparse-view co-visibility graph benchmark on Gibson and HM3D, where all tested vision models, including the proposed Covis, fall short of human performance.
-
UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
Fine-tuning a pretrained video diffusion transformer to predict geometry in one shared global frame produces consistent, camera-free surface normals and coordinates across entire video clips.
-
X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography
A large transformer with fixed-voxel Gaussian splatting reconstructs CT volumes from 6-10 X-ray projections in under a second, substantially beating prior sparse-view methods in simulation.
-
FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones
A commodity-drone, RGB-only pipeline with human-AI annotation produces 3D indoor maps with localized points of interest, evaluated in 11 of 12 scanned buildings.
Discussion (0). Continue with ORCID to comment.