REVIEW 4 major objections 4 minor 28 cited by
WorldMirror proposes a single feed-forward model that accepts any available geometric priors—camera poses, intrinsics, depth maps—and simultaneously outputs point clouds, depth, normals, camera parameters, and renderable 3D Gaussians, with
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
2026-08-04 10:15 UTC pith:YRTS3FJ7
load-bearing objection Solid multi-task 3D reconstruction system with convincing prior-injection results, but the headline NVS numbers use GT cameras for back-projection, undercutting the pose-free SOTA claim. the 4 major comments →
WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The core discovery, stated on the paper's own terms, is that a model which can consume any subset of geometric priors and simultaneously predict many 3D representations learns to use prior information as a shared scaffold: a depth hint sharpens camera estimates, a pose hint clarifies depth, and so on. The authors show that this transfer is systematic—single-modality priors give dual benefits (improving the corresponding task and the rest), and the full prior set yields the best point maps, depths, normals, and renderings. They also find that compact global embeddings for poses and intrinsics (one token per view) outperform dense per-pixel conditioning, and that a curriculum from simple to co
What carries the argument
Multi-Modal Prior Prompting: camera poses (rotation as quaternion plus normalized translation) and intrinsics (normalized focal lengths and principal point) are each compressed into a single token and concatenated with image tokens; depth maps are normalized and turned into dense tokens that are added directly to spatially aligned image tokens. During training a dynamic injection scheme randomly zeros out each prior with probability 0.5, so the model learns to exploit whichever priors are present and degrade gracefully when none are. A shared transformer backbone feeds several dense prediction heads that output point maps, depth, surface normals, and 3D Gaussians, plus a camera head; 3D Gaus
Load-bearing premise
The load-bearing premise is that the headline novel-view numbers represent the pose-free system; in fact those numbers are produced with ground-truth camera poses and intrinsics, so the pose-free claim rests entirely on the 'w/o GT Cameras' ablation row in Table 6.
What would settle it
Re-run the novel-view benchmark with only the model's predicted cameras and intrinsics used to back-project Gaussian centers, keeping all other settings fixed. If the margin over the previous best feed-forward splatting method collapses, the pose-free SOTA claim fails. Separately, to test the mutual-reinforcement thesis, ablate each prior one at a time on a held-out zero-shot benchmark and check that each prior improves every output task; if a depth prior improves only depth, the 'universal gains' claim is falsified.
If this is right
- A single model can serve as a common geometry backbone for AR, robotics, and content creation, since it outputs point clouds, camera poses, depth, normals, and renderable splats in one pass without per-scene optimization.
- Any available prior—even one modality—should improve all downstream geometric tasks, so systems with RGB-D sensors, SLAM poses, or known calibration can expect a uniform quality boost rather than a task-specific one.
- Providing all three priors (intrinsics, poses, depth) yields the largest measured gains, implying that sensor-rich pipelines obtain the biggest benefit.
- The predicted point cloud and Gaussians serve as a strong initialization for per-scene 3D Gaussian optimization, reaching better rendering quality in fewer iterations than random initialization.
- Because the model degrades gracefully when no priors are given, it can be deployed in settings where sensor information is sometimes unavailable.
Where Pith is reading between the lines
- If the universal-gain result is genuine, it implies the network is forming a shared internal scene model rather than task-specific shortcuts; a direct test would be to hold out a prior type never seen in training (e.g., sparse LiDAR depth) and check that it still lifts all tasks.
- The pose-free novel-view claim should be read through the 'w/o GT Cameras' ablation, not the headline Table 4 numbers, because those are produced with ground-truth cameras for back-projection; re-running the full benchmark with only predicted cameras would settle how much of the reported margin is actually pose-free.
- The finding that compact single-token embeddings beat dense ray embeddings suggests the priors act as global conditioning rather than per-pixel constraints; one consequence is that noisy or approximate priors (e.g., from an onboard SLAM) may be nearly as effective as exact ones—testable by injecting perturbed poses.
- The measured marginal gains per prior could be turned into an active-sensing policy: a robot could query the cheapest prior (e.g., intrinsics) first and only request depth or poses when the expected geometric gain justifies the sensor cost.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. WorldMirror presents a single feed-forward transformer that consumes N multi-view images together with any subset of geometric priors (camera poses, intrinsics, per-view depth) and predicts point maps, multi-view depth, camera parameters, surface normals, and 3D Gaussians. Priors are encoded as tokens (compact tokens for camera/intrinsics, dense additive tokens for depth), randomly dropped during training, and a curriculum schedules tasks, data, and resolution. Experiments cover point maps (7-Scenes/NRGBD/DTU), cameras (RealEstate10K/Sintel/TUM), normals (ScanNet/NYU/iBims), depth (NYU/Sintel/KITTI), and NVS (RealEstate10K/DL3DV/VR-NeRF), with claims of state-of-the-art results over VGGT, π3, AnySplat, FLARE, and others, plus universal gains from any prior injection.
Significance. If the results hold, WorldMirror is a useful step toward a generalist 3D geometric foundation model: one architecture that handles camera, depth, normal, point-map, and NVS tasks, with a clean token-based mechanism for incorporating optional priors. The breadth of the evaluation is a genuine strength, as is the ablation showing that a single-token prior embedding outperforms dense embeddings. The paper also demonstrates generalization to AI-generated video inputs. The main concerns are evaluative: the headline NVS numbers use ground-truth cameras for Gaussian back-projection, the DL3DV zero-shot status needs clarification, and the 'any-prior' claim lacks a depth-prior NVS ablation. These are fixable, and the Table 6 pose-free ablation suggests the central NVS conclusion may survive a corrected protocol, but the paper as written overstates the pose-free SOTA claim.
major comments (4)
- [Sec. 3.2, Eq. (4); Table 4] The headline NVS comparison is not generated by a fully pose-free system: Eq. (4) back-projects predicted depth maps using ground-truth camera poses and intrinsics. The Table 6 'w/o GT Cameras' ablation substitutes predicted cameras and reports small drops on RealEstate10K (20.30 vs 20.29) but larger drops on DL3DV (20.69 vs 20.91) and VR-NeRF (24.76 vs 25.75), and is not compared against AnySplat/FLARE under the same protocol. Please report Table 4 with predicted cameras and include baselines under that protocol, or explicitly scope the claims to 'given ground-truth cameras'.
- [Sec. 4.1; Sec. A.2] DL3DV is listed in the training data (A.2) and also used for 'zero-shot' NVS evaluation in Table 4. The paper does not state that the FLARE test split is disjoint from the DL3DV training scenes. If any overlap exists, the DL3DV rows are not zero-shot and may favor methods trained on that dataset. Please provide an explicit overlap analysis or re-evaluate on a held-out set.
- [Sec. 4.1; Table 4; Abstract] The paper claims 'any-prior prompting' and universal gains from priors, but Table 4 reports NVS with image-only, intrinsics, camera pose, and intrinsics+camera-pose inputs; no depth-prior NVS row is reported. Since depth is the most directly relevant prior for Gaussian placement, its absence weakens the 'any-prior' claim. Please add a depth-prior (and depth+other) NVS ablation, or explain why depth is not used in this setting.
- [Sec. 4.1, NVS paragraph] The phrase 'we follow the test-time camera pose alignment introduced by AnySplat' is ambiguous. If this alignment involves fitting predicted cameras to ground-truth cameras (e.g., a similarity transform), then even the 'w/o GT Cameras' variant leaks ground-truth pose information. Please define exactly what is aligned, and state whether any ground-truth geometry is used after the forward pass.
minor comments (4)
- [Eq. (9)] The predicted surface normal in the normal loss is written as \hat{E}_i; this is the same symbol used for camera parameters and should be \hat{N}_i to avoid confusion.
- [Table 6] Title has a typo: 'Novel View Synthsis' should be 'Novel View Synthesis'.
- [Sec. 4.2, Fig. 6] The four metrics and their aggregation in Fig. 6 are only tersely described. Please spell out how the bars are computed and whether values are averaged over scenes or views.
- [Appendix C] The limitations section mentions dynamic scenes and maximum input resolution, but does not mention the ground-truth-camera NVS protocol or the DL3DV training/evaluation overlap. These should be acknowledged and addressed in the revision.
Circularity Check
No circularity: the reported results are empirical comparisons on external benchmarks; the GT-camera NVS protocol is an evaluation caveat, not a circular reduction.
full rationale
WorldMirror's central claims are empirical: it reports point-map, camera, depth, normal, and NVS numbers against external baselines on held-out datasets. The method is a learned multi-task regressor initialized from VGGT weights; no equation defines a predicted quantity in terms of the same quantity. The prior-injection ablations explicitly compare no-prior, single-prior, and all-prior configurations, so rows such as 'w/ depth' or 'w/ camera pose' are conditional-input settings, not fitted parameters renamed as predictions. The NVS pipeline in Eq. 4 places Gaussian centers using ground-truth [R|t] and K, and Table 4 is therefore not a fully pose-free evaluation; however, Table 6's 'w/o GT Cameras' ablation replaces them with predicted cameras and quantifies the drop, and this is a benchmark-protocol weakness rather than a circularity. The initialization from VGGT is disclosed and the comparison models are external. No self-citation chain is load-bearing, and no uniqueness or ansatz is imported from the authors' own prior work to force the architecture. Accordingly, the correct circularity verdict is 0.
Axiom & Free-Parameter Ledger
free parameters (5)
- Composite loss weights =
λ_points=1.0, λ_depth=1.0, λ_cam=5.0, λ_normal=1.0, λ_3dgs=1.0, λ_lpips=0.05, λ_gsdepth=0.1, λ_consis=0.1
- Prior dropout probability =
0.5
- Depth confidence quantile for L_consis =
top 30%
- Curriculum schedule =
100 epochs (with normal head) + 50 epochs (Gaussian head fine-tune)
- Dynamic resolution range =
100k-250k pixels, aspect 0.5-2.0
axioms (5)
- domain assumption VGGT pretrained weights provide a valid initialization for WorldMirror.
- domain assumption Ground-truth camera poses and intrinsics are available at NVS inference time.
- domain assumption Pseudo-normals derived from GT depth via plane fitting are reliable enough to supervise the normal head.
- domain assumption The DL3DV test split (FLARE split) does not overlap with the DL3DV training split used by WorldMirror.
- domain assumption Benchmark protocols (e.g., test-time camera pose alignment for NVS) are applied consistently to all methods.
Cite this review
Pith. "Pith review of WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting." pith.science (2026). https://pith.science/paper/YRTS3FJ7
@misc{pith2026251010726,
author = {Pith},
title = {Pith review of: WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting},
year = {2026},
howpublished = {\url{https://pith.science/paper/YRTS3FJ7}},
note = {Machine review of arXiv:2510.10726}
}
read the original abstract
We present WorldMirror, a unified feed-forward model for comprehensive 3D geometric prediction tasks. Unlike existing methods constrained to image-only inputs or customized for a specific task, our framework flexibly integrates diverse geometric priors, including camera poses, intrinsics, and depth maps, while simultaneously generating multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussians. Remarkably, prior injection yields universal gains across all tasks, suggesting that input flexibility and multi-task prediction are mutually reinforcing. WorldMirror achieves state-of-the-art performance across diverse benchmarks from camera, point map, depth, and surface normal estimation to novel view synthesis, while maintaining the efficiency of feed-forward inference.
Figures
Forward citations
Cited by 28 Pith papers
-
SpatialBench: Is Your Spatial Foundation Model an All-Round Player?
SpatialBench evaluates 41 spatial foundation models across 6 paradigms and 5 task suites, finds they are not all-round players, and introduces the DA-Next-5M dataset plus DA-Next baseline model.
-
InvSplat: Inverse Feed-Forward Scene Splatting
InvSplat is a feed-forward multi-view model that predicts 3D Gaussians augmented with intrinsic material attributes for inverse rendering and relighting.
-
Beyond 2D Matching: A Unified Single-Stage Framework for Geometry-Aware Cross-View Object Geo-Localization
A new dataset of 220k+ cross-view pairs and a single-stage geometry-aware model GAGeo based on the π³ 3D foundation model outperforms prior methods on object geo-localization with strong generalization and zero-shot g...
-
Learn2Splat: Extending the Horizon of Learned 3DGS Optimization
A meta-learned optimizer for 3DGS that extends the optimization horizon via checkpoint buffers and latent gradient-scale encoding, delivering better early novel-view quality and long-term stability with zero-shot gene...
-
ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
ConFixGS repairs feedforward 3D Gaussian Splatting with confidence-aware diffusion priors, delivering up to 3.68 dB PSNR gains and halved FID scores on Waymo, nuScenes, and KITTI novel view synthesis tasks.
-
SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis
SplatWeaver dynamically allocates Gaussian primitives via cardinality experts and pixel-level routing guided by high-frequency cues for improved generalizable novel view synthesis.
-
SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis
SplatWeaver uses cardinality Gaussian experts and pixel-level routing to dynamically allocate varying numbers of Gaussian primitives for generalizable novel view synthesis.
-
AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priors
AnchorSplat uses anchor-aligned 3D Gaussians guided by geometric priors for feed-forward scene reconstruction, achieving SOTA novel view synthesis on ScanNet++ with fewer primitives and better view consistency.
-
WildSplat: Feedforward Gaussian Splatting from Unposed In-the-Wild Images
WildSplat decouples geometry from appearance in a single feedforward pass to produce appearance-conditioned 3D Gaussian reconstructions from unposed in-the-wild images.
-
Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes
Argus introduces a covisibility module and decomposed pixel-to-world mapping to deliver SOTA metric performance on camera pose, depth, and point cloud tasks using the Realsee3D panoramic dataset.
-
Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes
Argus plus Realsee3D deliver state-of-the-art metric camera pose, depth, and point-cloud reconstruction from unordered indoor panoramas via learned covisibility anchoring and geometric factorization.
-
Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes
Argus is a feed-forward network for metric panoramic 3D reconstruction, trained on the new Realsee3D dataset of 10K indoor scenes and using a learned covisibility module plus decomposed mapping supervision to achieve ...
-
FUSE-Flow: A Decoupled Framework for Calibration and Stateless Real-Time Multi-View Point Cloud Fusion
FUSE-Flow introduces a decoupled framework with GMAC for target-free extrinsic calibration and FUSE for stateless fusion to improve real-time multi-view point cloud reconstruction.
-
OF$^3$GS: On-the-Fly Feed-Forward 3D Gaussian Splatting from Unposed Images
An online feed-forward 3D Gaussian Splatting method stabilizes causal reconstruction with first-frame-anchored focal recovery and per-pixel 3D offsets, matching offline sparse-view baselines.
-
OF$^3$GS: On-the-Fly Feed-Forward 3D Gaussian Splatting from Unposed Images
FreeStreamGS achieves online NVS from unposed streaming inputs competitive with offline 3DGS methods via decoupled intrinsic recovery and dynamic point refinement.
-
UniT: Unified Geometry Learning with Group Autoregressive Transformer
UniT unifies online and offline 3D geometry perception via a Group Autoregressive Transformer that processes observation groups with anchor-free point map prediction and a scale-adaptive loss.
-
Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Images
A feed-forward model aligns ground and satellite features to predict Gaussian splats for improved novel-view synthesis on georeferenced outdoor scenes.
-
HD-VGGT: High-Resolution Visual Geometry Transformer
HD-VGGT achieves state-of-the-art high-resolution 3D reconstruction from image collections via a dual-branch architecture that predicts coarse geometry at low resolution and refines details at high resolution while mo...
-
AirSplat: Alignment and Rating for Robust Feed-Forward 3D Gaussian Splatting
AirSplat fine-tunes a 3D vision foundation model with a self-corrected pose loop and teacher-rated opacity pruning to achieve state-of-the-art pose-free novel view synthesis.
-
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
A real-time video diffusion world model that uses dual action control, reframed position encodings, and context-aligned distillation to keep generated environments consistent over hundreds of frames.
-
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
WorldPlay uses dual action representation, reconstituted context memory, and context forcing distillation to produce consistent 720p streaming video at 24 FPS for interactive world modeling.
-
FUSE-Flow: A Decoupled Framework for Calibration and Stateless Real-Time Multi-View Point Cloud Fusion
FUSE-Flow decouples multi-camera calibration and point-cloud fusion into two stateless modules, claiming linear-time scalability and better real-time reconstruction than prior systems.
-
IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation
IVGT implicitly represents scenes as continuous neural fields from pose-free multi-view images to enable coherent surface extraction, novel view synthesis, and related tasks via transformer-based feature retrieval and...
-
IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation
IVGT implicitly models continuous neural scene representations from pose-free multi-view images to enable coherent surface extraction, novel view synthesis, and related 3D tasks via SDF and color prediction.
-
Large Depth Completion Model from Sparse Observations
LDCM achieves state-of-the-art metric depth completion from sparse observations by combining foundation-model initialization with a point-map regression head that removes the need for camera intrinsics.
-
HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds
HY-World 2.0 generates and reconstructs high-fidelity navigable 3D Gaussian Splatting worlds from text, images, or videos via upgraded panorama, planning, expansion, and composition modules, with released code claimin...
-
OpenWorldLib: A Unified Codebase and Definition of Advanced World Models
OpenWorldLib offers a standardized codebase and definition for world models that combine perception, interaction, and memory to understand and predict the world.
-
OpenWorldLib: A Unified Codebase and Definition of Advanced World Models
OpenWorldLib defines world models as perception-centered systems with interaction and long-term memory, and provides a modular inference codebase unifying interactive video, 3D, reasoning, and VLA tasks.
Reference graph
Works this paper leans on
-
[1]
Map-free visual relocalization: Metric pose relative to a single image
Eduardo Arnold, Jamie Wynn, Sara Vicente, Guillermo Garcia-Hernando, Aron Monszpart, Victor Prisacariu, Daniyar Turmukhambetov, and Eric Brachmann. Map-free visual relocalization: Metric pose relative to a single image. In European Conference on Computer Vision, pp.\ 690--708. Springer, 2022
2022
-
[2]
Neural rgb-d surface reconstruction
Dejan Azinovi \'c , Ricardo Martin-Brualla, Dan B Goldman, Matthias Nie ner, and Justus Thies. Neural rgb-d surface reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6290--6301, 2022
2022
-
[3]
Rethinking inductive biases for surface normal estimation
Gwangbin Bae and Andrew J Davison. Rethinking inductive biases for surface normal estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 9535--9545, 2024
2024
-
[4]
Estimating and exploiting the aleatoric uncertainty in surface normal estimation
Gwangbin Bae, Ignas Budvytis, and Roberto Cipolla. Estimating and exploiting the aleatoric uncertainty in surface normal estimation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 13137--13146, 2021
2021
-
[5]
ARK itscenes - a diverse real-world dataset for 3d indoor scene understanding using mobile RGB -d data
Gilad Baruch, Zhuoyuan Chen, Afshin Dehghan, Tal Dimry, Yuri Feigin, Peter Fu, Thomas Gebauer, Brandon Joffe, Daniel Kurz, Arik Schwartz, and Elad Shulman. ARK itscenes - a diverse real-world dataset for 3d indoor scene understanding using mobile RGB -d data. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track...
2021
-
[6]
Transformerfusion: Monocular rgb scene reconstruction using transformers
Aljaz Bozic, Pablo Palafox, Justus Thies, Angela Dai, and Matthias Nie ner. Transformerfusion: Monocular rgb scene reconstruction using transformers. Advances in Neural Information Processing Systems, 34: 0 1403--1414, 2021
2021
-
[7]
Matterport3d: Learning from rgb-d data in indoor environments
Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Niessner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang. Matterport3d: Learning from rgb-d data in indoor environments. arXiv preprint arXiv:1709.06158, 2017
Pith/arXiv arXiv 2017
-
[8]
pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction
David Charatan, Sizhe Lester Li, Andrea Tagliasacchi, and Vincent Sitzmann. pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 19457--19467, 2024
2024
-
[9]
Oasis: A large-scale dataset for single image 3d in the wild
Weifeng Chen, Shengyi Qian, David Fan, Noriyuki Kojima, Max Hamilton, and Jia Deng. Oasis: A large-scale dataset for single image 3d in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 679--688, 2020
2020
-
[10]
Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images
Yuedong Chen, Haofei Xu, Chuanxia Zheng, Bohan Zhuang, Marc Pollefeys, Andreas Geiger, Tat-Jen Cham, and Jianfei Cai. Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images. In European Conference on Computer Vision, pp.\ 370--386. Springer, 2024
2024
-
[11]
Scannet: Richly-annotated 3d reconstructions of indoor scenes
Angela Dai, Angel X Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nie ner. Scannet: Richly-annotated 3d reconstructions of indoor scenes. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 5828--5839, 2017
2017
-
[12]
Vggt-long: Chunk it, loop it, align it--pushing vggt's limits on kilometer-scale long rgb sequences
Kai Deng, Zexin Ti, Jiawei Xu, Jian Yang, and Jin Xie. Vggt-long: Chunk it, loop it, align it--pushing vggt's limits on kilometer-scale long rgb sequences. arXiv preprint arXiv:2507.16443, 2025
Pith/arXiv arXiv 2025
-
[13]
Omnidata: A scalable pipeline for making multi-task mid-level vision datasets from 3d scans
Ainaz Eftekhar, Alexander Sax, Jitendra Malik, and Amir Zamir. Omnidata: A scalable pipeline for making multi-task mid-level vision datasets from 3d scans. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 10786--10796, 2021
2021
-
[14]
Dens3r: A foundation model for 3d geometry prediction
Xianze Fang, Jingnan Gao, Zhe Wang, Zhuo Chen, Xingyu Ren, Jiangjing Lyu, Qiaomu Ren, Zhonglei Yang, Xiaokang Yang, Yichao Yan, et al. Dens3r: A foundation model for 3d geometry prediction. arXiv preprint arXiv:2507.16290, 2025
Pith/arXiv arXiv 2025
-
[15]
Geowizard: Unleashing the diffusion priors for 3d geometry estimation from a single image
Xiao Fu, Wei Yin, Mu Hu, Kaixuan Wang, Yuexin Ma, Ping Tan, Shaojie Shen, Dahua Lin, and Xiaoxiao Long. Geowizard: Unleashing the diffusion priors for 3d geometry estimation from a single image. In European Conference on Computer Vision, pp.\ 241--258. Springer, 2024
2024
-
[16]
Cameractrl: Enabling camera control for text-to-video generation
Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang. Cameractrl: Enabling camera control for text-to-video generation. arXiv preprint arXiv:2404.02101, 2024
Pith/arXiv arXiv 2024
-
[17]
Deepmvs: Learning multi-view stereopsis
Po-Han Huang, Kevin Matzen, Johannes Kopf, Narendra Ahuja, and Jia-Bin Huang. Deepmvs: Learning multi-view stereopsis. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
2018
-
[18]
Voyager: Long-range and world-consistent video diffusion for explorable 3d scene generation
Tianyu Huang, Wangguandong Zheng, Tengfei Wang, Yuhao Liu, Zhenwei Wang, Junta Wu, Jie Jiang, Hui Li, Rynson WH Lau, Wangmeng Zuo, et al. Voyager: Long-range and world-consistent video diffusion for explorable 3d scene generation. arXiv preprint arXiv:2506.04225, 2025
Pith/arXiv arXiv 2025
-
[19]
Pow3r: Empowering unconstrained 3d reconstruction with camera and scene priors
Wonbong Jang, Philippe Weinzaepfel, Vincent Leroy, Lourdes Agapito, and Jerome Revaud. Pow3r: Empowering unconstrained 3d reconstruction with camera and scene priors. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 1071--1081, 2025
2025
-
[20]
Large scale multi-view stereopsis evaluation
Rasmus Jensen, Anders Dahl, George Vogiatzis, Engin Tola, and Henrik Aan s. Large scale multi-view stereopsis evaluation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 406--413, 2014
2014
-
[21]
Leap: Liberate sparse-view 3d modeling from camera poses
Hanwen Jiang, Zhenyu Jiang, Yue Zhao, and Qixing Huang. Leap: Liberate sparse-view 3d modeling from camera poses. arXiv preprint arXiv:2310.01410, 2023
Pith/arXiv arXiv 2023
-
[22]
Anysplat: Feed-forward 3d gaussian splatting from unconstrained views
Lihan Jiang, Yucheng Mao, Linning Xu, Tao Lu, Kerui Ren, Yichen Jin, Xudong Xu, Mulin Yu, Jiangmiao Pang, Feng Zhao, et al. Anysplat: Feed-forward 3d gaussian splatting from unconstrained views. arXiv preprint arXiv:2505.23716, 2025
arXiv 2025
-
[23]
3d common corruptions and data augmentation
O g uzhan Fatih Kar, Teresa Yeo, Andrei Atanov, and Amir Zamir. 3d common corruptions and data augmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 18963--18974, 2022
2022
-
[24]
Cotracker: It is better to track together
Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, and Christian Rupprecht. Cotracker: It is better to track together. In European conference on computer vision, pp.\ 18--35. Springer, 2024
2024
-
[25]
Poisson surface reconstruction
Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, volume 7, 2006
2006
-
[26]
3d gaussian splatting for real-time radiance field rendering
Bernhard Kerbl, Georgios Kopanas, Thomas Leimk \"u hler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph., 42 0 (4): 0 139--1, 2023
2023
-
[27]
Evaluation of cnn-based single-image depth estimation methods
Tobias Koch, Lukas Liebel, Friedrich Fraundorfer, and Marco Korner. Evaluation of cnn-based single-image depth estimation methods. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops, pp.\ 0--0, 2018
2018
-
[28]
Grounding image matching in 3d with mast3r
Vincent Leroy, Yohann Cabon, and J \'e r \^o me Revaud. Grounding image matching in 3d with mast3r. In European Conference on Computer Vision, pp.\ 71--91. Springer, 2024
2024
-
[29]
Megadepth: Learning single-view depth prediction from internet photos
Zhengqi Li and Noah Snavely. Megadepth: Learning single-view depth prediction from internet photos. In Computer Vision and Pattern Recognition (CVPR), 2018
2018
-
[30]
Dl3dv-10k: A large-scale scene dataset for deep learning-based 3d vision
Lu Ling, Yichen Sheng, Zhi Tu, Wentian Zhao, Cheng Xin, Kun Wan, Lantao Yu, Qianyu Guo, Zixun Yu, Yawen Lu, et al. Dl3dv-10k: A large-scale scene dataset for deep learning-based 3d vision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 22160--22169, 2024
2024
-
[31]
Monosplat: Generalizable 3d gaussian splatting from monocular depth foundation models
Yifan Liu, Keyu Fan, Weihao Yu, Chenxin Li, Hao Lu, and Yixuan Yuan. Monosplat: Generalizable 3d gaussian splatting from monocular depth foundation models. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 21570--21579, 2025
2025
-
[32]
Nerf: Representing scenes as neural radiance fields for view synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM, 65 0 (1): 0 99--106, 2021
2021
-
[33]
Epipolar-free 3d gaussian splatting for generalizable novel view synthesis
Zhiyuan Min, Yawei Luo, Jianwen Sun, and Yi Yang. Epipolar-free 3d gaussian splatting for generalizable novel view synthesis. Advances in Neural Information Processing Systems, 37: 0 39573--39596, 2024
2024
-
[34]
Aria digital twin: A new benchmark dataset for egocentric 3d machine perception
Xiaqing Pan, Nicholas Charron, Yongqian Yang, Scott Peters, Thomas Whelan, Chen Kong, Omkar Parkhi, Richard Newcombe, and Yuheng Carl Ren. Aria digital twin: A new benchmark dataset for egocentric 3d machine perception. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 20133--20143, 2023
2023
-
[35]
Unidepth: Universal monocular metric depth estimation
Luigi Piccinelli, Yung-Hsu Yang, Christos Sakaridis, Mattia Segu, Siyuan Li, Luc Van Gool, and Fisher Yu. Unidepth: Universal monocular metric depth estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 10106--10116, 2024
2024
-
[36]
Vision transformers for dense prediction
Ren \'e Ranftl, Alexey Bochkovskiy, and Vladlen Koltun. Vision transformers for dense prediction. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 12179--12188, 2021
2021
-
[37]
Common objects in 3d: Large-scale learning and evaluation of real-life 3d category reconstruction
Jeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone, Patrick Labatut, and David Novotny. Common objects in 3d: Large-scale learning and evaluation of real-life 3d category reconstruction. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 10901--10911, 2021
2021
-
[38]
Hypersim: A photorealistic synthetic dataset for holistic indoor scene understanding
Mike Roberts, Jason Ramapuram, Anurag Ranjan, Atulit Kumar, Miguel Angel Bautista, Nathan Paczan, Russ Webb, and Joshua M Susskind. Hypersim: A photorealistic synthetic dataset for holistic indoor scene understanding. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 10912--10922, 2021
2021
-
[39]
Habitat: A platform for embodied ai research
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, et al. Habitat: A platform for embodied ai research. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 9339--9347, 2019
2019
-
[40]
Structure-from-motion revisited
Johannes L Schonberger and Jan-Michael Frahm. Structure-from-motion revisited. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 4104--4113, 2016
2016
-
[41]
Pixelwise view selection for unstructured multi-view stereo
Johannes L Sch \"o nberger, Enliang Zheng, Jan-Michael Frahm, and Marc Pollefeys. Pixelwise view selection for unstructured multi-view stereo. In European conference on computer vision, pp.\ 501--518. Springer, 2016
2016
-
[42]
A multi-view stereo benchmark with high-resolution images and multi-camera videos
Thomas Schops, Johannes L Schonberger, Silvano Galliani, Torsten Sattler, Konrad Schindler, Marc Pollefeys, and Andreas Geiger. A multi-view stereo benchmark with high-resolution images and multi-camera videos. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 3260--3269, 2017
2017
-
[43]
Scene coordinate regression forests for camera relocalization in rgb-d images
Jamie Shotton, Ben Glocker, Christopher Zach, Shahram Izadi, Antonio Criminisi, and Andrew Fitzgibbon. Scene coordinate regression forests for camera relocalization in rgb-d images. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 2930--2937, 2013
2013
-
[44]
Indoor segmentation and support inference from rgbd images
Nathan Silberman, Derek Hoiem, Pushmeet Kohli, and Rob Fergus. Indoor segmentation and support inference from rgbd images. In European conference on computer vision, pp.\ 746--760. Springer, 2012
2012
-
[45]
Splatt3r: Zero-shot gaussian splatting from uncalibrated image pairs
Brandon Smart, Chuanxia Zheng, Iro Laina, and Victor Adrian Prisacariu. Splatt3r: Zero-shot gaussian splatting from uncalibrated image pairs. arXiv preprint arXiv:2408.13912, 2024
Pith/arXiv arXiv 2024
-
[46]
A benchmark for the evaluation of rgb-d slam systems
J \"u rgen Sturm, Nikolas Engelhard, Felix Endres, Wolfram Burgard, and Daniel Cremers. A benchmark for the evaluation of rgb-d slam systems. In 2012 IEEE/RSJ international conference on intelligent robots and systems, pp.\ 573--580. IEEE, 2012
2012
-
[47]
Hunyuanworld 1.0: Generating immersive, explorable, and interactive 3d worlds from words or pixels
HunyuanWorld Team. Hunyuanworld 1.0: Generating immersive, explorable, and interactive 3d worlds from words or pixels. arXiv preprint, 2025
2025
-
[48]
Smd-nets: Stereo mixture density networks
Fabio Tosi, Yiyi Liao, Carolin Schmitt, and Andreas Geiger. Smd-nets: Stereo mixture density networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 8942--8952, 2021
2021
-
[49]
Posediffusion: Solving pose estimation via diffusion-aided bundle adjustment
Jianyuan Wang, Christian Rupprecht, and David Novotny. Posediffusion: Solving pose estimation via diffusion-aided bundle adjustment. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 9773--9783, 2023 a
2023
-
[50]
Vggt: Visual geometry grounded transformer
Jianyuan Wang, Minghao Chen, Nikita Karaev, Andrea Vedaldi, Christian Rupprecht, and David Novotny. Vggt: Visual geometry grounded transformer. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 5294--5306, 2025 a
2025
-
[51]
Pf-lrm: Pose-free large reconstruction model for joint pose and shape prediction
Peng Wang, Hao Tan, Sai Bi, Yinghao Xu, Fujun Luan, Kalyan Sunkavalli, Wenping Wang, Zexiang Xu, and Kai Zhang. Pf-lrm: Pose-free large reconstruction model for joint pose and shape prediction. arXiv preprint arXiv:2311.12024, 2023 b
Pith/arXiv arXiv 2023
-
[52]
Continuous 3d perception model with persistent state
Qianqian Wang, Yifei Zhang, Aleksander Holynski, Alexei A Efros, and Angjoo Kanazawa. Continuous 3d perception model with persistent state. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 10510--10522, 2025 b
2025
-
[53]
Dust3r: Geometric 3d vision made easy
Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, and Jerome Revaud. Dust3r: Geometric 3d vision made easy. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 20697--20709, 2024
2024
-
[54]
Tartanair: A dataset to push the limits of visual slam
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, and Sebastian Scherer. Tartanair: A dataset to push the limits of visual slam. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.\ 4909--4916. IEEE, 2020
2020
-
[55]
pi3: Scalable permutation-equivariant visual geometry learning
Yifan Wang, Jianjun Zhou, Haoyi Zhu, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, and Tong He. pi3: Scalable permutation-equivariant visual geometry learning. arXiv preprint arXiv:2507.13347, 2025 c
Pith/arXiv arXiv 2025
-
[56]
Rgbd objects in the wild: Scaling real-world 3d object learning from rgb-d videos, 2024
Hongchi Xia, Yang Fu, Sifei Liu, and Xiaolong Wang. Rgbd objects in the wild: Scaling real-world 3d object learning from rgb-d videos, 2024. URL https://arxiv.org/abs/2401.12592
Pith/arXiv arXiv 2024
-
[57]
Depthsplat: Connecting gaussian splatting and depth
Haofei Xu, Songyou Peng, Fangjinhua Wang, Hermann Blum, Daniel Barath, Andreas Geiger, and Marc Pollefeys. Depthsplat: Connecting gaussian splatting and depth. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 16453--16463, 2025
2025
-
[58]
Vr-nerf: High-fidelity virtualized walkable spaces
Linning Xu, Vasu Agrawal, William Laney, Tony Garcia, Aayush Bansal, Changil Kim, Samuel Rota Bul \`o , Lorenzo Porzi, Peter Kontschieder, Alja z Bo z i c , et al. Vr-nerf: High-fidelity virtualized walkable spaces. In SIGGRAPH Asia 2023 Conference Papers, pp.\ 1--12, 2023
2023
-
[59]
Fast3r: Towards 3d reconstruction of 1000+ images in one forward pass
Jianing Yang, Alexander Sax, Kevin J Liang, Mikael Henaff, Hao Tang, Ang Cao, Joyce Chai, Franziska Meier, and Matt Feiszli. Fast3r: Towards 3d reconstruction of 1000+ images in one forward pass. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 21924--21935, 2025
2025
-
[60]
Depth anything: Unleashing the power of large-scale unlabeled data
Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything: Unleashing the power of large-scale unlabeled data. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 10371--10381, 2024
2024
-
[61]
Blendedmvs: A large-scale dataset for generalized multi-view stereo networks
Yao Yao, Zixin Luo, Shiwei Li, Jingyang Zhang, Yufan Ren, Lei Zhou, Tian Fang, and Long Quan. Blendedmvs: A large-scale dataset for generalized multi-view stereo networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 1790--1799, 2020
2020
-
[62]
No pose, no problem: Surprisingly simple 3d gaussian splats from sparse unposed images
Botao Ye, Sifei Liu, Haofei Xu, Xueting Li, Marc Pollefeys, Ming-Hsuan Yang, and Songyou Peng. No pose, no problem: Surprisingly simple 3d gaussian splats from sparse unposed images. arXiv preprint arXiv:2410.24207, 2024 a
Pith/arXiv arXiv 2024
-
[63]
Stablenormal: Reducing diffusion variance for stable and sharp normal
Chongjie Ye, Lingteng Qiu, Xiaodong Gu, Qi Zuo, Yushuang Wu, Zilong Dong, Liefeng Bo, Yuliang Xiu, and Xiaoguang Han. Stablenormal: Reducing diffusion variance for stable and sharp normal. ACM Transactions on Graphics (TOG), 43 0 (6): 0 1--18, 2024 b
2024
-
[64]
gsplat: An open-source library for gaussian splatting
Vickie Ye, Ruilong Li, Justin Kerr, Matias Turkulainen, Brent Yi, Zhuoyang Pan, Otto Seiskari, Jianbo Ye, Jeffrey Hu, Matthew Tancik, and Angjoo Kanazawa. gsplat: An open-source library for gaussian splatting. Journal of Machine Learning Research, 26 0 (34): 0 1--17, 2025
2025
-
[65]
Scannet++: A high-fidelity dataset of 3d indoor scenes
Chandan Yeshwanth, Yueh-Cheng Liu, Matthias Nie ner, and Angela Dai. Scannet++: A high-fidelity dataset of 3d indoor scenes. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 12--22, 2023
2023
-
[66]
pixelnerf: Neural radiance fields from one or few images
Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. pixelnerf: Neural radiance fields from one or few images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 4578--4587, 2021
2021
-
[67]
Monst3r: A simple approach for estimating geometry in the presence of motion
Junyi Zhang, Charles Herrmann, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun, and Ming-Hsuan Yang. Monst3r: A simple approach for estimating geometry in the presence of motion. arXiv preprint arXiv:2410.03825, 2024
Pith/arXiv arXiv 2024
-
[68]
Flare: Feed-forward geometry, appearance and camera estimation from uncalibrated sparse views
Shangzhan Zhang, Jianyuan Wang, Yinghao Xu, Nan Xue, Christian Rupprecht, Xiaowei Zhou, Yujun Shen, and Gordon Wetzstein. Flare: Feed-forward geometry, appearance and camera estimation from uncalibrated sparse views. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp.\ 21936--21947, 2025
2025
-
[69]
Stereo magnification: Learning view synthesis using multiplane images
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. Stereo magnification: Learning view synthesis using multiplane images. arXiv preprint arXiv:1805.09817, 2018
Pith/arXiv arXiv 2018
-
[70]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION format.date year duplicate empty "emp...
-
[71]
@esa (Ref
\@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should not add it explicitly Type <Return> for now, but then later remove the command n...
-
[72]
\@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@first@sw \@firstoftwo \@ifundefined NAT@b*@#2 \@firstoftwo @num @NAT@ctr \@secondoft...
-
[73]
We report the performance of WorldMirror under different input configurations
@open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibsetup #1 @NAT@ctr @ @openbib .11em \@plus.33em \@minus.07em 4000 4000 `\.\@m @bibit...
This paper was first reviewed by deepseek-v4-flash on August 4, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.