The reviewed record of science sign in
Pith

arxiv: 1906.05797 · v1 · pith:GHV2EPOO · submitted 2019-06-13 · cs.CV · cs.GR· eess.IV

The Replica Dataset: A Digital Replica of Indoor Spaces

Julian Straub , Thomas Whelan , Lingni Ma , Yufan Chen , Erik Wijmans , Simon Green , Jakob J. Engel , Raul Mur-Artal
show 22 more authors
Carl Ren Shobhit Verma Anton Clarkson Mingfei Yan Brian Budge Yajie Yan Xiaqing Pan June Yon Yuyang Zou Kimberly Leon Nigel Carter Jesus Briales Tyler Gillingham Elias Mueggler Luis Pesqueira Manolis Savva Dhruv Batra Hauke M. Strasdat Renzo De Nardi Michael Goesele Steven Lovegrove Richard Newcombe
This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-05-12 16:29 UTCgrok-4.3pith:GHV2EPOOrecord.jsonopen to challenge →

classification cs.CV cs.GReess.IV
keywords Replica dataset3D indoor reconstructionphoto-realistic scenessemantic segmentationembodied agentsmachine learningcomputer visionsim-to-real transfer
0
0 comments X

The pith

Replica is a dataset of 18 photo-realistic 3D indoor scenes designed so machine learning models trained on it may work directly on real-world data.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper introduces the Replica dataset containing 18 highly detailed 3D reconstructions of indoor environments. Each reconstruction includes a dense mesh, high-resolution HDR textures, semantic labels for classes and instances, and information on reflective surfaces like mirrors and glass. The purpose is to create realistic virtual worlds for training AI in computer vision and robotics tasks such as navigation and question answering. A key hope is that the realism allows models to transfer to actual images and videos without extra adjustments. This addresses the challenge of obtaining large amounts of labeled real-world data for such applications.

Core claim

We introduce Replica, a dataset of 18 highly photo-realistic 3D indoor scene reconstructions at room and building scale. Each scene consists of a dense mesh, high-resolution high-dynamic-range (HDR) textures, per-primitive semantic class and instance information, and planar mirror and glass reflectors. The goal of Replica is to enable machine learning research that relies on visually, geometrically, and semantically realistic generative models of the world - for instance, egocentric computer vision, semantic segmentation in 2D and 3D, geometric inference, and the development of embodied agents performing navigation, instruction following, and question answering. Due to the high level of the

What carries the argument

The Replica dataset of 18 indoor scenes, each supplying a dense mesh, HDR textures, per-primitive semantic labels, and reflector data to act as a realistic generative model for ML training.

If this is right

  • Enables training and evaluation of 2D and 3D semantic segmentation models on accurate per-primitive labels.
  • Supports geometric inference research using dense, textured 3D meshes.
  • Allows creation of embodied agents for navigation, instruction following, and question answering in realistic settings.
  • Provides native compatibility with Habitat for virtual robot training and testing.
  • Supplies a minimal C++ SDK to facilitate immediate use of the reconstructions and renderings.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The dataset may lower reliance on domain-adaptation methods by shrinking the visual gap between simulation and reality.
  • Direct performance comparisons on Replica versus real data could quantify how much scene fidelity is required for different tasks.
  • Adding dynamic objects or time-varying lighting to the scenes could extend the work toward video-based and interactive AI.

Load-bearing premise

The 18 scenes achieve sufficient photo-realism and geometric accuracy in meshes, textures, and semantics that ML models trained on them transfer directly to real-world image and video data without domain adaptation.

What would settle it

Train a semantic segmentation or navigation model on Replica renderings and measure its accuracy on real captured indoor images or videos; comparable results to models trained on real data would support the direct-transfer claim.

read the original abstract

We introduce Replica, a dataset of 18 highly photo-realistic 3D indoor scene reconstructions at room and building scale. Each scene consists of a dense mesh, high-resolution high-dynamic-range (HDR) textures, per-primitive semantic class and instance information, and planar mirror and glass reflectors. The goal of Replica is to enable machine learning (ML) research that relies on visually, geometrically, and semantically realistic generative models of the world - for instance, egocentric computer vision, semantic segmentation in 2D and 3D, geometric inference, and the development of embodied agents (virtual robots) performing navigation, instruction following, and question answering. Due to the high level of realism of the renderings from Replica, there is hope that ML systems trained on Replica may transfer directly to real world image and video data. Together with the data, we are releasing a minimal C++ SDK as a starting point for working with the Replica dataset. In addition, Replica is `Habitat-compatible', i.e. can be natively used with AI Habitat for training and testing embodied agents.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 2 minor

Summary. The manuscript introduces the Replica dataset consisting of 18 highly photo-realistic 3D indoor scene reconstructions at room and building scale. Each scene provides a dense mesh, high-resolution HDR textures, per-primitive semantic class and instance labels, and information on planar mirrors and glass reflectors. The goal is to support ML research in egocentric computer vision, semantic segmentation, geometric inference, and embodied AI, with the hope that trained models can transfer directly to real-world data. The authors release a minimal C++ SDK and note compatibility with the Habitat simulator.

Significance. The release of this dataset, along with the SDK and Habitat compatibility, represents a useful contribution to the field by providing a resource for training and testing models in highly detailed simulated indoor environments. If the claimed photo-realism holds, it could help advance research on sim-to-real transfer for tasks like navigation and question answering by embodied agents. The provision of semantic labels and reflector information strengthens its applicability to a range of CV and robotics tasks.

major comments (1)
  1. [Abstract] Abstract: The claim that 'due to the high level of realism of the renderings from Replica, there is hope that ML systems trained on Replica may transfer directly to real world image and video data' is presented without quantitative support such as FID/KID scores, perceptual similarity metrics, mesh reconstruction error statistics, or side-by-side comparisons to real RGB-D captures of the same rooms. This is load-bearing for the central motivation of direct transfer without domain adaptation.
minor comments (2)
  1. The manuscript would be strengthened by including a clear description of the data capture and reconstruction pipeline (including any accuracy metrics for geometry and textures) in a dedicated methods section.
  2. Clarify whether the released dataset includes the original captured RGB-D images in addition to the reconstructed meshes and textures, as this affects usability for validation studies.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the positive review and the helpful comment on the abstract. We address the concern point by point below.

read point-by-point responses

  1. Referee: [Abstract] Abstract: The claim that 'due to the high level of realism of the renderings from Replica, there is hope that ML systems trained on Replica may transfer directly to real world image and video data' is presented without quantitative support such as FID/KID scores, perceptual similarity metrics, mesh reconstruction error statistics, or side-by-side comparisons to real RGB-D captures of the same rooms. This is load-bearing for the central motivation of direct transfer without domain adaptation.

    Authors: We agree that the statement in the abstract is aspirational and lacks the quantitative evidence (FID/KID, perceptual metrics, reconstruction errors, or direct real-world comparisons) that would be needed to substantiate direct sim-to-real transfer. The phrasing uses 'there is hope' to reflect an intended outcome rather than a demonstrated result, and the manuscript's motivation section grounds the realism in the capture pipeline (high-resolution HDR textures, dense meshes, and reflector modeling) rather than in transfer experiments. Because the paper's primary contribution is the dataset release and not a transfer benchmark, we do not have these metrics available. We will therefore revise the abstract to qualify the claim, emphasizing that Replica provides a high-fidelity simulation environment intended to support research on sim-to-real transfer while making clear that direct transfer without adaptation remains an open question to be investigated by the community. revision: yes

Circularity Check

0 steps flagged

No derivation chain or predictions present in dataset release paper

full rationale

The paper introduces Replica as a collection of 18 reconstructed indoor scenes with meshes, HDR textures, semantics, and reflectors. Its sole forward-looking statement is an informal hope that renderings may enable direct ML transfer to real data. No equations, fitted parameters, uniqueness theorems, ansatzes, or predictions are defined or derived anywhere in the manuscript. The work is a data resource release whose claims rest on descriptive pipeline details rather than any self-referential reduction or construction from inputs.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claim depends on the domain assumption that the reconstructions are faithful to real spaces; no free parameters or invented entities are introduced.

axioms (1)
  • domain assumption The provided 3D reconstructions and renderings are sufficiently accurate and photo-realistic to represent real indoor environments.
    Invoked in the abstract when stating the goal of enabling direct transfer to real-world data.

pith-pipeline@v0.9.0 · 5614 in / 1195 out tokens · 102986 ms · 2026-05-12T16:29:51.021545+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 60 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

    cs.CV 2026-05 unverdicted novelty 8.0

    SpatialBench evaluates 41 spatial foundation models across 6 paradigms and 5 task suites, finds they are not all-round players, and introduces the DA-Next-5M dataset plus DA-Next baseline model.

  2. MAGS-SLAM: Monocular Multi-Agent Gaussian Splatting SLAM for Geometrically and Photometrically Consistent Reconstruction

    cs.RO 2026-05 unverdicted novelty 8.0

    MAGS-SLAM is the first RGB-only multi-agent 3D Gaussian Splatting SLAM framework that matches RGB-D performance via compact submap sharing, geometry-appearance loop verification, and occupancy-aware fusion.

  3. Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video

    cs.CV 2025-12 unverdicted novelty 8.0

    Integrating direction-of-arrival spectra and binaural embeddings from passive audio into vision models improves relative camera pose estimation in in-the-wild videos and adds robustness to visual corruption.

  4. Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI

    cs.CV 2021-09 accept novelty 8.0

    HM3D offers 1000 building-scale 3D environments that are larger and higher-fidelity than existing datasets, enabling better-performing embodied AI agents for tasks like PointGoal navigation.

  5. Think While You Map: Asynchronous Vision-Language Agents for Incremental 3D Scene Graphs

    cs.CV 2026-06 unverdicted novelty 7.0

    An asynchronous architecture decouples incremental voxel-based mapping from VLM-based semantic enrichment to produce queryable open-vocabulary 3D scene graphs that match or exceed prior methods on segmentation and gro...

  6. CasaMaestro: Multi-View Panoramas for House-Scale 3D Reconstruction

    cs.CV 2026-06 unverdicted novelty 7.0

    CasaMaestro predicts metric depth and poses from sparse multi-view panoramas to enable fast house-scale 3D reconstruction.

  7. GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping

    cs.CV 2026-06 unverdicted novelty 7.0

    GaussLite conditions 3D Gaussian Splatting seeding density, gradient flow, and scaling on task relevance masks derived from LLM-parsed natural language and open-vocabulary detection, yielding +2.72 dB ROI PSNR gains o...

  8. AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting

    cs.CV 2026-06 unverdicted novelty 7.0

    AEGIR explicitly models local area emitters inside a relightable Gaussian Splatting pipeline and uses a differentiable deferred renderer with multiple importance sampling plus regularization to jointly optimize emitte...

  9. SemanticXR: Low Power and Real-time Queryable Semantic Mapping with an Object-Level Device-Cloud Architecture

    cs.DC 2026-06 unverdicted novelty 7.0

    SemanticXR introduces the first device-cloud system for real-time open-vocabulary semantic mapping and querying that organizes work around semantically identifiable objects to meet XR power, bandwidth, and memory limits.

  10. ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo

    cs.RO 2026-05 unverdicted novelty 7.0

    ActMVS is the first monocular framework for active scene reconstruction that combines view factor graph construction with global depth optimization to generate online, globally consistent dense depth maps competitive ...

  11. REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image

    cs.CV 2026-05 unverdicted novelty 7.0

    REST3D reconstructs physically stable 3D scenes from single images via agentic scene-tree understanding and physics-constrained optimization.

  12. OP2GS: Object-Aware 3D Gaussian Splatting with Dual-Opacity Primitives

    cs.CV 2026-05 unverdicted novelty 7.0

    OP2GS adds instance identities and dual opacities to 3D Gaussians so that visual rendering and object-mask rendering are handled by separate opacity channels, reducing label contamination while attaching semantics at ...

  13. VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction

    cs.CV 2026-05 unverdicted novelty 7.0

    VGGT-Edit proposes a native 3D text-conditioned editing framework using depth-synchronized injection and residual field prediction, plus the DeltaScene dataset, outperforming 2D-lifting methods.

  14. PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting

    cs.CV 2026-05 unverdicted novelty 7.0

    PanoPlane achieves up to 17.8% PSNR gains in sparse-view indoor novel view synthesis by using training-free plane-aware panoramic completion to supervise 3D Gaussian Splatting.

  15. Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images

    cs.CV 2026-05 unverdicted novelty 7.0

    A new benchmark reveals MLLMs achieve only 13% or lower accuracy on advanced perspective-conditioned spatial tasks in omnidirectional images, with RL reward shaping raising a 7B model from 31% to 60% in controlled settings.

  16. Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images

    cs.CV 2026-05 conditional novelty 7.0

    MLLMs exhibit a large perception-reasoning gap on perspective-conditioned spatial reasoning in omnidirectional images, with accuracy falling from 57% on basic direction tasks to under 1% on compositional reasoning, th...

  17. Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images

    cs.CV 2026-05 unverdicted novelty 7.0

    MLLMs display a large perception-reasoning gap on perspective-conditioned spatial reasoning tasks from omnidirectional images, with sharp accuracy drops on advanced tasks like egocentric rotation, though partial gains...

  18. Differentiable Ray Tracing with Gaussians for Unified Radio Propagation Simulation and View Synthesis

    cs.CV 2026-05 unverdicted novelty 7.0

    Embedding Gaussian primitives into a ray tracing structure enables unified radio propagation simulation and view synthesis from visual-only reconstructions.

  19. MaMi-HOI: Harmonizing Global Kinematics and Local Geometry for Human-Object Interaction Generation

    cs.RO 2026-05 unverdicted novelty 7.0

    MaMi-HOI counters geometric forgetting in diffusion models via a Geometry-Aware Proximity Adapter for precise contacts and a Kinematic Harmony Adapter for natural whole-body postures in human-object interactions.

  20. Sparse-to-Complete: From Sparse Image Captures to Complete 3D Scenes

    cs.CV 2026-05 unverdicted novelty 7.0

    S2C-3D reconstructs complete high-fidelity 3D scenes from as few as 6-8 images by finetuning a diffusion model on scene data, applying consistency-conditioned sampling, and planning trajectories for full coverage.

  21. 3D Generation for Embodied AI and Robotic Simulation: A Survey

    cs.RO 2026-04 accept novelty 7.0

    3D generation for embodied AI is shifting from visual realism toward interaction readiness, organized into data generation, simulation environments, and sim-to-real bridging roles.

  22. A Survey of Spatial Memory Representations for Efficient Robot Navigation

    cs.CV 2026-04 unverdicted novelty 7.0

    The survey reviews spatial memory methods across 88 references, defines α as peak runtime memory over map size, profiles neural methods showing α from 2.3 to 215 on A100 GPU, and proposes a standardized evaluation pro...

  23. Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Prediction

    cs.SD 2026-04 unverdicted novelty 7.0

    BDATP enhances generalization in audio-visual navigation by explicitly modeling interaural differences and using auxiliary action prediction, achieving up to 21.6 percentage point gains in success rate on unheard soun...

  24. SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction

    cs.CV 2026-04 unverdicted novelty 7.0

    SparseSplat uses entropy-based probabilistic sampling and a specialized point cloud network to generate compact 3D Gaussian maps that retain high rendering quality with far fewer Gaussians than prior feed-forward methods.

  25. VBGS-SLAM: Variational Bayesian Gaussian Splatting Simultaneous Localization and Mapping

    cs.CV 2026-04 unverdicted novelty 7.0

    VBGS-SLAM uses variational inference on conjugate Gaussian properties to couple 3DGS map refinement and pose tracking with closed-form updates and posterior uncertainty, reducing drift compared to deterministic methods.

  26. VGGT-360: Geometry-Consistent Zero-Shot Panoramic Depth Estimation

    cs.CV 2026-03 unverdicted novelty 7.0

    VGGT-360 delivers geometry-consistent zero-shot panoramic depth by converting panoramas into multi-view 3D reconstructions via VGGT models and three plug-and-play correction modules, then reprojecting the result.

  27. EAG-PT: Emission-Aware Gaussians and Path Tracing for Diffuse Indoor Scene Reconstruction and Editing

    cs.GR 2026-01 unverdicted novelty 7.0

    EAG-PT reconstructs indoor scenes with emission-separated 2D Gaussians and uses path tracing for physically consistent editing of diffuse global illumination.

  28. 3AM: 3egment Anything with Geometric Consistency in Videos

    cs.CV 2026-01 unverdicted novelty 7.0

    3AM integrates MUSt3R 3D features into SAM2 via a Feature Merger and FOV-aware sampling to deliver geometry-consistent video object segmentation from RGB alone, with large gains on wide-baseline datasets.

  29. Decoupled Generative Modeling for Human-Object Interaction Synthesis

    cs.CV 2025-12 unverdicted novelty 7.0

    DecHOI decouples trajectory planning from motion synthesis to produce realistic human-object interactions without prescribed waypoints and with improved contact dynamics.

  30. StereoSpace: Depth-Free Synthesis of Stereo Geometry via End-to-End Diffusion in a Canonical Space

    cs.CV 2025-12 unverdicted novelty 7.0

    A viewpoint-conditioned diffusion model generates stereo image pairs from monocular input in a canonical rectified space without using depth or explicit warping.

  31. OpenTrack3D: Towards Accurate and Generalizable Open-Vocabulary 3D Instance Segmentation

    cs.CV 2025-12 unverdicted novelty 7.0

    OpenTrack3D achieves state-of-the-art open-vocabulary 3D instance segmentation by generating cross-view consistent proposals online with a visual-spatial tracker and replacing CLIP with an MLLM for improved compositio...

  32. MODEST: Multi-Optics Depth-of-Field Stereo Dataset

    cs.CV 2025-11 accept novelty 7.0

    MODEST provides the first large-scale high-resolution stereo DSLR dataset with systematic variation of focal length and aperture to support research on real-world optical effects in depth estimation.

  33. SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM

    cs.RO 2025-04 unverdicted novelty 7.0

    Presents SLAM&Render, a robot-recorded benchmark dataset with 40 multi-modal sequences for testing SLAM, novel view synthesis, and Gaussian Splatting under controlled variations in lighting, arrangements, and occlusions.

  34. Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis

    cs.CV 2026-07 conditional novelty 6.0

    RelGraphOV constructs relationship-aware 3D scene graphs via VLM reasoning and uses a dual-stream gated GAT to refine open-vocabulary 3D segmentation, achieving state-of-the-art on ScanNetV2, ScanNet200, ScanNet++, an...

  35. GUSH3R: Everyone Everywhere All at Once as Gaussians

    cs.CV 2026-07 conditional novelty 6.0

    A feed-forward framework predicts unified 3D Gaussian representations of dynamic humans and static scenes from monocular video in a single forward pass.

  36. FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image

    cs.CV 2026-06 unverdicted novelty 6.0

    FastPano3D generates high-fidelity 3D Gaussian scenes from a single panoramic image via feed-forward inference, claimed 156x faster than prior methods with half the parameters.

  37. Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

    cs.CV 2026-06 unverdicted novelty 6.0

    Argus is a feed-forward network for metric panoramic 3D reconstruction, trained on the new Realsee3D dataset of 10K indoor scenes and using a learned covisibility module plus decomposed mapping supervision to achieve ...

  38. Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

    cs.CV 2026-06 unverdicted novelty 6.0

    Argus introduces a covisibility module and decomposed pixel-to-world mapping to deliver SOTA metric performance on camera pose, depth, and point cloud tasks using the Realsee3D panoramic dataset.

  39. MyGO-Splat: Multi-Objective Closed-Loop Geometric Feedback for RGB-Only Gaussian SLAM

    cs.RO 2026-06 unverdicted novelty 6.0

    MyGO-Splat is a closed-loop RGB-only Gaussian SLAM system that rasterizes depth and normals from the map to supervise pose optimization and align monocular depth priors for scale consistency.

  40. CubifyGS: Object-Centric 3D Gaussian Splatting for Lifelong Dynamic Scene Maintenance

    cs.RO 2026-06 unverdicted novelty 6.0

    CubifyGS introduces object-level asset management in 3D Gaussian Splatting to handle object rearrangements in lifelong dynamic scenes more efficiently than primitive-level updates.

  41. Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement

    cs.CV 2026-06 unverdicted novelty 6.0

    Physics-decomposed transfer learning fuses cross-domain priors to enable label-free training and claims SOTA results for underwater image enhancement.

  42. JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space

    cs.CV 2026-06 unverdicted novelty 6.0

    JointEdit3D performs feed-forward 3D scene editing via asymmetric latent inpainting in a unified RGB-geometry space, with a new SceneEdit3D-15K dataset and benchmark showing gains in edited region quality and structur...

  43. Wild3R: Feed-Forward 3D Gaussian Splatting from Unconstrained Sparse Photo Collection

    cs.CV 2026-06 unverdicted novelty 6.0

    Wild3R is a feed-forward 3D Gaussian Splatting model trained on the new WildCity dataset of 200 scenes with 170 lighting conditions and transients to handle unconstrained sparse photo collections.

  44. Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding

    eess.AS 2026-06 unverdicted novelty 6.0

    Spatial-Omni introduces an SO-Encoder and new datasets to integrate FOA spatial audio into Omni LLMs, improving results on 16 spatial subtasks while preserving general audio performance.

  45. EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

    cs.CV 2026-06 unverdicted novelty 6.0

    EPS3D is an end-to-end architecture for 3D panoptic segmentation from multi-view images that uses distillation and semantic-instance mutual enhancement to achieve higher benchmark performance and speed than prior methods.

  46. GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence

    cs.CV 2026-06 unverdicted novelty 6.0

    GVC-Seg achieves state-of-the-art 3D instance segmentation by using geometric visual correspondence to mitigate confidence bias when ensembling proposals from foundation models in a training-free manner.

  47. UniSHARP: Universal Sharp Monocular View Synthesis

    cs.CV 2026-06 unverdicted novelty 6.0

    UniSHARP performs universal sharp monocular view synthesis by implicit alignment of diverse camera images in a unified omnidirectional latent space using ray-arranged Gaussian primitives and UniK3D-inspired feature decoding.

  48. Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

    cs.CV 2026-06 unverdicted novelty 6.0

    Anchor3R reframes feed-forward 3D reconstruction as current-centric local measurement prediction, using loop-closure and motion averaging to produce coherent global maps from visual streams.

  49. PixVOD: Pixel-Distributed Direct Visual Odometry and Depth Estimation

    cs.CV 2026-06 unverdicted novelty 6.0

    A pixel-distributed direct visual odometry and depth estimation method using Gaussian Belief Propagation with keyframe anchoring for on-sensor consensus.

  50. MLP Splatting: Object-Centric Neural Fields

    cs.CV 2026-06 unverdicted novelty 6.0

    MLP-Splatting decomposes scenes into a few compact MLP primitives with localized support for photorealistic novel-view synthesis and object-level editing from RGB supervision.

  51. BA-T: An Iterative Transformer for Two-View Bundle Adjustment

    cs.CV 2026-06 unverdicted novelty 6.0

    BA-T is an iterative Transformer that implements bundle adjustment as a repeatable lightweight layer to progressively refine pose and geometry predictions in two-view 3D reconstruction while using far fewer decoder pa...

  52. D\'ej\`a View: Looping Transformers for Multi-View 3D Reconstruction

    cs.CV 2026-05 unverdicted novelty 6.0

    DéjàView applies a single transformer block recurrently for K refinement steps, matching or exceeding larger feed-forward models on five multi-view 3D benchmarks with fewer parameters and comparable compute.

  53. DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding

    cs.CV 2026-05 unverdicted novelty 6.0

    DGSG-Mind is a hybrid 3D Gaussian dynamic scene graph system with an embodied reasoning agent for robust instance fusion, dynamic updates, and multimodal grounding in self-reconstructed maps.

  54. S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields

    cs.CV 2026-05 unverdicted novelty 6.0

    S2MDF is a lightweight add-on layer that applies a hard no-intersection constraint to any compositional SDF representation, reducing overlaps to numerical precision without architecture changes.

  55. Provably Guaranteed Polytopic Uncertainty Quantification for SLAM

    cs.RO 2026-05 unverdicted novelty 6.0

    Presents polytopic forward/backward/compound UQ modules for full 3D SLAM pipeline with deterministic containment guarantees and conformal prediction calibration from data.

  56. RGB-only Active 3D Scene Graph Generation for Indoor Mobile Robots

    cs.RO 2026-05 unverdicted novelty 6.0

    RGB-only active 3D scene graph generation unifies perception and planning to achieve depth-baseline parity and more than double object detection in active indoor exploration.

  57. Fixed External Cameras as Common Prior Maps for Active 3D Scene Graph Generation

    cs.RO 2026-05 unverdicted novelty 6.0

    Fixed external cameras as Common Prior Maps boost initial object recall in 3D scene graph generation by up to 79% and improve active exploration efficiency.

  58. CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage

    cs.CV 2026-05 unverdicted novelty 6.0

    Presents COVER, a greedy ERP viewpoint curator with coverage scoring and depth conflict penalization, and releases the CM-EVS dataset of 36k sparse panoramic RGB-D-pose frames from 1,275 indoor scenes plus outdoor data.

  59. VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors

    cs.CV 2026-05 unverdicted novelty 6.0

    VidSplat iteratively synthesizes novel views with geometry-guided video diffusion to enable robust Gaussian splatting reconstruction from sparse or single-image inputs.

  60. MoMo: Conditioned Contrastive Representation Learning for Preference-Modulated Planning

    cs.LG 2026-05 unverdicted novelty 6.0

    MoMo conditions contrastive representations and prediction operators on user preferences via FiLM and low-rank modulation to enable continuous modulation of plan safety while preserving inference efficiency.

Reference graph

Works this paper leans on

28 extracted references · 28 canonical work pages · cited by 103 Pith papers · 2 internal anchors

  1. [1]

    On Evaluation of Embodied Navigation Agents

    Peter Anderson, Angel X. Chang, Devendra Singh Chaplot, Alexey Dosovitskiy, Saurabh Gupta, Vladlen Koltun, Jana Kosecka, Jitendra Malik, Roozbeh Mottaghi, Manolis Savva, and Amir Roshan Zamir. On evaluation of embodied navigation agents. arXiv:1807.06757, 2018

    work page internal anchor Pith review arXiv 2018

  2. [2]

    Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments

    Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko S ¨underhauf, Ian Reid, Stephen Gould, and Anton van den Hen- gel. Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments. In CVPR, 2018

    work page 2018

  3. [3]

    Lawrence Zitnick, and Devi Parikh

    Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, and Devi Parikh. VQA: Visual Question Answering. In ICCV, 2015

    work page 2015

  4. [4]

    Zamir, Helen Jiang, Ioannis Brilakis, Martin Fischer, and Silvio Savarese

    Iro Armeni, Ozan Sener, Amir R. Zamir, Helen Jiang, Ioannis Brilakis, Martin Fischer, and Silvio Savarese. 3D semantic parsing of large- scale indoor spaces. In CVPR, 2016

    work page 2016

  5. [5]

    Ptex: Per-face texture mapping for production rendering

    Brent Burley and Dylan Lacewell. Ptex: Per-face texture mapping for production rendering. In Computer Graphics Forum , volume 27, pages 1155–1164. Wiley Online Library, 2008

    work page 2008

  6. [6]

    Matterport3D: Learning from RGB-D data in indoor environments

    Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Niessner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang. Matterport3D: Learning from RGB-D data in indoor environments. In 3DV, 2017. https://niessner.github.io/Matterport/

    work page 2017

  7. [7]

    Kenneth J. W. Craik. The Nature of Explanation . Cambridge University Press, 1943

    work page 1943

  8. [8]

    Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner

    Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner. Scannet: Richly-annotated 3D reconstructions of indoor scenes. In CVPR, 2017. http://www.scan- net.org/

    work page 2017

  9. [9]

    Embodied Question Answering

    Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra. Embodied Question Answering. In CVPR, 2018

    work page 2018

  10. [10]

    Direct sparse odometry

    Jakob Engel, Vladlen Koltun, and Daniel Cremers. Direct sparse odometry. TPAMI, 40(3):611–625, 2017

    work page 2017

  11. [11]

    Efficient graph- based image segmentation

    Pedro F Felzenszwalb and Daniel P Huttenlocher. Efficient graph- based image segmentation. IJCV, 59(2):167–181, 2004

    work page 2004

  12. [12]

    Example-based synthesis of 3D object arrange- ments

    Matthew Fisher, Daniel Ritchie, Manolis Savva, Thomas Funkhouser, and Pat Hanrahan. Example-based synthesis of 3D object arrange- ments. In ACM SIGGRAPH Asia , 2012

    work page 2012

  13. [13]

    The robotrix: An extremely photorealistic and very-large-scale indoor dataset of sequences with robot trajectories and interactions

    Alberto Garcia-Garcia, Pablo Martinez-Gonzalez, Sergiu Oprea, John Alejandro Castro-Vargas, Sergio Orts-Escolano, Jose Garcia- Rodriguez, and Alvaro Jover-Alvarez. The robotrix: An extremely photorealistic and very-large-scale indoor dataset of sequences with robot trajectories and interactions. In IROS, pages 6790–6797. IEEE, 2018

    work page 2018

  14. [14]

    Scenenet: understanding real world indoor scenes with synthetic data

    A Handa, V Patraucean, V Badrinarayanan, S Stent, and R Cipolla. Scenenet: understanding real world indoor scenes with synthetic data. arxiv preprint (2015). arXiv preprint arXiv:1511.07041 , 2015

    work page internal anchor Pith review arXiv 2015

  15. [15]

    Instant field-aligned meshes

    Wenzel Jakob, Marco Tarini, Daniele Panozzo, and Olga Sorkine- Hornung. Instant field-aligned meshes. ACM Transactions on Graph- ics, 34(6), November 2015

    work page 2015

  16. [16]

    ImageNet classi- fication with deep convolutional neural networks

    Alex Krizhevsky, Ilya Sutskever, and Geoff Hinton. ImageNet classi- fication with deep convolutional neural networks. In NIPS, 2012

    work page 2012

  17. [17]

    Interiornet: Mega-scale multi-sensor photo-realistic in- door scenes dataset

    Wenbin Li, Sajad Saeedi, John McCormac, Ronald Clark, Dimos Tzoumanikas, Qing Ye, Yuzhong Huang, Rui Tang, and Stefan Leutenegger. Interiornet: Mega-scale multi-sensor photo-realistic in- door scenes dataset. In BMVC, 2018

    work page 2018

  18. [18]

    Filling holes in meshes

    Peter Liepa. Filling holes in meshes. In ACM SIGGRAPH Symposium on Geometry Processing , pages 200–205, 2003

    work page 2003

  19. [19]

    Lawrence Zitnick

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Per- ona, Deva Ramanan, Piotr Dollr, and C. Lawrence Zitnick. Microsoft COCO: Common objects in context. In ECCV, 2014

    work page 2014

  20. [20]

    Lorensen and Harvey E

    William E. Lorensen and Harvey E. Cline. Marching cubes: A high resolution 3D surface construction algorithm. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’87, pages 163–169, New York, NY , USA,

    work page

  21. [21]

    S ´ebastien Loriot, Jane Tournois, and Ilker O. Yaz. Polygon mesh processing. In CGAL User and Reference Manual . CGAL Editorial Board, 4.14 edition, 2019

    work page 2019

  22. [22]

    ORB-SLAM: a versatile and accurate monocular SLAM system

    Raul Mur-Artal, Jose Maria Martinez Montiel, and Juan D Tardos. ORB-SLAM: a versatile and accurate monocular SLAM system. TRO, 31(5):1147–1163, 2015

    work page 2015

  23. [23]

    Davison, Pushmeet Kohi, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon

    Richard A Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J. Davison, Pushmeet Kohi, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon. Kinectfusion: Real- time dense surface mapping and tracking. In 2011 IEEE International Symposium on Mixed and Augmented Reality , pages 127–136. IEEE, 2011

    work page 2011

  24. [24]

    Habitat: A Platform for Embodied AI Research

    Manolis Savva*, Abhishek Kadian*, Oleksandr Maksymets*, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, Devi Parikh, and Dhruv Batra. Habitat: A platform for embodied ai research. arXiv preprint arXiv:1904.01201 , 2019

    work page Pith review arXiv 1904

  25. [25]

    Semantic scene completion from a single depth image

    Shuran Song, Fisher Yu, Andy Zeng, Angel X Chang, Manolis Savva, and Thomas Funkhouser. Semantic scene completion from a single depth image. In CVPR, 2017

    work page 2017

  26. [26]

    R. S. Sutton and A. G. Barto. An adaptive network that constructs and uses an internal model of its world. Cognition and Brain Theory , 1981

    work page 1981

  27. [27]

    Lovegrove, Julian Straub, Simon Green, Richard Szeliski, Steven Butterfield, Shobhit Verma, and Richard Newcombe

    Thomas Whelan, Michael Goesele, Steven J. Lovegrove, Julian Straub, Simon Green, Richard Szeliski, Steven Butterfield, Shobhit Verma, and Richard Newcombe. Reconstructing scenes with mirror and glass surfaces. ACM Transactions on Graphics (TOG) , 37(4):102, 2018

    work page 2018

  28. [28]

    Zamir, Zhiyang He, Alexander Sax, Jitendra Malik, and Silvio Savarese

    Fei Xia, Amir R. Zamir, Zhiyang He, Alexander Sax, Jitendra Malik, and Silvio Savarese. Gibson env: Real-world perception for embodied agents. In CVPR, 2018. http://gibsonenv.stanford.edu/database/

    work page 2018