Pith. sign in

REVIEW 2 major objections 5 minor 1 cited by

Single-image 3D reconstruction can be reframed as engine-native structured parsing that outputs movable object boxes, per-object meshes, and countable parametric lights, with a new benchmark supplying the missing supervision.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · deepseek-v4-flash

2026-08-01 09:04 UTC pith:RC24VAF3

load-bearing objection Lumera-2K's parametric-light annotations are the real novelty; the box benchmark is plausible but the underspecified sanitized protocol needs a sensitivity analysis before the headline ranking can be trusted. the 2 major comments →

arxiv 2607.20889 v1 pith:RC24VAF3 submitted 2026-07-23 cs.CV

Engine-Native Editable 3D World Reconstruction with Objects and Lighting

Junhao Chen , Xinghao Chen , Henghaofan Zhang , Zihao Qiao , Saining Zhang , Yongzhi Li , Ruqi Huang , Sisi Li
show 3 more authors
Yimin Sheng Jianyi Zhu Hao Zhao
This is my paper
classification cs.CV
keywords single-image 3D reconstructioneditable 3D scenesparametric lightinggame-engine datastructured scene parsing3D object detectionscene understandinglight estimation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Lumera argues that turning a single image into an editable 3D scene should be treated as game-engine structured parsing: the scene is an explicit set of entities—oriented object boxes with labels, parametric light tuples (x, y, z, r, g, b, I), per-object meshes, and an HDR environment probe—not a radiance field or a fused point cloud. The paper supplies the missing supervision with a benchmark built from 2,513 game-engine projects, containing 63 million object instances and 102.6K engine-native parametric lights across 95.1K views. Two fine-tuned point-cloud spatial-language parsers emit boxes and light tuples from a single image and its recovered depth; the paper reports that the box parser achieves the strongest overall detection, geometry, semantic, and layout scores among compared single-image methods, while the light parser finds nearly every non-empty scene but localizes individual lights imperfectly (F1 0.209 at 0.5 m). The contribution is a representation: local illumination becomes countable, editable, and measurable, and the remaining weak points become explicit benchmark targets.

Core claim

The central claim is that image-to-scene reconstruction should be factored around editable entities and that a game-engine dataset can make that factorization trainable. The paper introduces Lumera-2K, a benchmark built from 2,513 game-engine projects, and a reference pipeline, Lumera: a colored point cloud is fed to two schema-conditioned spatial-language decoders, one serializing oriented object boxes with open-vocabulary labels and the other serializing parametric light tuples. Boxes are projected back into the image to prompt per-object mesh reconstruction; an HDR environment is estimated separately; and a bounded agent loop may edit only whitelisted fields—object yaw and scale in the ge

What carries the argument

The load-bearing machinery is entity-token serialization: each object is an oriented 3D box written as a structured token block (class, center, yaw, extents) and each light is written as a seven-number tuple (x, y, z, r, g, b, I), both decoded autoregressively from a point-cloud-conditioned spatial-language model. This unifies detection and lighting estimation as one code-generation task and makes lights countable, matchable, and directly importable into a scene engine. Two supporting mechanisms carry the rest: a per-object mesh and HDR assembly stage, and a stage-aware Generator/Verifier loop whose executor freezes everything outside a field whitelist, validates each edit statically and dyn

Load-bearing premise

The top-line result rests on the sanitized evaluation protocol—invalid labels, non-positive sizes, repeated IDs, and ID-fallback cases are removed before scoring every method; if those exclusions disproportionately remove low-quality outputs of the comparison methods, the reported lead is partly a property of the scoring rules rather than reconstruction quality.

What would settle it

Re-run the box benchmark without the sanitized exclusions, applying identical constrained decoding and label filtering to every method; if the relative ordering changes or the gap collapses, the 'strongest overall' claim is protocol-dependent. A corroborating stress test is evaluating on real photos of large outdoor scenes, where the paper reports the monocular point-cloud front end drifts to around 17 m Chamfer-L2.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

If this is right

  • A single photo can yield an editable scene file—object instances with transforms, meshes, and discrete lights—rather than only view-synthesis pixels or a merged point cloud.
  • Parametric lights become a quantifiable prediction target: position, color, and intensity can be scored by position-first matching, giving future work an explicit benchmark metric.
  • Domain-specific fine-tuning of a point-cloud spatial-language model transfers to dense game-scale scenes, improving strict 3D overlap and semantic scores relative to prior single-image parsers.
  • Agentic refinement is usable as a bounded editor over an existing parse, not as a replacement for parsing: it improves a good indoor parse but does not rescue poor outdoor parses.
  • The named bottlenecks—individual-light recall, roughly 2.7x intensity error, relation recovery, and outdoor metric drift—are converted into concrete targets for later systems.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Testable extension: the box parser's advantage may transfer to other point-cloud backbones under the same schema-conditioned fine-tuning, which would show the contribution is the entity-serialized supervision rather than the specific base model.
  • The combination of near-perfect scene-level light recall and weak individual-light F1 suggests a practical two-stage design (decide that a scene contains lights, then localize them) and argues for supervising lights whose influence is visible even when the source geometry is off-frame.
  • The 2.7x intensity error with moderate color accuracy suggests luminous intensity is poorly readable from point-cloud location tokens; a regression head on rendered shading or a render-compare objective may close that gap faster than more autoregressive tokens.
  • If full native light parameters are predicted, explicit-scene-conditioned video synthesis could use consistent predicted lighting instead of baked appearance, an implicit downstream motivation of the paper.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper introduces Lumera, a benchmark and reference pipeline for engine-native, light-aware 3D scene reconstruction from a single image. It contributes Lumera-2K, a UE5-derived dataset of 2,513 projects with object boxes, parametric lights, HDR probes, and planned camera views; Lumera-Box and Lumera-Light, two SpatialLM-based SFT parsers for oriented 3D boxes and light tuples; and an assembly pipeline with per-object meshes, HDR estimation, and a bounded agentic refinement loop. Experiments report a sanitized box benchmark against DetAny3D, SpatialLM, N3D-VLM, and WildDet3D, claiming Lumera-Box is strongest overall, and a light benchmark claiming Lumera-Light recovers non-empty scenes almost always but localizes individual lights poorly (F1 0.209 at 0.5 m).

Significance. The dataset and the parametric-light prediction target are original and potentially useful: countable, engine-native light annotations are scarce, and the paper makes them a measurable benchmark quantity. If the benchmark protocol is sound, the results would establish a new evaluation axis for editable-scene reconstruction and identify concrete bottlenecks. The paper is empirically grounded, but the central comparison rests on a self-defined 'sanitized protocol' that is currently under-specified; the significance is conditional on making that protocol transparent and robust. No code or model weights are provided in the manuscript, but the dataset release is promised.

major comments (2)
  1. [Sec. 5.1 / Table 2 / Appendix I] The sanitized protocol is load-bearing for the headline claim 'Lumera-Box is the strongest overall method,' yet it is not defined. The text says it removes 'invalid labels, non-positive sizes, repeated IDs, and ID fallback cases,' but none of these categories are operationalized, and no per-method exclusion counts or sensitivity analysis are reported. Appendix I explicitly states that the parser lacks constrained decoding and that the protocol was necessary, so the filters can differentially discard baseline outputs that use different vocabularies or decoding schemes. The authors must define each filter, report how many predictions/scenes from each method were excluded, and rerun the benchmark with either all predictions repaired to a common schema or with the filters removed.
  2. [Table 2 / Sec. 5.2] The very large geometry errors for N3D-VLM (Chamf-L2 3430.24, C-MAE 2188.33) and the exactly zero mAP for DetAny3D and SpatialLM suggest a coordinate-frame, unit, or format mismatch rather than reconstruction quality alone. If baseline outputs are scored in a frame different from their own output convention, the comparison conflates mismatch with error. The paper should report an alignment-robust variant of the metrics (e.g., after a Sim(3) or rigid alignment of each method's outputs to the reference frame) and a per-method parse-success/validity breakdown. Without this, the magnitude of the claimed improvement is not interpretable.
minor comments (5)
  1. [Sec. 5.3 / Table 4] The sentence 'Lumera-Light recovers almost all non-empty scenes (recall 0.998)' is misleading in isolation. Since the benchmark contains no empty GT scenes, a trivial predictor that always emits one light would also achieve near-perfect scene recall. The paper should report a trivial-baseline comparison or rephrase the claim as 'the model almost always predicts at least one light.'
  2. [Sec. 4.4 / Sec. 5.3] The bounded refinement case study reports a 'VLM score' improving from 6.1 to 8.3, but the scoring VLM, the scale, and the prompt are not specified. This is a self-assessment by a VLM and should be labeled as anecdotal; the Chamfer reduction is more objective and should be emphasized.
  3. [Sec. 3.1 / Eq. (1)] The camera-planner weights w_c, w_n, w_a and the QA quality-score weights in Appendix A.5 are described as defaults in the release, but no values are given in the paper. A short table of the default weights would improve reproducibility.
  4. [Appendix G] The relabeling prompt uses a model named 'GPT-5.4-mini'; please provide a citation or a precise version identifier so that label noise is reproducible.
  5. [Appendix I] The outdoor Chamfer-L2 of about 17 m is a major front-end limitation and should appear in the main experimental section, not only in the limitations appendix, since it directly affects the metric-geometry interpretation for outdoor scenes.

Circularity Check

0 steps flagged

No significant circularity: Lumera's central benchmark claims rest on held-out supervised evaluation, not on fitted inputs renamed as predictions.

full rationale

Lumera-Box and Lumera-Light are fine-tuned SpatialLM checkpoints on Lumera-2K training streams; the headline numbers (box mAP 0.1141, IoU-B 0.2472, F-score 0.2762; light F1 0.209) are measured on project-level val+test splits under a sanitized protocol applied to all methods. The box targets come from UE5 component transforms and the light targets from engine component traversal; light evaluation matches predictions to GT UE5 exports through a loss-preserving adapter, not to the training targets. The only self-referential element is the case-study VLM score (Sec. 5.3), but the same passage also reports an external Chamfer drop and does not support the central benchmark claims. The sanitized protocol (Sec. 5.1) removes invalid labels and ID fallback cases before scoring; this is an evaluation-fairness risk because the filter is not precisely defined and no per-method exclusion counts are reported, but it is not a derivation that reduces to the paper's inputs. No equation equates a prediction to a fitted parameter, and no load-bearing claim is justified solely by self-citation. The derivation chain is therefore self-contained for the claims it actually makes.

Axiom & Free-Parameter Ledger

4 free parameters · 5 axioms · 0 invented entities

The central claims rest on the UE5-to-engine representation choice, the single-image point cloud as the sole geometric input, VLM-generated labels as ground truth, and two evaluation decisions (sanitization and Hungarian matching at 0.5 m) that are hand-chosen rather than derived.

free parameters (4)
  • camera planner weights w_c, w_n, w_a
    Hand-chosen weights in Eq. (1) controlling coverage, novelty, and fill; values not reported, tuned on UE5 projects.
  • QA quality-score weights = 0.34, 0.34, 0.18, 0.14
    Eq. (15) weights for luminance std, edge density, dominant color ratios; hand-set thresholds decide which frames survive.
  • camera sampling thresholds
    Appendix A: 60cm wall margin, 4m NMS distance, 12° yaw difference, object coverage thresholds, minimum view counts — all hand-picked.
  • sanitized benchmark exclusions
    Section 5.1 removes invalid labels, non-positive sizes, repeated IDs, and ID fallback cases before scoring; a post-hoc data selection choice affecting the central comparison.
axioms (5)
  • domain assumption UE5 game-engine scenes with countable parametric lights are a representative target for editable 3D scene reconstruction.
    Sec 1 and Table 1 motivate the task; the central evaluation is built on this choice.
  • domain assumption A single image's Depth Anything 3 point cloud provides sufficient metric 3D structure for box and light parsing.
    Sec 4.3: the point cloud is the only geometric input; Appendix I's outdoor Chamfer-L2 ~17m shows this is fragile.
  • domain assumption VLM relabeling of isolated renders with weak asset-name hints yields correct open-vocabulary labels.
    Sec 3.2 and Appendix G use GPT-5.4-mini; no human-verification rate is reported, so label noise may affect semantic scores.
  • ad hoc to paper Removing invalid predictions before scoring gives a fair comparison across methods.
    Sec 5.1 sanitized protocol; if exclusions disproportionately affect baselines, the 'strongest overall' claim is biased.
  • ad hoc to paper Position-first Hungarian matching at 0.5 m is an appropriate correspondence for light evaluation.
    Sec 5.3 / App E; color and intensity are then measured on matched pairs, so matching choice drives downstream metrics.

pith-pipeline@v1.3.0-alltime-deepseek · 24670 in / 12374 out tokens · 109737 ms · 2026-08-01T09:04:45.314533+00:00 · methodology

0 comments
read the original abstract

Editable 3D scene creation requires object instances and lights that can be inspected, moved, and imported into standard engines, yet existing single-image methods largely stop at room-scale geometry, baked/global illumination, or text-driven generation. We introduce Lumera (Light-aware Unified Engine-native Reconstruction and Assembly), a benchmark and reference pipeline for engine-native, light-aware 3D scene parsing from a single image. Lumera-2K is built from 2,513 UE5 projects and provides 3.73M components, 63M object instances, 102.6K engine-native parametric lights, and 95.1K camera views. On this data, Lumera-Box and Lumera-Light adapt VLM to parse object boxes and parametric light tuples (x,y,z,r,g,b,I), which are assembled with per-object mesh reconstruction, HDR environment estimation, and a bounded agentic refinement loop. In a sanitized box benchmark against DetAny3D, SpatialLM, N3D-VLM, and WildDet3D, Lumera-Box obtains the strongest overall detection, geometry, semantic, and layout scores (merged mAP 0.1141, IoU-B 0.2472, F-score 0.2762), while WildDet3D remains stronger on anchor recall. For lights, Lumera-Light recovers almost all non-empty scenes (recall 0.998) but remains limited at individual-light localization (F1 0.209 at 0.5 m); matched lights have median position error 0.261 m, median {\Delta}E2000 4.59, and intensity Pearson r=0.628. These results establish parametric lights as a measurable editable-scene target and expose remaining bottlenecks in relation structure, light recall/intensity, and cross-engine generalization.

Figures

Figures reproduced from arXiv: 2607.20889 by Hao Zhao, Henghaofan Zhang, Jianyi Zhu, Junhao Chen, Ruqi Huang, Saining Zhang, Sisi Li, Xinghao Chen, Yimin Sheng, Yongzhi Li, Zihao Qiao.

Figure 1
Figure 1. Figure 1: Given a single image, Lumera parses object-level 3D boxes and engine-native parametric lights, reconstructs per-object meshes, estimates an HDR [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Lumera pipeline. Top: structured parsing. A geometry front end reconstructs a colored point cloud from the input image; Lumera-Box and Lumera-Light, two independent SpatialLM SFT checkpoints, parse oriented object boxes and parametric light tuples (𝑥, 𝑦, 𝑧, 𝑟, 𝑔, 𝑏, 𝐼 ). Middle: instantiation and assembly. Boxes are projected back to the image to prompt instance masks; SAM3D reconstructs a textured mesh pe… view at source ↗
Figure 3
Figure 3. Figure 3: Schema-conditioned 3D scene parsing for object boxes and lights. Top: box parsing. A colored point cloud is paired with a task prompt and a Bbox schema, enabling the model to generate structured object layouts of the form Bbox(class, x, y, z, yaw, sx, sy, sz). This represents category-aware, orientation-aware 3D object localization as autoregressive layout-code prediction. Bottom: light parsing. Using the … view at source ↗
Figure 4
Figure 4. Figure 4: Case studies of image-conditioned 3D scene generation. Given a single input image, our method reconstructs coherent 3D scenes with plausible object layouts, geometry, and lighting across diverse environments. why a light-aware dataset and benchmark are useful: they expose the unsolved parts of game-scale editable reconstruction under a representation that downstream tools can actually use [PITH_FULL_IMAGE… view at source ↗
Figure 5
Figure 5. Figure 5: Qualitative inference results from Lumera-Light. Lumera-Light predicts engine-native parametric lights, shown against ground-truth light layouts in game-scale point clouds. Image GT Spatiallm N3D-VLM WildDet3D DetAny3D Ours [PITH_FULL_IMAGE:figures/full_fig_p012_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Qualitative inference results from Lumera-Box. 3D box parsing comparisons against SpatialLM, N3D-VLM, and WildDet3D, where Lumera-Box recovers denser and more spatially aligned editable object layouts [PITH_FULL_IMAGE:figures/full_fig_p012_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Qualitative comparison on image-conditioned 3D scene generation. Each column shows one input image and the corresponding 3D scene generated by different methods, including Ours, MIDI, CAST, SceneGen, VIGA, and Sam3D. Compared with prior approaches, our method better preserves the scene-level layout, object composition, and spatial relationships of the input image. It reconstructs more complete and coherent… view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh

    cs.CV 2026-07 conditional novelty 6.0

    Conditioning a video diffusion model on animated-mesh G-buffer maps (tracking + world position + normals) improves camera-and-object control over depth conditioning in the authors' 68-video benchmark.

Reference graph

Works this paper leans on

107 extracted references · 12 linked inside Pith · cited by 1 Pith paper

  1. [1]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Scannet: Richly-annotated 3d reconstructions of indoor scenes , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  2. [2]

    Communications of the ACM , volume=

    Nerf: Representing scenes as neural radiance fields for view synthesis , author=. Communications of the ACM , volume=. 2021 , publisher=

    2021

  3. [3]

    ACM transactions on graphics (TOG) , volume=

    Instant neural graphics primitives with a multiresolution hash encoding , author=. ACM transactions on graphics (TOG) , volume=. 2022 , publisher=

    2022

  4. [4]

    , author=

    3d gaussian splatting for real-time radiance field rendering. , author=. ACM Trans. Graph. , volume=

  5. [5]

    ACM SIGGRAPH 2024 conference papers , pages=

    2d gaussian splatting for geometrically accurate radiance fields , author=. ACM SIGGRAPH 2024 conference papers , pages=

    2024

  6. [6]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Scaffold-gs: Structured 3d gaussians for view-adaptive rendering , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  7. [7]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Total3dunderstanding: Joint layout, object pose and mesh reconstruction for indoor scenes from a single image , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  8. [8]

    International Conference on Learning Representations , volume=

    Monst3r: A simple approach for estimating geometry in the presence of motion , author=. International Conference on Learning Representations , volume=

  9. [9]

    proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Deep hough voting for 3d object detection in point clouds , author=. proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  10. [10]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    An end-to-end transformer model for 3d object detection , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  11. [11]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Embodiedscan: A holistic multi-modal 3d perception suite towards embodied ai , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  12. [12]

    European Conference on Computer Vision , pages=

    Scenescript: Reconstructing scenes with an autoregressive structured language model , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  13. [13]

    Advances in Neural Information Processing Systems , volume=

    Spatiallm: Training large language models for structured indoor modeling , author=. Advances in Neural Information Processing Systems , volume=

  14. [14]

    European Conference on Computer Vision , pages=

    Structured3d: A large photo-realistic dataset for structured 3d modeling , author=. European Conference on Computer Vision , pages=. 2020 , organization=

    2020

  15. [15]

    Machine Vision and Applications , volume=

    Ultraman: ultra-fast and high-resolution texture generation for 3D human reconstruction from a single image , author=. Machine Vision and Applications , volume=. 2026 , publisher=

    2026

  16. [16]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Hypersim: A photorealistic synthetic dataset for holistic indoor scene understanding , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  17. [17]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    3d-front: 3d furnished rooms with layouts and semantics , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  18. [18]

    Proceedings of the 36th International Conference on Neural Information Processing Systems , pages=

    ProcTHOR: large-scale embodied AI using procedural generation , author=. Proceedings of the 36th International Conference on Neural Information Processing Systems , pages=

  19. [19]

    Fangsheng Weng and Junhao Chen and Xiang Li and Jie Qin and Hanzhong Guo and ShaochunHao and Xiaoguang Han , booktitle=. Garment. 2026 , url=

    2026

  20. [20]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Infinigen indoors: Photorealistic indoor scenes using procedural generation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  21. [21]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Holodeck: Language guided generation of 3d embodied ai environments , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  22. [22]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Deepcad: A deep generative network for computer-aided design models , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  23. [23]

    ACM Transactions on Graphics (TOG) , volume=

    BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patch , author=. ACM Transactions on Graphics (TOG) , volume=. 2025 , publisher=

    2025

  24. [24]

    The Thirteenth International Conference on Learning Representations , year=

    EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generation , author=. The Thirteenth International Conference on Learning Representations , year=

  25. [25]

    arXiv preprint arXiv:2411.09595 , year=

    Llama-mesh: Unifying 3d mesh generation with language models , author=. arXiv preprint arXiv:2411.09595 , year=

    Pith/arXiv arXiv

  26. [26]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Meshgpt: Generating triangle meshes with decoder-only transformers , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  27. [27]

    Advances in Neural Information Processing Systems , volume=

    Omnisvg: A unified scalable vector graphics generation model , author=. Advances in Neural Information Processing Systems , volume=

  28. [28]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Generating physically stable and buildable brick structures from text , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  29. [29]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Drive: Diffusion-based rigging empowers generation of versatile and expressive characters , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  30. [30]

    arXiv preprint arXiv:2603.11554 , year=

    MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks , author=. arXiv preprint arXiv:2603.11554 , year=

    arXiv

  31. [31]

    The Fourteenth International Conference on Learning Representations , year=

    DanceTogether: Generating Interactive Multi-Person Video without Identity Drifting , author=. The Fourteenth International Conference on Learning Representations , year=

  32. [32]

    arXiv preprint arXiv:2604.09415 , year=

    PhysInOne: Visual Physics Learning and Reasoning in One Suite , author=. arXiv preprint arXiv:2604.09415 , year=

    Pith/arXiv arXiv

  33. [33]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Objaverse: A universe of annotated 3d objects , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  34. [34]

    Advances in Neural Information Processing Systems , volume=

    Objaverse-xl: A universe of 10m+ 3d objects , author=. Advances in Neural Information Processing Systems , volume=

  35. [35]

    Advances in Neural Information Processing Systems , volume=

    Depth anything v2 , author=. Advances in Neural Information Processing Systems , volume=

  36. [36]

    arXiv preprint arXiv:2511.10647 , year=

    Depth anything 3: Recovering the visual space from any views , author=. arXiv preprint arXiv:2511.10647 , year=

    Pith/arXiv arXiv

  37. [37]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Dust3r: Geometric 3d vision made easy , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  38. [38]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Vggt: Visual geometry grounded transformer , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  39. [39]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Structured 3d latents for scalable and versatile 3d generation , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  40. [40]

    arXiv preprint arXiv:2511.16624 , year=

    Sam 3d: 3dfy anything in images , author=. arXiv preprint arXiv:2511.16624 , year=

    Pith/arXiv arXiv

  41. [41]

    European Conference on Computer Vision , pages=

    Intrinsic single-image hdr reconstruction , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  42. [42]

    arXiv preprint arXiv:2507.16869 , year=

    Controllable video generation: A survey , author=. arXiv preprint arXiv:2507.16869 , year=

    arXiv

  43. [43]

    IEEE Transactions on Pattern Analysis and Machine Intelligence , year=

    Human motion video generation: A survey , author=. IEEE Transactions on Pattern Analysis and Machine Intelligence , year=

  44. [44]

    Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers , pages=

    Diffusion as shader: 3d-aware video diffusion for versatile video generation control , author=. Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers , pages=

  45. [45]

    Proceedings of the SIGGRAPH Asia 2025 Conference Papers , pages=

    VideoFrom3D: 3D Scene Video Generation via Complementary Image and Video Diffusion Models , author=. Proceedings of the SIGGRAPH Asia 2025 Conference Papers , pages=

    2025

  46. [46]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =

    Huang, Kaiyi and Huang, Yukun and Li, Yu and Bai, Jianhong and Wang, Xintao and Lin, Zinan and Ning, Xuefei and Yu, Jiwen and Wang, Yu and Liu, Xihui , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2026 , pages =

    2026

  47. [47]

    2026 , eprint=

    From Frames to Sequences: Temporally Consistent Human-Centric Dense Prediction , author=. 2026 , eprint=

    2026

  48. [48]

    Introducing GPT-5.4 mini and nano , year =

  49. [49]

    European Conference on Computer Vision , pages=

    Blenderalchemy: Editing 3d graphics with vision-language models , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  50. [50]

    arXiv preprint arXiv:2601.11109 , year=

    Vision-as-inverse-graphics agent via interleaved multimodal reasoning , author=. arXiv preprint arXiv:2601.11109 , year=

    Pith/arXiv arXiv

  51. [51]

    2023 IEEE International Conference on Robotics and Automation (ICRA) , pages=

    Mask3d: Mask transformer for 3d semantic instance segmentation , author=. 2023 IEEE International Conference on Robotics and Automation (ICRA) , pages=. 2023 , organization=

    2023

  52. [52]

    European conference on computer vision , pages=

    Scanrefer: 3d object localization in rgb-d scans using natural language , author=. European conference on computer vision , pages=. 2020 , organization=

    2020

  53. [53]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Multi3drefer: Grounding text description to multiple 3d objects , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  54. [54]

    Proceedings of the 37th International Conference on Neural Information Processing Systems , pages=

    OpenMask3D: open-vocabulary 3D instance segmentation , author=. Proceedings of the 37th International Conference on Neural Information Processing Systems , pages=

  55. [55]

    European Conference on Computer Vision , pages=

    Pointllm: Empowering large language models to understand point clouds , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  56. [56]

    arXiv preprint arXiv:2602.10116 , year=

    Sage: Scalable agentic 3d scene generation for embodied ai , author=. arXiv preprint arXiv:2602.10116 , year=

    arXiv

  57. [57]

    arXiv preprint arXiv:2602.09153 , year=

    Scenesmith: Agentic generation of simulation-ready indoor scenes , author=. arXiv preprint arXiv:2602.09153 , year=

    Pith/arXiv arXiv

  58. [58]

    arXiv preprint arXiv:2602.11757 , year=

    Code2worlds: Empowering coding llms for 4d world generation , author=. arXiv preprint arXiv:2602.11757 , year=

    arXiv

  59. [59]

    2026 , eprint=

    Feedforward 3D Editing Learns from Semantic-Part Transformation , author=. 2026 , eprint=

    2026

  60. [60]

    International Conference on Learning Representations , volume=

    Depth pro: Sharp monocular metric depth in less than a second , author=. International Conference on Learning Representations , volume=

  61. [61]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Metric3d: Towards zero-shot metric 3d prediction from a single image , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  62. [62]

    Proceedings of the 31st International Conference on Computational Linguistics , pages=

    Idea23d: Collaborative lmm agents enable 3d model generation from interleaved multimodal inputs , author=. Proceedings of the 31st International Conference on Computational Linguistics , pages=

  63. [63]

    arXiv preprint arXiv:2508.10868 , year=

    Texverse: A universe of 3d objects with high-resolution textures , author=. arXiv preprint arXiv:2508.10868 , year=

    Pith/arXiv arXiv

  64. [64]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =

    Sun, Mingze and Zeng, Cheng and Pei, Jiansong and Chen, Junhao and Song, Chaoyue and Wang, Shaohui and Chang, Tianyuan and Huang, Bin and Zeng, Zijiao and Huang, Ruqi , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2026 , pages =

    2026

  65. [65]

    European conference on computer vision , pages=

    Grounding image matching in 3d with mast3r , author=. European conference on computer vision , pages=. 2024 , organization=

    2024

  66. [66]

    arXiv preprint arXiv:2310.15110 , year=

    Zero123++: a single image to consistent multi-view diffusion base model , author=. arXiv preprint arXiv:2310.15110 , year=

    Pith/arXiv arXiv

  67. [67]

    arXiv preprint arXiv:2404.07191 , year=

    Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models , author=. arXiv preprint arXiv:2404.07191 , year=

    Pith/arXiv arXiv

  68. [68]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =

    Chen, Junhao and Gao, Kejun and Cui, Yuehan and Sun, Mingze and Chen, Mingjin and Wang, Shaohui and Long, Xiaoxiao and Ma, Fei and Tian, Qi and Zhao, Hao and Huang, Ruqi , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2026 , pages =

    2026

  69. [69]

    Forty-first International Conference on Machine Learning , year=

    Scenecraft: An llm agent for synthesizing 3d scenes as blender code , author=. Forty-first International Conference on Machine Learning , year=

  70. [70]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , year =

    Fan-Yun Sun and Weiyu Liu and Siyi Gu and Dylan Lim and Goutam Bhat and Federico Tombari and Manling Li and Nick Haber and Jiajun Wu , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , year =

  71. [71]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Odam: Object detection, association, and mapping using posed rgb video , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  72. [72]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =

    Chen, Mingjin and Chen, Junhao and Fan, Zhaoxin and Lee, Yujian and Dang, Zichen and Wang, Lili and Cui, Yawen and Chau, Lap-Pui and Wang, Yi , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2026 , pages =

    2026

  73. [73]

    2026 , eprint=

    One Video, One World: Turning Monocular Video into Physical 4D Scenes , author=. 2026 , eprint=

    2026

  74. [74]

    arXiv preprint arXiv:2512.16561 , year=

    N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models , author=. arXiv preprint arXiv:2512.16561 , year=

    arXiv

  75. [75]

    WildDet3D: Scaling Promptable 3D Detection in the Wild , author=

  76. [76]

    2025 International Conference on 3D Vision (3DV) , pages=

    Gen3dsr: Generalizable 3d scene reconstruction via divide and conquer from a single view , author=. 2025 International Conference on 3D Vision (3DV) , pages=. 2025 , organization=

    2025

  77. [77]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Cad-estate: Large-scale cad model annotation in rgb videos , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  78. [78]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Colmap-free 3d gaussian splatting , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  79. [79]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Wonderjourney: Going from anywhere to everywhere , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  80. [80]

    arXiv preprint arXiv:2311.13384 , year=

    Luciddreamer: Domain-free generation of 3d gaussian splatting scenes , author=. arXiv preprint arXiv:2311.13384 , year=

    Pith/arXiv arXiv

Showing first 80 references.