pith. sign in

arxiv: 2605.06088 · v2 · pith:W2K32ELXnew · submitted 2026-05-07 · 💻 cs.CV

OpenGaFF: Open-Vocabulary Gaussian Feature Field with Codebook Attention

Kunyi Li , Michael Niemeyer , Sen Wang , Stefano Gasperini , Nassir Navab , Federico Tombari This is my paper

Pith reviewed 2026-05-20 23:24 UTC · model grok-4.3

classification 💻 cs.CV
keywords open-vocabulary3D scene understandingGaussian Splattingsemantic segmentationfeature fieldcodebook attention3D consistency
0
0 comments X

The pith

OpenGaFF conditions semantic predictions on Gaussian geometry and uses a shared codebook to achieve consistent open-vocabulary 3D understanding.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents OpenGaFF as a way to handle fragmented semantic labels when lifting 2D open-vocabulary models into 3D Gaussian Splatting scenes. It models semantics as a continuous field that depends directly on each Gaussian's position, shape, and appearance rather than treating features independently per view. A learned codebook supplies reusable semantic building blocks while a matching attention step pulls language-aligned features only from the most similar codebook entries. This setup is meant to cut down on contradictory labels for the same 3D point across different camera angles. The authors show the resulting fields produce cleaner 2D and 3D segmentations on standard benchmarks.

Core claim

The central claim is that explicitly tying semantic output to the underlying Gaussian geometry and appearance, then routing language features through a discrete codebook via attention, produces spatially coherent open-vocabulary labels and reduces feature variance inside individual objects. The codebook acts as a set of shared semantic primitives that the attention mechanism queries by similarity, allowing the model to reason about novel categories without retraining while keeping predictions consistent across multi-view observations.

What carries the argument

Gaussian Feature Field that represents semantics as a continuous function of each Gaussian's geometry and appearance, together with a structured codebook and codebook-guided attention that retrieves language features by similarity matching.

If this is right

  • Semantic labels become more consistent across multiple camera views of the same 3D structure.
  • Intra-object feature variance decreases because predictions are routed through a small set of shared codebook entries.
  • The learned codebook entries become semantically interpretable, revealing what primitives the model has discovered.
  • Open-vocabulary queries succeed on novel categories without requiring per-scene retraining.
  • Segmentation quality improves on both 2D rendered views and direct 3D evaluations.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The same conditioning principle could be tested on other 3D representations such as meshes or point clouds to see if geometry-semantics coupling generalizes.
  • An interpretable codebook might support user-driven editing of semantic categories by swapping or combining codebook vectors.
  • If the attention mechanism scales efficiently, the approach could support online updates when new views or objects are added to a scene.

Load-bearing premise

Conditioning semantic predictions directly on geometric structure will create tighter links between shape and meaning and therefore reduce contradictory labels for the same 3D region seen from different views.

What would settle it

Run the same open-vocabulary 3D benchmarks with the geometric conditioning removed or replaced by view-independent features and check whether cross-view label agreement and segmentation metrics drop below the reported OpenGaFF numbers.

Figures

Figures reproduced from arXiv: 2605.06088 by Federico Tombari, Kunyi Li, Michael Niemeyer, Nassir Navab, Sen Wang, Stefano Gasperini.

Figure 1
Figure 1. Figure 1: OpenGaFF is an open-vocabulary 3D scene understanding method and achieves precise segmentation and consistently high vision-language similarity score in both 2D and 3D evaluations. Abstract Understanding open-vocabulary 3D scenes with Gaussian-based representations remains challenging due to fragmented and spatially inconsistent semantic predic￾tions across multi-view observations. In this paper, we presen… view at source ↗
Figure 2
Figure 2. Figure 2: Overview of OpenGaFF. We first preprocess RGB images using foundation models to generate ground-truth language features. These features are clustered for structured language codebook initialization, while PCA is applied to per-view feature maps to obtain low-dimensional representations for supervising the Gaussian Feature Field. In Stage 1, the Gaussian Feature Field is trained by 2D feature distillation. … view at source ↗
Figure 3
Figure 3. Figure 3: Qualitative Evaluation of 2D and 3D Open-Vocabulary Query on LERF-OVS [28]. We visualize vision-language similarity as 2D heatmaps. For the shown 3D results, we perform open-vocabulary segmentation directly in 3D and render selected Gaussians. Our method achieve more precise and consistent segmentation in both 2D and 3D. 4 Experiments 4.1 Experimental Setup Datasets. Following previous methods [13, 16, 14]… view at source ↗
Figure 4
Figure 4. Figure 4: Qualitative Evaluation of 3D Open-Vocabulary Query on ScanNet-v2 [33]. We highlight the Gaussians corresponding to the query text. Our approach produces more spatially consistent responses while LangSplatV2 [10] exhibits significant noise and inconsistent activations. fragmented or noisy results. Due to weak geometry–semantic coupling, relevant Gaussians may be missed, leading to incomplete shapes (e.g., "… view at source ↗
Figure 5
Figure 5. Figure 5: What Does the Codebook Capture? LangSplatV2 [10] encodes semantics in a dis￾tributed manner, where a single entry may rep￾resent multiple objects or an object may span mul￾tiple entries. In contrast, our method learns disen￾tangled semantic units. Recent works [21, 14, 10] have demonstrated the effectiveness of incorporating codebook learn￾ing into 3D scene understanding. However, an open question remains:… view at source ↗
Figure 6
Figure 6. Figure 6: Ablation Studies. We conduct comprehensive ablation studies to demonstrate the effectc of differnet proposed contributions and report the mIoU of 3D OVS on the whole scene. explicitly couples semantics with geometry, enabling consistent feature propagation across spatially coherent regions and producing more complete and robust segmentation in both 2D and 3D. Ablation on Attention Module. We replace the co… view at source ↗
Figure 7
Figure 7. Figure 7: Ablation on Entropy Loss. We report the mIoU of 3D OVS on Figurines scene. Larger λentropy values encourage stricter object-level bindings but may over-specialize entries, hurting rare object learning due to limited observations. Rendered RGB Rendered LD Feature Predicted Language Feature Ours View 1 View 2 Predicted Language Feature LangSplatV2 view at source ↗
Figure 8
Figure 8. Figure 8: Illustration of Object-Level Feature Consistency. Compared with the language feature maps predicted by LangSplatV2 [10], ours are more consistent and clearer, demonstrating superior segmentation performance. can be suboptimal for objects that appear infrequently in the training data. Due to limited observations, such objects may not be sufficiently learned, leading to degraded segmentation performance. Thi… view at source ↗
Figure 9
Figure 9. Figure 9: Visualization of Codebook Entries. We present per-entry heatmaps and their correspond￾ing masked RGB images to visualize the regions each codebook entry attends to. These results demonstrate that our codebook effectively captures disentangled and semantically meaningful units. D.3 More Evaluation on ScanNet-v2 We visualize the predicted semantic feature point clouds and compare them with the ground-truth s… view at source ↗
Figure 10
Figure 10. Figure 10: Qualitative Evaluation of 2D Open-Vocabulary Segmentation on MipNeRF360 [32]. Our method can predict more precise and consistent segmentation in both 2D and 3D. stems from our Gaussian Feature Field (Section 3.2), which effectively couples 3D geometry with semantic representations. 5 view at source ↗
Figure 11
Figure 11. Figure 11: Additional Qualitative Evaluation of 2D and 3D Open-Vocabulary Segmentation on LERF-OVS [28]. Our method can predict more precise and consistent segmentation in both 2D and 3D. 6 view at source ↗
Figure 12
Figure 12. Figure 12: Additional Qualitative Evaluation of 3D Open-Vocabulary Segmentation on ScanNet￾v2 [33]. We visualize the language feature point cloud. Ours method can predict clean and more consistent language feature. 7 view at source ↗
read the original abstract

Understanding open-vocabulary 3D scenes with Gaussian-based representations remains challenging due to fragmented and spatially inconsistent semantic predictions across multi-view observations. In this paper, we present OpenGaFF, a novel framework for open-vocabulary 3D scene understanding built upon 3D Gaussian Splatting. At the core of our method is a Gaussian Feature Field that models semantics as a continuous function of Gaussian geometry and appearance. By explicitly conditioning semantic predictions on geometric structure, this formulation strengthens the coupling between geometry and semantics, leading to improved spatial coherence across similar structures in 3D space. To further enforce object-level semantic consistency, we introduce a structured codebook that serves as a set of shared semantic primitives. Furthermore, a codebook-guided attention mechanism is proposed to retrieve language features via similarity matching between query embeddings and learned codebook entries, enabling robust open-vocabulary reasoning while reducing intra-object feature variance. Extensive experiments on standard 2D and 3D open-vocabulary benchmarks demonstrate that our method consistently outperforms prior approaches, achieving improved segmentation quality, stronger 3D semantic consistency and a semantically interpretable codebook that provides insight into the learned representation.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 2 minor

Summary. The paper claims to present OpenGaFF, a novel framework for open-vocabulary 3D scene understanding built upon 3D Gaussian Splatting. The core is a Gaussian Feature Field that models semantics as a continuous function of Gaussian geometry and appearance. A structured codebook and codebook-guided attention mechanism are introduced to enforce object-level semantic consistency and enable robust open-vocabulary reasoning. Extensive experiments on standard 2D and 3D open-vocabulary benchmarks are said to demonstrate consistent outperformance over prior approaches in segmentation quality and 3D semantic consistency.

Significance. If the empirical claims hold, this work could be significant for improving spatial coherence in 3D semantic predictions by better integrating geometric structure with semantics in Gaussian-based representations. The semantically interpretable codebook is a strength that may offer insights into the learned features. The approach is timely given the rise of Gaussian Splatting in 3D vision.

minor comments (2)
  1. The abstract does not include any quantitative results or specific benchmark names, which would help readers quickly assess the claims.
  2. Clarify the exact formulation of how the attention mechanism retrieves language features; an equation would improve clarity.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for their positive summary of our work, recognition of its potential significance, and recommendation for minor revision. We will incorporate all minor suggestions into the revised manuscript.

Circularity Check

0 steps flagged

No significant circularity in derivation chain

full rationale

The paper proposes a new technical construction: a Gaussian Feature Field that models semantics as a continuous function of per-Gaussian geometry and appearance, augmented by a learned codebook of shared semantic primitives and a codebook-guided attention mechanism for language feature retrieval. These elements are introduced as architectural choices within a 3D Gaussian Splatting backbone rather than derived from or reduced to fitted parameters, prior self-citations, or re-expressions of the target quantities. Performance improvements are presented strictly as outcomes of experiments on external 2D and 3D benchmarks, with no equations or steps shown that equate a claimed prediction back to its own inputs by construction. The argument therefore remains self-contained and externally falsifiable.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 2 invented entities

Review performed on abstract only; no explicit free parameters, mathematical axioms, or independent evidence for new entities are stated in the provided text.

invented entities (2)
  • Gaussian Feature Field no independent evidence
    purpose: Models semantics as a continuous function of Gaussian geometry and appearance
    Core modeling choice introduced to couple geometry and semantics.
  • structured codebook no independent evidence
    purpose: Serves as shared semantic primitives to enforce object-level consistency
    Introduced to reduce intra-object feature variance via similarity matching.

pith-pipeline@v0.9.0 · 5746 in / 1280 out tokens · 53303 ms · 2026-05-20T23:24:05.056611+00:00 · methodology

Review history (2 revisions) →

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Reference graph

Works this paper leans on

36 extracted references · 36 canonical work pages · 2 internal anchors

  1. [1]

    Drivedreamer: Towards real-world-drive world models for autonomous driving

    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jiagang Zhu, and Jiwen Lu. Drivedreamer: Towards real-world-drive world models for autonomous driving. InEuropean conference on computer vision, pages 55–72. Springer, 2024

    work page 2024

  2. [2]

    Driving into the future: Multiview visual forecasting and planning with world model for autonomous driving

    Yuqi Wang, Jiawei He, Lue Fan, Hongxin Li, Yuntao Chen, and Zhaoxiang Zhang. Driving into the future: Multiview visual forecasting and planning with world model for autonomous driving. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14749–14759, 2024

    work page 2024

  3. [3]

    Openemma: Open-source multimodal model for end-to-end autonomous driving

    Shuo Xing, Chengyuan Qian, Yuping Wang, Hongyuan Hua, Kexin Tian, Yang Zhou, and Zhengzhong Tu. Openemma: Open-source multimodal model for end-to-end autonomous driving. InProceedings of the Winter Conference on Applications of Computer Vision, pages 1001–1009, 2025

    work page 2025

  4. [4]

    Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments

    Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko Sünderhauf, Ian Reid, Stephen Gould, and Anton Van Den Hengel. Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 3674–3683, 2018

    work page 2018

  5. [5]

    Magma: A foundation model for multimodal ai agents

    Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, et al. Magma: A foundation model for multimodal ai agents. InProceedings of the computer vision and pattern recognition conference, pages 14203–14214, 2025

    work page 2025

  6. [6]

    A comprehensive survey of scene graphs: Generation and application.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1):1–26, 2021

    Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, and Alex Hauptmann. A comprehensive survey of scene graphs: Generation and application.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1):1–26, 2021

    work page 2021

  7. [7]

    Foundations of spatial perception for robotics: Hierarchical representations and real-time systems.The International Journal of Robotics Research, 43(10):1457–1505, 2024

    Nathan Hughes, Yun Chang, Siyi Hu, Rajat Talak, Rumaia Abdulhai, Jared Strader, and Luca Carlone. Foundations of spatial perception for robotics: Hierarchical representations and real-time systems.The International Journal of Robotics Research, 43(10):1457–1505, 2024

    work page 2024

  8. [8]

    Openscene: 3d scene understanding with open vocabularies

    Songyou Peng, Kyle Genova, Chiyu Jiang, Andrea Tagliasacchi, Marc Pollefeys, Thomas Funkhouser, et al. Openscene: 3d scene understanding with open vocabularies. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 815–824, 2023

    work page 2023

  9. [9]

    Langsplat: 3d language gaus- sian splatting

    Minghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang, and Hanspeter Pfister. Langsplat: 3d language gaus- sian splatting. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20051–20060, 2024

    work page 2024

  10. [10]

    Langsplatv2: High- dimensional 3d language gaussian splatting with 450+ fps

    Wanhua Li, Yujie Zhao, Minghan Qin, Yang Liu, Yuanhao Cai, and Chuang Gan. Langsplatv2: High- dimensional 3d language gaussian splatting with 450+ fps. InAnnual Conference on Neural Information Processing Systems, 2025

    work page 2025

  11. [11]

    3d gaussian splatting for real-time radiance field rendering.ACM Trans

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering.ACM Trans. Graph., 42(4):139–1, 2023

    work page 2023

  12. [12]

    Language-driven Semantic Segmentation

    Boyi Li, Kilian Q Weinberger, Serge Belongie, Vladlen Koltun, and René Ranftl. Language-driven semantic segmentation.arXiv preprint arXiv:2201.03546, 2022

    work page internal anchor Pith review Pith/arXiv arXiv 2022

  13. [13]

    Opengaussian: Towards point-level 3d gaussian-based open vocabulary understanding.Advances in Neural Information Processing Systems, 37:19114–19138, 2024

    Yanmin Wu, Jiarui Meng, Haijie Li, Chenming Wu, Yahao Shi, Xinhua Cheng, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, et al. Opengaussian: Towards point-level 3d gaussian-based open vocabulary understanding.Advances in Neural Information Processing Systems, 37:19114–19138, 2024

    work page 2024

  14. [14]

    Gala: Guided attention with language alignment for open vocabulary gaussian splatting.arXiv preprint arXiv:2508.14278, 2025

    Elena Alegret, Kunyi Li, Sen Wang, Siyun Liang, Michael Niemeyer, Stefano Gasperini, Nassir Navab, and Federico Tombari. Gala: Guided attention with language alignment for open vocabulary gaussian splatting.arXiv preprint arXiv:2508.14278, 2025

    work page arXiv 2025

  15. [15]

    Supergseg: Open-vocabulary 3d segmentation with structured super-gaussians

    Siyun Liang, Sen Wang, Kunyi Li, Michael Niemeyer, Stefano Gasperini, Hendrik Lensch, Nassir Navab, and Federico Tombari. Supergseg: Open-vocabulary 3d segmentation with structured super-gaussians. arXiv preprint arXiv:2412.10231, 2024

    work page arXiv 2024

  16. [16]

    Visibility- aware language aggregation for open-vocabulary segmentation in 3d gaussian splatting.arXiv preprint arXiv:2509.05515, 2025

    Sen Wang, Kunyi Li, Siyun Liang, Elena Alegret, Jing Ma, Nassir Navab, and Stefano Gasperini. Visibility- aware language aggregation for open-vocabulary segmentation in 3d gaussian splatting.arXiv preprint arXiv:2509.05515, 2025

    work page arXiv 2025

  17. [17]

    Feature 3dgs: Supercharging 3d gaussian splatting to enable distilled feature fields

    Shijie Zhou, Haoran Chang, Sicheng Jiang, Zhiwen Fan, Zehao Zhu, Dejia Xu, Pradyumna Chari, Suya You, Zhangyang Wang, and Achuta Kadambi. Feature 3dgs: Supercharging 3d gaussian splatting to enable distilled feature fields. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21676–21685, 2024. 10

    work page 2024

  18. [18]

    Gags: Granularity- aware feature distillation for language gaussian splatting

    Yuning Peng, Haiping Wang, Yuan Liu, Chenglu Wen, Zhen Dong, and Bisheng Yang. Gags: Granularity- aware feature distillation for language gaussian splatting. InProceedings of the AAAI Conference on Artificial Intelligence, volume 40, pages 8376–8384, 2026

    work page 2026

  19. [19]

    Kim Jun-Seong, GeonU Kim, Kim Yu-Ji, Yu-Chiang Frank Wang, Jaesung Choe, and Tae-Hyun Oh. Dr. splat: Directly referring 3d gaussian splatting via direct language embedding registration. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 14137–14146, 2025

    work page 2025

  20. [20]

    Occam’s lgs: An efficient approach for language gaussian splatting.arXiv preprint arXiv:2412.01807, 2024

    Jiahuan Cheng, Jan-Nico Zaech, Luc Van Gool, and Danda Pani Paudel. Occam’s lgs: An efficient approach for language gaussian splatting.arXiv preprint arXiv:2412.01807, 2024

    work page arXiv 2024

  21. [21]

    Goi: Find 3d gaussians of interest with an optimizable open-vocabulary semantic-space hyperplane

    Yansong Qu, Shaohui Dai, Xinyang Li, Jianghang Lin, Liujuan Cao, Shengchuan Zhang, and Rongrong Ji. Goi: Find 3d gaussians of interest with an optimizable open-vocabulary semantic-space hyperplane. In Proceedings of the 32nd ACM international conference on multimedia, pages 5328–5337, 2024

    work page 2024

  22. [22]

    Ccl-lgs: Contrastive codebook learning for 3d language gaussian splatting.arXiv preprint arXiv:2505.20469, 2025

    Lei Tian, Xiaomin Li, Liqian Ma, Hefei Huang, Zirui Zheng, Hao Yin, Taiqing Li, Huchuan Lu, and Xu Jia. Ccl-lgs: Contrastive codebook learning for 3d language gaussian splatting.arXiv preprint arXiv:2505.20469, 2025

    work page arXiv 2025

  23. [23]

    Dinov2: Learning robust visual features without supervision.Transactions on Machine Learning Research Journal, 2024

    Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision.Transactions on Machine Learning Research Journal, 2024

    work page 2024

  24. [24]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. InEuropean conference on computer vision, pages 38–55. Springer, 2024

    work page 2024

  25. [25]

    Segment anything

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Segment anything. InProceedings of the IEEE/CVF international conference on computer vision, pages 4015–4026, 2023

    work page 2023

  26. [26]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. InInternational conference on machine learning, pages 8748–8763. PmLR, 2021

    work page 2021

  27. [27]

    SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

    Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, et al. Siglip 2: Multilingual vision-language encoders with improved semantic understanding, localization, and dense features.arXiv preprint arXiv:2502.14786, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  28. [28]

    Lerf: Language embedded radiance fields

    Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, and Matthew Tancik. Lerf: Language embedded radiance fields. InProceedings of the IEEE/CVF international conference on computer vision, pages 19729–19739, 2023

    work page 2023

  29. [29]

    Garfield: Group anything with radiance fields

    Chung Min Kim, Mingxuan Wu, Justin Kerr, Ken Goldberg, Matthew Tancik, and Angjoo Kanazawa. Garfield: Group anything with radiance fields. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21530–21539, 2024

    work page 2024

  30. [30]

    Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning

    Haiyang Ying, Yixuan Yin, Jinzhi Zhang, Fan Wang, Tao Yu, Ruqi Huang, and Lu Fang. Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20612–20622, 2024

    work page 2024

  31. [31]

    Nerf: Representing scenes as neural radiance fields for view synthesis.Communications of the ACM, 65 (1):99–106, 2021

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view synthesis.Communications of the ACM, 65 (1):99–106, 2021

    work page 2021

  32. [32]

    Mip-nerf 360: Unbounded anti-aliased neural radiance fields

    Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, and Peter Hedman. Mip-nerf 360: Unbounded anti-aliased neural radiance fields. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5470–5479, 2022

    work page 2022

  33. [33]

    Scannet: Richly-annotated 3d reconstructions of indoor scenes

    Angela Dai, Angel X Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner. Scannet: Richly-annotated 3d reconstructions of indoor scenes. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 5828–5839, 2017

    work page 2017

  34. [34]

    gsplat: An open-source library for gaussian splatting.Journal of Machine Learning Research, 26(34):1–17, 2025

    Vickie Ye, Ruilong Li, Justin Kerr, Matias Turkulainen, Brent Yi, Zhuoyang Pan, Otto Seiskari, Jianbo Ye, Jeffrey Hu, Matthew Tancik, et al. gsplat: An open-source library for gaussian splatting.Journal of Machine Learning Research, 26(34):1–17, 2025. 11

    work page 2025

  35. [35]

    Cluster quality analysis using silhouette score

    Ketan Rajshekhar Shahapure and Charles Nicholas. Cluster quality analysis using silhouette score. In 2020 IEEE 7th international conference on data science and advanced analytics (DSAA), pages 747–748. IEEE, 2020

    work page 2020

  36. [36]

    British Free Range Eggs

    Jin-Chuan Shi, Miao Wang, Hao-Bin Duan, and Shao-Hua Guan. Language embedded 3d gaussians for open-vocabulary scene understanding. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5333–5343, 2024. 12 A Implementation Details Preprocessing.We follow LangSplat [ 9] to preprocess SAM [25] masks and CLIP [26] language...

    work page 2024