Pith

open record

sign in

arxiv: 2606.01545 · v1 · pith:GWZEKW4Q · submitted 2026-06-01 · cs.RO

Hierarchical Object Representation for Spatial Robot Perception: Points, Meshes, and Superquadrics

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 reserved 2026-06-28 14:50 UTCgrok-4.3pith:GWZEKW4Qrecord.jsonopen to challenge →

Figure 1
Figure 1. Figure 1: Hierarchical Object Representation. (a) Our object representation is composed of four layers: Layer 1 (point cloud), Layer 2 (dense 3D mesh), Layer 3 (Superquadric), and Layer 4 (Inflated Superquadric). (b) Layer 1 (point cloud) is obtained by aggre￾gating object point cloud trackied from… reproduced from arXiv: 2606.01545
classification cs.RO
keywords hierarchical object representationsuperquadrics3D scene graphsRGB-D perceptionmap alignmentcollision checkingrobot navigationobject reconstruction
0
0 comments X

The pith

A four-layer hierarchy from RGB-D data to superquadrics supports high-fidelity reconstruction, map alignment, and analytical collision checking.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper introduces a hierarchical object representation organized into four layers that progressively abstract raw sensor data into point clouds, dense 3D meshes, and superquadric analytical primitives. This structure targets high-fidelity object-level reconstruction, robust re-localization via map alignment, and efficient collision checking for robot navigation in cluttered spaces. The authors build a pipeline from RGB-D image streams and validate it on indoor and outdoor real-world datasets, including demonstrations of improved map alignment over the ROMAN baseline.

Core claim

The representation is structurally organized into four distinct layers, progressively abstracting the scene from raw sensor data to dense 3D meshes to analytical primitives such as superquadrics, which provide a sparse and analytical representation for object geometry. A pipeline builds this from RGB-D streams captured by a robot and is shown to work in real-world open-set scenes indoors and outdoors, with superquadric-based alignment outperforming prior object-based methods.

What carries the argument

Four-layer hierarchical object representation that abstracts from raw RGB-D data through point clouds and meshes to superquadrics as the analytical primitive layer.

If this is right

  • Enables high-fidelity object-level reconstruction directly from RGB-D image streams.
  • Supports robust object-based re-localization and map alignment.
  • Permits efficient analytical collision checking for navigation planning in dense environments.
  • Achieves higher map alignment accuracy than the prior ROMAN method on tested datasets.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The layered structure could reduce memory use in large maps by storing sparse superquadrics instead of full meshes at the top level.
  • Analytical superquadric parameters might allow closed-form solutions for certain planning queries that dense representations cannot.
  • Extending the pipeline to fuse semantic labels at the mesh or superquadric layer could link geometry to higher-level scene understanding.

Load-bearing premise

That fitting superquadrics to real-world open-set objects yields representations sufficiently accurate for high-fidelity reconstruction, robust map alignment, and analytical collision checking.

What would settle it

A controlled test in which superquadric fits on open-set objects produce collision-checking errors or map-alignment accuracy below that achieved by bounding-box or point-cloud baselines in the same cluttered scenes.

Figures

Figures reproduced from arXiv: 2606.01545 by Ceng Zhang, Gregory S. Chirikjian, Mohamed Samshad, Rajat Talak, Wan Su.

Figure 2
Figure 2. Figure 2: Hickory: Pipeline for building the hierarchical object representation from posed RGB-D image stream. (a) Layer 1 performs object segmentation and feature-variance￾based best-view selection. (b) Layer 2 reconstructs object meshes and estimates their poses to build an object-level scene. (c) Layer 3 abstracts each object mesh into a compact superquadric representations and shows its applicability in map alig… view at source ↗
Figure 3
Figure 3. Figure 3: Visualization of Dataset for Map Alignment Evaluation: (a) Four indoor scenes in ReplicaCAD [13], featuring distinct object configurations. The two independent camera trajectories for each scene are highlighted in blue and orange. (b) Three outdoor scenes in Kimera-Multi [15], where two robots traverse shared locations either in the same direction (Scenes 1 and 2) or in opposite directions (Scene 3). Note … view at source ↗
Figure 4
Figure 4. Figure 4: As detailed in Table 3, our superquadric-based matching achieves accu [PITH_FULL_IMAGE:figures/full_fig_p011_4.png] view at source ↗
Figure 4
Figure 4. Figure 4: Visualization of Map alignment Result. (a) Evaluation in simulation on Repli￾caCAD dataset. (b) Demonstration in real world on NUS-CLB scene. the coarse dimensions of mesh bounding boxes, it fundamentally fails to dis￾tinguish geometrically different objects that coincidentally share similar spatial volumes, leading to brutally wrong matching and degrading its performance es￾pecially under scenes with fewe… view at source ↗
Figure 5
Figure 5. Figure 5: Evaluation on Robot Navigation. (a) Simulation evaluation. Comparison of 2D occupancy grid maps generated by different representation methods (left), and the corresponding planned navigation paths given the start and end positions (right). (b) Real-world demonstration. The occupy map by Mesh-OBB representation (red) fails to plan a valid path while our inflated superquadric representation (green) is able f… view at source ↗
read the original abstract

Hierarchical 3D Scene Graphs (3DSG) have emerged as an actionable and scalable representation for long-term autonomy incorporating metric, semantic, and topological information in the scene. However, the question of geometric representation of objects in 3DSG has been overlooked as most methods use simplified geometric models such as partial point clouds or 3D bounding boxes. In this work, we introduce a hierarchical object representation that can be leveraged for high-fidelity object-level reconstruction, object-based robust re-localization or map alignment, and efficient and analytical collision checking for safe robot navigation planning in dense and cluttered environments. The representation is structurally organized into four distinct layers, progressively abstracting the scene from raw sensor data to dense 3D meshes to analytical primitives such as superquadrics, which provide a sparse and analytical representation for object geometry. We develop a pipeline that builds the hierarchical object representation from RGB-D image stream captured by a robot, and demonstrate its working in real-world open-set object scenes in both indoor and outdoor environments. Extensive experiments across diverse datasets including HOPE, ReplicaCAD, Kimera-Multi, and NUS Campus Dataset collected using Unitree B2 Robot validate our pipeline in both indoor and outdoor environments. We show that our superquadric-based map alignment method outperforms the current state-of-the-art object based map alignment method ROMAN. Our code can be found at https://github.com/perceptica-robotics/Hickory.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper introduces a four-layer hierarchical object representation for 3D scene graphs in robotics: raw RGB-D points, dense meshes, and analytical superquadric primitives. A pipeline constructs this representation from robot-captured RGB-D streams and is evaluated on HOPE, ReplicaCAD, Kimera-Multi, and NUS Campus datasets (indoor/outdoor), claiming utility for high-fidelity reconstruction, robust object-based map alignment (outperforming ROMAN), and analytical collision checking, with code released at the provided GitHub link.

Significance. If the superquadric approximations prove sufficiently accurate for the claimed tasks, the hierarchy could provide a useful sparse, analytical alternative to point clouds or bounding boxes for object-level long-term autonomy. The open-source code release supports reproducibility and is a clear strength.

major comments (2)
  1. [Abstract; experimental validation (datasets HOPE, ReplicaCAD, Kimera-Multi, NUS Campus)] Abstract and experimental validation sections: the central claims of high-fidelity reconstruction, robust map alignment, and analytical collision checking rest on superquadric fitting yielding representations accurate enough for these uses, yet no quantitative fitting metrics (Hausdorff distance, volume error, surface deviation, or similar) against ground-truth meshes are reported for the open-set objects across the four datasets. Without these, it is impossible to determine whether approximation residuals remain within tolerance relative to sensor noise or object scale.
  2. [Map alignment experiments] Method and results on map alignment: the reported outperformance over ROMAN is stated without accompanying superquadric-specific error analysis, ablation on fitting parameters, or statistical details (e.g., variance across runs or object categories), which is load-bearing for the claim that the analytic layer enables robust re-localization.
minor comments (2)
  1. [Introduction] Notation for the four layers could be made more consistent when first introduced to aid readability.
  2. [Figure 1] The pipeline diagram would benefit from explicit arrows indicating data flow between layers.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the thoughtful and constructive comments. We agree that the manuscript would benefit from additional quantitative validation of the superquadric fitting accuracy and more detailed analysis of the map alignment results. Below we respond point-by-point and indicate the revisions we will make.

read point-by-point responses
  1. Referee: Abstract and experimental validation sections: the central claims of high-fidelity reconstruction, robust map alignment, and analytical collision checking rest on superquadric fitting yielding representations accurate enough for these uses, yet no quantitative fitting metrics (Hausdorff distance, volume error, surface deviation, or similar) against ground-truth meshes are reported for the open-set objects across the four datasets. Without these, it is impossible to determine whether approximation residuals remain within tolerance relative to sensor noise or object scale.

    Authors: We agree that explicit quantitative fitting metrics are needed to substantiate the accuracy claims for the superquadric layer. The original submission prioritized demonstrating the end-to-end pipeline and its robotics applications over detailed per-object fitting error analysis. In the revised manuscript we will add a new subsection under Experiments that reports Hausdorff distance, volume error, and mean surface deviation for superquadric fits against ground-truth meshes on ReplicaCAD and HOPE. For NUS Campus and Kimera-Multi we will report fitting residuals and compare them to sensor noise levels. These additions will allow readers to assess whether approximation errors remain within acceptable bounds. revision: yes

  2. Referee: Method and results on map alignment: the reported outperformance over ROMAN is stated without accompanying superquadric-specific error analysis, ablation on fitting parameters, or statistical details (e.g., variance across runs or object categories), which is load-bearing for the claim that the analytic layer enables robust re-localization.

    Authors: The map alignment section currently shows aggregate success rates and pose errors comparing our superquadric method to ROMAN. We acknowledge the lack of ablations and statistical breakdowns. In revision we will expand the results to include (i) an ablation on key fitting parameters (point sampling density, optimization iterations), (ii) standard deviation across repeated runs, and (iii) performance stratified by object category on the Kimera-Multi and NUS Campus sequences. These additions will strengthen the evidence that the analytic layer contributes to robust re-localization. revision: yes

Circularity Check

0 steps flagged

No circularity: pipeline and experiments are self-contained

full rationale

The paper presents an engineering pipeline for building a four-layer hierarchical object representation (points → meshes → superquadrics) from RGB-D streams and validates it via experiments on HOPE, ReplicaCAD, Kimera-Multi, and NUS Campus datasets, including a comparison showing outperformance versus ROMAN on map alignment. No equations, fitted parameters, or predictions are defined in terms of themselves; no self-citations are invoked as load-bearing uniqueness theorems; and no ansatz or renaming of known results is presented as a derivation. The central claims rest on described implementation and empirical results rather than any reduction to prior inputs by construction. This is the expected non-finding for a systems paper whose value is in the implemented pipeline and reported comparisons.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Abstract provides no explicit free parameters, axioms, or invented entities; superquadrics are referenced as known analytical primitives rather than newly postulated.

pith-pipeline@v0.9.1-grok · 5807 in / 1041 out tokens · 25158 ms · 2026-06-28T14:50:03.983770+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

51 extracted references · 5 canonical work pages · 3 internal anchors

  1. [1]

    3d dynamic scene graphs: Actionable spatial perception with places, objects, and humans,

    A. Rosinol, A. Gupta, M. Abate, J. Shi, and L. Carlone, “3d dynamic scene graphs: Actionable spatial perception with places, objects, and humans,”Robotics: Science and Systems XVI, 2020

  2. [2]

    Foundations of spatial perception for robotics: Hierarchical representations and real-time systems,

    N. Hughes, Y. Chang, S. Hu, R. Talak, R. Abdulhai, J. Strader, and L. Carlone, “Foundations of spatial perception for robotics: Hierarchical representations and real-time systems,”The International Journal of Robotics Research, vol. 43, no. 10, pp. 1457–1505, 2024

  3. [3]

    Dsp-slam: Object oriented slam with deep shape priors,

    J. Wang, M. R¨ unz, and L. Agapito, “Dsp-slam: Object oriented slam with deep shape priors,” in2021 International Conference on 3D Vision (3DV), pp. 1362– 1371, IEEE, 2021

  4. [4]

    3d scene graphs in robotics: A unified representation bridging geometry, semantics, and action,

    I. Catalano, C. C. Zumaya, J. A. Placed, J. Civera, W. M. Bessa, and J. Pe˜ na- Queralta, “3d scene graphs in robotics: A unified representation bridging geometry, semantics, and action,”Authorea Preprints, 2025

  5. [5]

    Scene representations for robotic spatial perception,

    R. Mascaro and M. Chli, “Scene representations for robotic spatial perception,” Annual Review of Control, Robotics, and Autonomous Systems, vol. 8, no. 1, pp. 351–377, 2025

  6. [6]

    Lrm: Large reconstruction model for single image to 3d,

    Y. Hong, K. Zhang, J. Gu, S. Bi, Y. Zhou, D. Liu, F. Liu, K. Sunkavalli, T. Bui, and H. Tan, “Lrm: Large reconstruction model for single image to 3d,” inInternational Conference on Learning Representations, vol. 2024, pp. 50678–50702, 2024

  7. [7]

    InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

    J. Xu, W. Cheng, Y. Gao, X. Wang, S. Gao, and Y. Shan, “Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction mod- els,”arXiv preprint arXiv:2404.07191, 2024

  8. [8]

    Structured 3d latents for scalable and versatile 3d generation,

    J. Xiang, Z. Lv, S. Xu, Y. Deng, R. Wang, B. Zhang, D. Chen, X. Tong, and J. Yang, “Structured 3d latents for scalable and versatile 3d generation,” inPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 21469–21480, 2025

  9. [9]

    SAM 3D: 3Dfy Anything in Images

    X. Chen, F.-J. Chu, P. Gleize, K. J. Liang, A. Sax, H. Tang, W. Wang, M. Guo, T. Hardin, X. Li,et al., “Sam 3d: 3dfy anything in images,”arXiv preprint arXiv:2511.16624, 2025

  10. [10]

    Superquadrics revisited: Learning 3d shape parsing beyond cuboids,

    D. Paschalidou, A. O. Ulusoy, and A. Geiger, “Superquadrics revisited: Learning 3d shape parsing beyond cuboids,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10344–10353, 2019

  11. [11]

    Fast segment anything,

    X. Zhao, W. Ding, Y. An, Y. Du, T. Yu, M. Li, M. Tang, and J. Wang, “Fast segment anything,” 2023

  12. [12]

    Marching-primitives: Shape ab- straction from signed distance function,

    W. Liu, Y. Wu, S. Ruan, and G. S. Chirikjian, “Marching-primitives: Shape ab- straction from signed distance function,” inProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pp. 8771–8780, 2023

  13. [13]

    Habitat 2.0: Training home assistants to rearrange their habitat,

    A. Szot, A. Clegg, E. Undersander, E. Wijmans, Y. Zhao, J. Turner, N. Maestre, M. Mukadam, D. Chaplot, O. Maksymets, A. Gokaslan, V. Vondrus, S. Dharur, F. Meier, W. Galuba, A. Chang, Z. Kira, V. Koltun, J. Malik, M. Savva, and D. Batra, “Habitat 2.0: Training home assistants to rearrange their habitat,” in Advances in Neural Information Processing System...

  14. [14]

    6- dof pose estimation of household objects for robotic manipulation: An accessible 16 Ceng Zhang et al. dataset and benchmark,

    S. Tyree, J. Tremblay, T. To, J. Cheng, T. Mosier, J. Smith, and S. Birchfield, “6- dof pose estimation of household objects for robotic manipulation: An accessible 16 Ceng Zhang et al. dataset and benchmark,” inInternational Conference on Intelligent Robots and Systems (IROS), 2022

  15. [15]

    Kimera-multi: Robust, distributed, dense metric-semantic slam for multi-robot systems,

    Y. Tian, Y. Chang, F. H. Arias, C. Nieto-Granda, J. P. How, and L. Carlone, “Kimera-multi: Robust, distributed, dense metric-semantic slam for multi-robot systems,”IEEE transactions on robotics, vol. 38, no. 4, 2022

  16. [16]

    ROMAN: Open- Set Object Map Alignment for Robust View-Invariant Global Localization,

    M. B. Peterson, Y. X. Jia, Y. Tian, A. Thomas, and J. P. How, “ROMAN: Open- Set Object Map Alignment for Robust View-Invariant Global Localization,” in Robotics: Science and Systems (RSS), 2025

  17. [17]

    Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,

    R. Mur-Artal and J. D. Tard´ os, “Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,”IEEE transactions on robotics, vol. 33, no. 5, pp. 1255–1262, 2017

  18. [18]

    Lsd-slam: Large-scale direct monocular slam,

    J. Engel, T. Sch¨ ops, and D. Cremers, “Lsd-slam: Large-scale direct monocular slam,” inEuropean conference on computer vision, pp. 834–849, Springer, 2014

  19. [19]

    Resilient and distributed multi-robot visual slam: Datasets, experiments, and lessons learned,

    Y. Tian, Y. Chang, L. Quang, A. Schang, C. Nieto-Granda, J. P. How, and L. Car- lone, “Resilient and distributed multi-robot visual slam: Datasets, experiments, and lessons learned,” in2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 11027–11034, IEEE, 2023

  20. [20]

    Quadricslam: Dual quadrics from object detections as landmarks in object-oriented slam,

    L. Nicholson, M. Milford, and N. S¨ underhauf, “Quadricslam: Dual quadrics from object detections as landmarks in object-oriented slam,”IEEE Robotics and Au- tomation Letters, vol. 4, no. 1, pp. 1–8, 2018

  21. [21]

    Rgb-d slam based incremental cuboid modeling,

    M. , H. Uchiyama, D. Thomas, R.-i. Taniguchi, R. Roberto, V. Teichrieb,et al., “Rgb-d slam based incremental cuboid modeling,” inProceedings of the European Conference on Computer Vision (ECCV) Workshops, pp. 0–0, 2018

  22. [22]

    Fusion++: Volumetric object-level slam,

    J. McCormac, R. Clark, M. Bloesch, A. Davison, and S. Leutenegger, “Fusion++: Volumetric object-level slam,” in2018 international conference on 3D vision (3DV), pp. 32–41, IEEE, 2018

  23. [23]

    Maskfusion: Real-time recognition, track- ing and reconstruction of multiple moving objects,

    M. Runz, M. Buffier, and L. Agapito, “Maskfusion: Real-time recognition, track- ing and reconstruction of multiple moving objects,” in2018 IEEE international symposium on mixed and augmented reality (ISMAR), pp. 10–20, IEEE, 2018

  24. [24]

    Segment anything,

    A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y. Lo,et al., “Segment anything,” inProceedings of the IEEE/CVF international conference on computer vision, pp. 4015–4026, 2023

  25. [25]

    Sq-slam: Monocular semantic slam based on superquadric object representation,

    X. Han and L. Yang, “Sq-slam: Monocular semantic slam based on superquadric object representation,”Journal of Intelligent & Robotic Systems, vol. 109, no. 2, p. 29, 2023

  26. [26]

    Superquadric object represen- tation for optimization-based semantic slam,

    F. Tschopp, J. Nieto, R. Siegwart, and C. Cadena, “Superquadric object represen- tation for optimization-based semantic slam,”arXiv preprint arXiv:2109.09627, 2021

  27. [27]

    3d scene graph: A structure for unified semantics, 3d space, and camera,

    I. Armeni, Z.-Y. He, J. Gwak, A. R. Zamir, M. Fischer, J. Malik, and S. Savarese, “3d scene graph: A structure for unified semantics, 3d space, and camera,” inPro- ceedings of the IEEE/CVF international conference on computer vision, pp. 5664– 5673, 2019

  28. [28]

    Kimera: an open-source library for real-time metric-semantic localization and mapping,

    A. Rosinol, M. Abate, Y. Chang, and L. Carlone, “Kimera: an open-source library for real-time metric-semantic localization and mapping,” in2020 IEEE interna- tional conference on robotics and automation (ICRA), pp. 1689–1696, IEEE, 2020

  29. [29]

    arXiv preprint arXiv:2201.13360 (2022)

    N. Hughes, Y. Chang, and L. Carlone, “Hydra: A real-time spatial percep- tion system for 3d scene graph construction and optimization,”arXiv preprint arXiv:2201.13360, 2022

  30. [30]

    Hydra-multi: Collaborative online construction of 3d scene graphs with multi-robot teams,

    Y. Chang, N. Hughes, A. Ray, and L. Carlone, “Hydra-multi: Collaborative online construction of 3d scene graphs with multi-robot teams,” in2023 IEEE/RSJ Inter- Hierarchical Object Representation for Spatial Robot Perception 17 national Conference on Intelligent Robots and Systems (IROS), pp. 10995–11002, IEEE, 2023

  31. [31]

    S-graphs+: Real-time localization and mapping leveraging hierarchical representations,

    H. Bavle, J. L. Sanchez-Lopez, M. Shaheer, J. Civera, and H. Voos, “S-graphs+: Real-time localization and mapping leveraging hierarchical representations,”IEEE Robotics and Automation Letters, vol. 8, no. 8, pp. 4927–4934, 2023

  32. [32]

    Conceptgraphs: Open- vocabulary 3d scene graphs for perception and planning,

    Q. Gu, A. Kuwajerwala, S. Morin, K. M. Jatavallabhula, B. Sen, A. Agar- wal, C. Rivera, W. Paul, K. Ellis, R. Chellappa,et al., “Conceptgraphs: Open- vocabulary 3d scene graphs for perception and planning,” in2024 IEEE Inter- national Conference on Robotics and Automation (ICRA), pp. 5021–5028, IEEE, 2024

  33. [33]

    Hierarchical open-vocabulary 3d scene graphs for language-grounded robot navigation,

    A. Werby, C. Huang, M. B¨ uchner, A. Valada, and W. Burgard, “Hierarchical open-vocabulary 3d scene graphs for language-grounded robot navigation,” inFirst Workshop on Vision-Language Models for Navigation and Manipulation at ICRA 2024, 2024

  34. [34]

    Clio: Real-time task-driven open-set 3d scene graphs,

    D. Maggio, Y. Chang, N. Hughes, M. Trang, D. Griffith, C. Dougherty, E. Cristo- falo, L. Schmid, and L. Carlone, “Clio: Real-time task-driven open-set 3d scene graphs,”IEEE Robotics and Automation Letters, vol. 9, no. 10, pp. 8921–8928, 2024

  35. [35]

    Netvlad: Cnn ar- chitecture for weakly supervised place recognition,

    R. Arandjelovic, P. Gronat, A. Torii, T. Pajdla, and J. Sivic, “Netvlad: Cnn ar- chitecture for weakly supervised place recognition,” inProceedings of the IEEE conference on computer vision and pattern recognition, pp. 5297–5307, 2016

  36. [36]

    Patch-netvlad: Multi- scale fusion of locally-global descriptors for place recognition,

    S. Hausler, S. Garg, M. Xu, M. Milford, and T. Fischer, “Patch-netvlad: Multi- scale fusion of locally-global descriptors for place recognition,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 14141– 14152, 2021

  37. [37]

    DINOv2: Learning Robust Visual Features without Supervision

    M. Oquab, T. Darcet, T. Moutakanni, H. Vo, M. Szafraniec, V. Khalidov, P. Fer- nandez, D. Haziza, F. Massa, A. El-Nouby,et al., “Dinov2: Learning robust visual features without supervision,”arXiv preprint arXiv:2304.07193, 2023

  38. [38]

    Semantic graph based place recognition for 3d point clouds,

    X. Kong, X. Yang, G. Zhai, X. Zhao, X. Zeng, M. Wang, Y. Liu, W. Li, and F. Wen, “Semantic graph based place recognition for 3d point clouds,” in2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8216–8223, IEEE, 2020

  39. [39]

    Clip-clique: Graph-based correspon- dence matching augmented by vision language models for object-based global local- ization,

    S. Matsuzaki, K. Tanaka, and K. Shintani, “Clip-clique: Graph-based correspon- dence matching augmented by vision language models for object-based global local- ization,”IEEE Robotics and Automation Letters, vol. 9, no. 11, pp. 10399–10406, 2024

  40. [40]

    Clip-loc: Multi-modal landmark association for global localization in object- based maps,

    S. Matsuzaki, T. Sugino, K. Tanaka, Z. Sha, S. Nakaoka, S. Yoshizawa, and K. Shin- tani, “Clip-loc: Multi-modal landmark association for global localization in object- based maps,” in2024 IEEE International Conference on Robotics and Automation (ICRA), pp. 13673–13679, IEEE, 2024

  41. [41]

    Clipper: A graph-theoretic framework for robust data association,

    P. C. Lusk, K. Fathian, and J. P. How, “Clipper: A graph-theoretic framework for robust data association,” in2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 13828–13834, IEEE, 2021

  42. [42]

    A fast procedure for computing the distance between complex objects in three-dimensional space,

    E. G. Gilbert, D. W. Johnson, and S. S. Keerthi, “A fast procedure for computing the distance between complex objects in three-dimensional space,”IEEE Journal on Robotics and Automation, vol. 4, no. 2, pp. 193–203, 1988

  43. [43]

    S. M. LaValle,Planning Algorithms. Cambridge University Press, 2006

  44. [44]

    Voxblox: Incremen- tal 3d euclidean signed distance fields for on-board mav planning,

    H. Oleynikova, Z. Taylor, M. Fehr, R. Siegwart, and J. Nieto, “Voxblox: Incremen- tal 3d euclidean signed distance fields for on-board mav planning,”IEEE/RSJ In- ternational Conference on Intelligent Robots and Systems (IROS), pp. 1366–1373, 2017. 18 Ceng Zhang et al

  45. [45]

    Kinectfusion: Real-time dense surface mapping and tracking,

    R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon, “Kinectfusion: Real-time dense surface mapping and tracking,” inIEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 127–136, 2011

  46. [46]

    Spatial planning: A configuration space approach,

    T. Lozano-P´ erez, “Spatial planning: A configuration space approach,”IEEE Trans- actions on Computers, vol. 32, no. 2, pp. 108–120, 1983

  47. [47]

    Deepsdf: Learning continuous signed distance functions for shape representation,

    J. J. Park, P. Florence, J. Straub, R. Newcombe, and S. Lovegrove, “Deepsdf: Learning continuous signed distance functions for shape representation,” inIEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 165–174, 2019

  48. [48]

    Dinov2: Learning robust visual features without supervision,

    M. Oquab, T. Darcet, T. Moutakanni, H. Vo, M. Szafraniec, V. Khalidov, P. Fer- nandez, D. Haziza, F. Massa, A. El-Nouby,et al., “Dinov2: Learning robust visual features without supervision,”Transactions on Machine Learning Research Jour- nal, 2024

  49. [49]

    Oneformer: One trans- former to rule universal image segmentation,

    J. Jain, J. Li, M. T. Chiu, A. Hassani, N. Orlov, and H. Shi, “Oneformer: One trans- former to rule universal image segmentation,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 2989–2998, 2023

  50. [50]

    Foundationpose: Unified 6d pose estimation and tracking of novel objects,

    B. Wen, W. Yang, J. Kautz, and S. Birchfield, “Foundationpose: Unified 6d pose estimation and tracking of novel objects,” inProceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, pp. 17868–17879, 2024

  51. [51]

    Jaklic, A

    A. Jaklic, A. Leonardis, and F. Solina,Segmentation and recovery of superquadrics, vol. 20. Springer Science & Business Media, 2000