Pith. sign in

REVIEW 4 major objections 5 minor 28 references

UniDiffGrasp: A Unified Framework Integrating VLM Reasoning and VLM-Guided Part Diffusion for Open-Vocabulary Constrained Grasping with Dual Arms

T0 review · 4 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read UniDiffGrasp claims that a VLM-chosen functional part, converted into a point-cloud constraint, directly guides diffusion-based grasp synthesis, reaching 0.876 single-arm and 0.767 dual-arm success on a real robot without retraining.

desk verdict A plausible and genuinely integrated VLM-to-diffusion grasping pipeline, but the reported metrics don't verify that grasps actually contact the intended part, so the headline 'significantly surpassing' claim is under-supported. read the letter →

arxiv 2505.06832 v1 pith:HH5NQ5SN submitted 2025-05-11 cs.RO

Xueyang Guo , Hongwei Hu , Chengye Song , Jiale Chen , Zilin Zhao , Yu Fu , Bowen Guan , Zhenze Liu This is my paper · ORCID
classification cs.RO
keywords open-vocabularygraspingtask-orientedpart-guideddiffusionconstrainedgraspgenerationdual-armmanipulationvision-languagemodelsaffordancegrounding6-DoFsynthesis
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

UniDiffGrasp is an attempt to close the gap between what a vision-language model understands about a task and where a robot actually places its grippers. The paper's claim is that the part a VLM identifies from a natural-language instruction — the handle, the keyboard, both handles — can be turned directly into a geometric constraint that steers a diffusion-based grasp generator, so no retraining or task-specific data is needed. On a physical dual-arm robot, the authors report 0.876 grasp success in single-arm trials and 0.767 in dual-arm trials, with the constrained diffusion producing higher collision-free rates than baselines that feed the same semantic labels into general-purpose grasp detectors. The broader motivation is that household and industrial tasks usually require grasping by a functional part, not by the object as a whole, and often require two arms working together.

What carries the argument

The load-bearing mechanism is Part-Guided Diffusion inside a Constrained Grasp Diffusion Field: a diffusion model trained only on unconstrained grasps is made to respect a target region by evaluating candidate poses against both the global object point cloud and the part point cloud, with guided energy $\max(e'_k, e''_k)$ and an adaptive score that favors whichever constraint is harder to satisfy. The VLM-identified part becomes that part point cloud through hierarchical segmentation — an object mask from GroundedSAM followed by a part mask from VLPart — so language is effectively converted into geometry. This mechanism is what lets the pipeline skip retraining and still produce 6-DoF grasps concentrated on the requested functional region.

What would settle it

Run the identical objects and instructions with ground-truth part masks substituted for the VLM-segmentation output; if success rates stay near the reported levels, the VLM-driven constraint stage is not doing the work, whereas a large drop would confirm that mask quality is the bottleneck. A stage-wise failure log that counts missed or malformed part masks separately from grasp-pose collisions would also settle where the pipeline breaks.

Watch

Extended reading notes

Core claim

The central discovery is that a semantic part label, once grounded as a point cloud through hierarchical open-vocabulary segmentation, works as a direct conditioning input for the Constrained Grasp Diffusion Field's Part-Guided Diffusion strategy. At each diffusion step, the energy model is evaluated against both the whole object and the target part; the effective guiding energy is the maximum of the two, so the score steers candidate grasps into the target region while keeping them globally stable and collision-free. This makes constrained grasping a zero-shot operation: the same unconstrained-trained generator adapts to arbitrary part constraints at inference time. For dual-arm tasks, UniDiffGrasp defines two target regions, either by splitting semantic parts or by geometric division, generates candidate grasps for each arm independently, then filters by energy, inter-gripper collision, and force closure, and finally selects the pair with maximal gripper separation. The reported outcome is grasp success of 0.876 in single-arm and 0.767 in dual-arm scenarios across seven single-arm and four dual-arm household object classes.

Load-bearing premise

The load-bearing premise is that the VLM and the stacked segmentation models, object first then part, return the user-intended functional part as a geometrically coherent point-cloud mask; when that mask is wrong, fragmented, or off-target, the part-guided diffusion is handed an invalid constraint and cannot recover, and the paper does not isolate this upstream failure rate.

Editorial extensions

If this is right

  • A single diffusion model trained only on unconstrained grasps can be reused zero-shot for any new target part described in language, because the constraint enters only as a point cloud at inference time.
  • Natural-language task commands such as 'pour,' 'stew,' or 'type' become part-specific grasps without per-object retraining or constraint-specific datasets.
  • Dual-arm coordination reduces to defining two target regions and pairing independently generated per-arm grasps by collision, force closure, and separation, rather than learning a dedicated dual-arm policy.
  • The gap in collision-free rate between UniDiffGrasp and the baselines indicates that the constrained diffusion, not the semantic labels alone, supplies the geometric precision.
  • The reported gains are largest on objects with complex or small functional parts, such as pans, mugs, kettles, and pots, where post-filtering unconstrained grasps is least sample-efficient.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If upstream mask quality is the real bottleneck, then improving open-vocabulary part segmentation without touching the diffusion module should raise end-to-end success further; the paper does not test this directly.
  • The same interface would accept constraints from sources other than a VLM, such as a user clicking a point in the image or a separate affordance model, so the contribution generalizes beyond the specific language pipeline.
  • A direct test of this modularity would be swapping the VLM for a different part proposer and measuring whether grasp success tracks mask quality rather than the choice of language model.
  • The dual-arm selection criteria are generic enough to extend beyond rigid household objects to cooperative manipulation of larger or deformable items, though the paper's experiments do not demonstrate that extension.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes UniDiffGrasp, an end-to-end pipeline for open-vocabulary constrained grasping on a dual-arm Baxter robot. A VLM (GPT-4o) parses the user instruction and visual input into a target object, functional part, and operation mode (Eq. (1)); GroundedSAM and VLPart ground these into an object point cloud P and a part point cloud P_t (Eqs. (2)-(3)); a Constrained Grasp Diffusion Field (CGDF) with part-guided diffusion generates 6-DoF grasp candidates conditioned on P and P_t, from which a lowest-energy grasp is selected (Eq. (4)). For dual-arm tasks, two target regions are obtained by semantic or geometric splitting, per-arm part-guided diffusion generates grasp sets, and a selection procedure filters by energy threshold, inter-gripper collision, force closure, and maximal distance (Eqs. (7)-(9)). The paper reports real-world experiments on seven single-arm objects and four dual-arm objects, 30 trials per object-method condition, with average GSR 0.876 and 0.767 and CFR 0.900 and 0.850, respectively, compared against ThinkGrasp and a FPS+KNN baseline.

Significance. If the reported results are valid, the paper's main contribution is a working integration of VLM reasoning with a constrained diffusion grasp generator, showing that part masks from open-vocabulary segmentation can serve as geometric constraints for zero-shot constrained grasping, and that a simple pair-selection procedure can produce stable dual-arm grasps. The real-world deployment on a physical robot with 30 trials per condition is a concrete engineering effort, and using physical execution outcomes rather than only simulated metrics avoids circularity. However, the significance is weakened by the evaluation design: the headline metrics do not verify that the executed grasps actually contacted the intended part, and the statistical basis for the claimed superiority is absent. The novelty of the pipeline itself is largely integrative—each component (GPT-4o, GroundedSAM, VLPart, CGDF) is existing—so the contribution rests heavily on the strength of the experimental validation.

major comments (4)
  1. [IV (Tables I and II)] The central claim that UniDiffGrasp performs part-targeted grasping is not supported by the reported metrics. GSR is defined as successful physical grasp executions (lift and stable hold) and CFR as the percentage of generated grasp poses with no collision between the gripper model and the target object mesh; neither definition requires the executed grasp to contact the VLM-identified part mask M*_p or the target point cloud P_t from Eq. (3). For objects such as mugs, pans, and kettles, a grasp on the rim or body can lift the object successfully, so a system that ignores the part constraint entirely could still achieve high GSR and CFR. The sentence at the end of Section III-B saying the final grasp is accurately targeted to the VLM-identified functional part is therefore not measured by the current evaluation. I recommend adding a part-contact metric (e.g., verifying that the gripper contact region intersects M*_p in the 3D point cloud) and reporting it per object.
  2. [IV-A and IV-B, Tables I and II] All comparisons are based on point estimates from 30 trials per object-method condition, with no confidence intervals, variance measures, or significance tests. For example, the single-arm average GSR of 0.876 (Ours) versus 0.705 (ThinkGrasp) is reported as significantly surpassing, but with 30 trials per object the per-object binomial 95% confidence intervals are roughly plus or minus 0.17, and even pooled across seven objects the interval for 0.876 would be about plus or minus 0.045; no test accounts for object-to-object variability. The claim of significance is thus unsupported. Please report per-object confidence intervals or raw counts (e.g., 27 out of 30) and, if possible, a paired statistical test across objects (e.g., Wilcoxon signed-rank) or a mixed-effects model.
  3. [IV-B, Table II] The dual-arm baseline is not a state-of-the-art method and does not isolate the contributions of the proposed system. The baseline uses FPS+KNN to generate random target regions and omits semantic splitting, energy-threshold filtering, force-closure checking, and maximal-distance selection, so the comparison conflates target-region quality with the pair-selection procedure. A more informative comparison would include a baseline with FPS+KNN regions but the same selection pipeline, or a semantic-splitting-only variant, to attribute the reported GSR and CFR gains to specific components. The paper should also state the baseline's underlying grasp generator and give the exact K and distance parameters used.
  4. [III-A and Fig. 2] The pipeline's upstream segmentation step is a load-bearing assumption that is not measured. Equation (3) feeds the VLPart mask M*_p directly into P_t; if GroundedSAM or VLPart returns a wrong or geometrically incoherent mask, the part-guided diffusion cannot recover, yet the paper reports no segmentation success rate or analysis of failure cases. In addition, Fig. 2 shows error messages being sent back to the VLM, which implies an unspecified retry loop; the paper never defines whether a trial attempt includes such retries or whether failed segmentations are counted in the GSR denominator. Please specify the retry protocol and report the part-segmentation accuracy separately from grasp execution.
minor comments (5)
  1. [IV-A] The text 'UniDiffGrasp, as detailed in Section IV-B and IV-A' is self-referential and should be corrected to point to the appropriate sections.
  2. [III-B and III-C] The hyperparameters T (diffusion steps), N (candidate grasps per arm), the energy threshold delta, and the force-closure quality threshold are never given; please report them in the experimental section.
  3. [III-B, Eq. (4)] Equation (4) selects the final grasp by minimizing global energy E_theta at k=0, while the guided diffusion uses max(e'_k, e''_k); please clarify whether this selection could choose a grasp that is not on the target part and, if not, why the guided energy is not used for selection.
  4. [IV, CFR definition] The CFR metric is computed against a ground-truth object mesh, but the collision-checking method (signed distance field, gripper model resolution, etc.) is not described; please add one sentence describing the checker.
  5. [General] There are a few textual inconsistencies, such as 'Table 1' vs 'TABLE I' and the caption in Fig. 1 where 'BottleKnife' lacks a space; these should be cleaned up before publication.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: reported grasp success is a physical execution outcome, not reconstructed from the fitted inputs.

full rationale

The derivation chain is self-contained. The VLM interprets the instruction and outputs target object, part, and mode (Eq. 1); segmentation converts these into constraint point clouds P_t and P_{t1}/P_{t2} (Eqs. 2-3 and Section III-C); and Part-Guided Diffusion from CGDF is used as a previously published external grasp generator, conditioned on those point clouds. Final grasp selection in Eq. 4 minimizes an energy function with respect to the global cloud, but the reported GSR and CFR are physical execution outcomes and geometric collision checks, not quantities algebraically forced by the constraint definitions. No parameter is fitted to the reported success rates; the energy threshold delta and force-closure limits are presented as predefined selection criteria. The only apparent self-citation is Ref. [29] for a force-closure quality estimator used in dual-arm filtering; this is a standard stability metric and is not load-bearing for the central claim of part-targeted grasping. The skeptic's concern that GSR and CFR do not verify contact with the VLM-identified part is a measurement-validity gap, not a circularity: even if the metrics fail to isolate the part constraint, the reported numbers are not true by construction. Therefore the score is 0, with no circular steps identified.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The central claim rests entirely on the reliability of pretrained external components (VLM, open-vocabulary segmentation, CGDF energy model, force closure estimator) and on unreported thresholds. No new physical entities are introduced, and no new first-principles derivation is supplied.

free parameters (3)
  • Energy threshold delta
    Used in Eqs. (7)-(8) to filter candidate grasps for each arm; the value is not reported, so its effect on success rates is unknown.
  • Force closure quality threshold
    Used in the dual-arm stability check (Section III-C, step 3); threshold value is not stated.
  • Number of candidate grasps N and diffusion steps T
    Affect sample efficiency and grasp quality; values are not specified in the paper.
assumptions (4)
  • domain assumption CGDF's part-guided diffusion energy model, trained on unconstrained data, generalizes to arbitrary target regions specified by VLPart masks from real depth sensors.
    The paper directly uses CGDF's method in Section III-B without re-verifying it on its own data; if this fails, generated grasps will not be constrained to the intended part.
  • domain assumption GPT-4o correctly infers target object, functional part, and single/dual-arm mode from the language instruction and image.
    Entered in Eq. (1); a VLM misinterpretation cascades to every downstream step.
  • domain assumption GroundedSAM and VLPart accurately segment the instructed part on the masked object view.
    Introduced in Eqs. (2)-(3); mask errors propagate directly to P_t and to P_t1/P_t2 for dual-arm grasping.
  • domain assumption The differentiable force closure estimator [29] is a valid predictor of physical grasp stability for parallel-jaw grippers.
    Used in dual-arm pair selection, Section III-C step 3; if the FC score is unreliable, the stability filter is unreliable.

how reviews work

0 comments
Cite this review

Pith. "Pith review of UniDiffGrasp: A Unified Framework Integrating VLM Reasoning and VLM-Guided Part Diffusion for Open-Vocabulary Constrained Grasping with Dual Arms." pith.science (2026). https://pith.science/paper/HH5NQ5SN

@misc{pith2026250506832,
  author       = {Pith},
  title        = {Pith review of: UniDiffGrasp: A Unified Framework Integrating VLM Reasoning and VLM-Guided Part Diffusion for Open-Vocabulary Constrained Grasping with Dual Arms},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/HH5NQ5SN}},
  note         = {Machine review of arXiv:2505.06832}
}
read the original abstract

Open-vocabulary, task-oriented grasping of specific functional parts, particularly with dual arms, remains a key challenge, as current Vision-Language Models (VLMs), while enhancing task understanding, often struggle with precise grasp generation within defined constraints and effective dual-arm coordination. We innovatively propose UniDiffGrasp, a unified framework integrating VLM reasoning with guided part diffusion to address these limitations. UniDiffGrasp leverages a VLM to interpret user input and identify semantic targets (object, part(s), mode), which are then grounded via open-vocabulary segmentation. Critically, the identified parts directly provide geometric constraints for a Constrained Grasp Diffusion Field (CGDF) using its Part-Guided Diffusion, enabling efficient, high-quality 6-DoF grasps without retraining. For dual-arm tasks, UniDiffGrasp defines distinct target regions, applies part-guided diffusion per arm, and selects stable cooperative grasps. Through extensive real-world deployment, UniDiffGrasp achieves grasp success rates of 0.876 in single-arm and 0.767 in dual-arm scenarios, significantly surpassing existing state-of-the-art methods, demonstrating its capability to enable precise and coordinated open-vocabulary grasping in complex real-world scenarios.

Figures

Figures reproduced from arXiv: 2505.06832 by the authors.

Figure 1
Figure 1. UniDiffGrasp: Open-Vocabulary Constrained Grasping Example [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. UniDiffGrasp Framework: Integrating VLM Reasoning, Multi-Stage Segmentation, and Part-Guided Diffusion for Grasp Generation. User input [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Principle of Dual-Arm Grasp Generation in UniDiffGrasp using [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Visualization of task-oriented grasping of functional parts by single-arm [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: Visualization of collaborative dual-arm grasping for large object manipulation [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

28 extracted references · 10 canonical work pages

  1. [1]

    Open-vocabulary queryable scene representations for real world planning,

    B. Chen, F. Xia, B. Ichter, K. Rao, K. Gopalakrishnan, M. S. Ryoo, A. Stone, and D. Kappler, “Open-vocabulary queryable scene representations for real world planning,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 11 509–11 522

    2023

  2. [2]

    A joint modeling of vision-language-action for target- oriented grasping in clutter,

    K. Xu, S. Zhao, Z. Zhou, Z. Li, H. Pi, Y . Zhu, Y . Wang, and R. Xiong, “A joint modeling of vision-language-action for target- oriented grasping in clutter,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 11 597–11 604

    2023

  3. [3]

    Da 2 dataset: Toward dexterity-aware dual- arm grasping,

    G. Zhai, Y . Zheng, Z. Xu, X. Kong, Y . Liu, B. Busam, Y . Ren, N. Navab, and Z. Zhang, “Da 2 dataset: Toward dexterity-aware dual- arm grasping,” IEEE Robotics and Automation Letters , vol. 7, no. 4, pp. 8941–8948, 2022

    work page 2022

  4. [4]

    6-dof graspnet: Variational grasp generation for object manipulation,

    A. Mousavian, C. Eppner, and D. Fox, “6-dof graspnet: Variational grasp generation for object manipulation,” in Proceedings of the IEEE/CVF international conference on computer vision , 2019, pp. 2901–2910

    2019

  5. [5]

    Contact- graspnet: Efficient 6-dof grasp generation in cluttered scenes,

    M. Sundermeyer, A. Mousavian, R. Triebel, and D. Fox, “Contact- graspnet: Efficient 6-dof grasp generation in cluttered scenes,” in 2021 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2021, pp. 13 438–13 444

    2021

  6. [6]

    Affordgrasp: In-context affordance reasoning for open-vocabulary task-oriented grasping in clutter,

    Y . Tang, S. Zhang, X. Hao, P. Wang, J. Wu, Z. Wang, and S. Zhang, “Affordgrasp: In-context affordance reasoning for open-vocabulary task-oriented grasping in clutter,” arXiv preprint arXiv:2503.00778 , 2025

    arXiv 2025

  7. [7]

    Thinkgrasp: A vision-language system for strategic part grasping in clutter,

    Y . Qian, X. Zhu, O. Biza, S. Jiang, L. Zhao, H. Huang, Y . Qi, and R. Platt, “Thinkgrasp: A vision-language system for strategic part grasping in clutter,” arXiv preprint arXiv:2407.11298 , 2024

    arXiv 2024

  8. [8]

    Graspnet-1billion: A large- scale benchmark for general object grasping,

    H.-S. Fang, C. Wang, M. Gou, and C. Lu, “Graspnet-1billion: A large- scale benchmark for general object grasping,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 11 444–11 453

    2020

Show all 28 references
  1. [9]

    Anygrasp: Robust and efficient grasp perception in spatial and temporal domains,

    H.-S. Fang, C. Wang, H. Fang, M. Gou, J. Liu, H. Yan, W. Liu, Y . Xie, and C. Lu, “Anygrasp: Robust and efficient grasp perception in spatial and temporal domains,” IEEE Transactions on Robotics, vol. 39, no. 5, pp. 3929–3945, 2023

    2023

  2. [10]

    Constrained generative sampling of 6-dof grasps,

    J. Lundell, F. Verdoja, T. N. Le, A. Mousavian, D. Fox, and V . Kyrki, “Constrained generative sampling of 6-dof grasps,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE, 2023, pp. 2940–2946

    2023

  3. [11]

    Constrained 6-dof grasp generation on complex shapes for improved dual-arm manipulation,

    G. Singh, S. Kalwar, M. F. Karim, B. Sen, N. Govindan, S. Sridhar, and K. M. Krishna, “Constrained 6-dof grasp generation on complex shapes for improved dual-arm manipulation,” in 2024 IEEE/RSJ Inter- national Conference on Intelligent Robots and Systems (IROS) . IEEE, 2024, p...

    2024

  4. [12]

    An overview of 3d object grasp synthesis algorithms,

    A. Sahbani, S. El-Khoury, and P. Bidaud, “An overview of 3d object grasp synthesis algorithms,” Robotics and autonomous systems , vol. 60, no. 3, pp. 326–336, 2012

    2012

  5. [13]

    Affordances from human videos as a versatile representation for robotics,

    S. Bahl, R. Mendonca, L. Chen, U. Jain, and D. Pathak, “Affordances from human videos as a versatile representation for robotics,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 13 778–13 790

    2023

  6. [14]

    Robo-abc: Affordance generalization beyond categories via semantic correspon- dence for robot manipulation,

    Y . Ju, K. Hu, G. Zhang, G. Zhang, M. Jiang, and H. Xu, “Robo-abc: Affordance generalization beyond categories via semantic correspon- dence for robot manipulation,” in European Conference on Computer Vision. Springer, 2024, pp. 222–239

    2024

  7. [15]

    Graspgpt: Leveraging semantic knowledge from a large language model for task- oriented grasping,

    C. Tang, D. Huang, W. Ge, W. Liu, and H. Zhang, “Graspgpt: Leveraging semantic knowledge from a large language model for task- oriented grasping,” IEEE Robotics and Automation Letters , vol. 8, no. 11, pp. 7551–7558, 2023

    2023

  8. [16]

    Foundationgrasp: Generalizable task-oriented grasping with foundation models,

    C. Tang, D. Huang, W. Dong, R. Xu, and H. Zhang, “Foundationgrasp: Generalizable task-oriented grasping with foundation models,” IEEE Transactions on Automation Science and Engineering , 2025

    2025

  9. [17]

    Affordance grounding from demonstration video to target image,

    J. Chen, D. Gao, K. Q. Lin, and M. Z. Shou, “Affordance grounding from demonstration video to target image,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 6799–6808

    2023

  10. [18]

    Glover: Generaliz- able open-vocabulary affordance reasoning for task-oriented grasping,

    T. Ma, Z. Wang, J. Zhou, M. Wang, and J. Liang, “Glover: Generaliz- able open-vocabulary affordance reasoning for task-oriented grasping,” arXiv preprint arXiv:2411.12286 , 2024

    2024 arXiv

  11. [20]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection,

    S. Liu, Z. Zeng, T. Ren, F. Li, H. Zhang, J. Yang, Q. Jiang, C. Li, J. Yang, H. Su et al., “Grounding dino: Marrying dino with grounded pre-training for open-set object detection,” in European Conference on Computer Vision. Springer, 2024, pp. 38–55

    2024

  12. [21]

    Segment anything,

    A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y . Lo et al. , “Segment anything,” in Proceedings of the IEEE/CVF international conference on computer vision , 2023, pp. 4015–4026

    2023

  13. [22]

    Going denser with open-vocabulary part segmentation,

    P. Sun, S. Chen, C. Zhu, F. Xiao, P. Luo, S. Xie, and Z. Yan, “Going denser with open-vocabulary part segmentation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 15 453–15 465

    2023

  14. [23]

    Lan- grasp: An effective approach to semantic object grasping using large language models,

    R. Mirjalili, M. Krawez, S. Silenzi, Y . Blei, and W. Burgard, “Lan- grasp: An effective approach to semantic object grasping using large language models,” in First Workshop on Vision-Language Models for Navigation and Manipulation at ICRA 2024 , 2024

    2024

  15. [24]

    Oval-prompt: Open-vocabulary affordance localization for robot manipulation through llm affordance-grounding,

    E. Tong, A. Opipari, S. Lewis, Z. Zeng, and O. C. Jenkins, “Oval-prompt: Open-vocabulary affordance localization for robot manipulation through llm affordance-grounding,” arXiv preprint arXiv:2404.11000, 2024

    2024 arXiv

  16. [25]

    Se (3)- diffusionfields: Learning smooth cost functions for joint grasp and motion optimization through diffusion,

    J. Urain, N. Funk, J. Peters, and G. Chalvatzaki, “Se (3)- diffusionfields: Learning smooth cost functions for joint grasp and motion optimization through diffusion,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 5923–5930

    2023

  17. [26]

    Convolutional occupancy networks,

    S. Peng, M. Niemeyer, L. Mescheder, M. Pollefeys, and A. Geiger, “Convolutional occupancy networks,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part III 16 . Springer, 2020, pp. 523–540

    2020

  18. [27]

    Gpt-4o system card,

    A. Hurst, A. Lerer, A. P. Goucher, A. Perelman, A. Ramesh, A. Clark, A. Ostrow, A. Welihinda, A. Hayes, A. Radford et al., “Gpt-4o system card,” arXiv preprint arXiv:2410.21276 , 2024

    2024 arXiv

  19. [28]

    Grounded sam: Assembling open-world models for diverse visual tasks,

    T. Ren, S. Liu, A. Zeng, J. Lin, K. Li, H. Cao, J. Chen, X. Huang, Y . Chen, F. Yanet al., “Grounded sam: Assembling open-world models for diverse visual tasks,” arXiv preprint arXiv:2401.14159 , 2024

    2024 arXiv

  20. [29]

    Synthesizing diverse and physically stable grasps with arbitrary hand structures using differentiable force closure estimator,

    T. Liu, Z. Liu, Z. Jiao, Y . Zhu, and S.-C. Zhu, “Synthesizing diverse and physically stable grasps with arbitrary hand structures using differentiable force closure estimator,” IEEE Robotics and Automation Letters, vol. 7, no. 1, pp. 470–477, 2021

    2021

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.