Pith. sign in

REVIEW 4 major objections 5 minor 70 references

PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A single RGB photograph and an open-vocabulary instruction suffice to synthesize a situated 3D hand-object interaction sequence without predefined object geometry or trajectories.

desk verdict Genuinely new input setting and a coherent pipeline, but the evaluation as written leaves the end-to-end claim under-supported. read the letter →

arxiv 2608.01905 v2 pith:VNYKIIEW submitted 2026-08-03 cs.CV

Zhenhao Zhang , Jiajun Zhang , Wei Min , Yebin Liu This is my paper · ORCID
classification cs.CV
keywords hand-objectinteractionsynthesissingleRGBphotographopen-vocabularyinstructiontask-conditionedcontactpriorcontact-conditionedgrasplatentoptimizationvision-languagetaskparsing3Dscenerecovery
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

PhotoHOI sets out to show that a complete 3D hand-object interaction sequence can be synthesized from just one RGB photograph and an open-vocabulary language instruction, with no predefined object geometry, trajectory, or task-specific condition. The paper's route is to parse the instruction into action, interaction object, target region, and spatial relation; recover the task-relevant 3D scene with single-image reconstruction and support-aware refinement; and then synthesize hand motion from learned contact and grasp priors, refining the grasp in a latent pose space. If this works, it removes a structural bottleneck of prior HOI synthesis, which requires users to supply 3D assets or motion conditions that natural input lacks. The reported experiments on GRAB and H2O show lower interpenetration and higher contact ratio than representative baselines, and on 2,000 real-photo trials the framework reports higher task success and scene consistency. The practical payoff would be that AR/VR, digital-human, and embodied-interaction systems could generate situated hand-object interactions directly from a camera and a sentence.

What carries the argument

The central object is the task-relevant scene representation $S=\{(G_i,T_i)\}$, where $G_i$ is the recovered local geometry of each relevant object and $T_i$ is its similarity transform in a shared coordinate frame. The motion-side machinery is the two-stage conditioning chain: a task-conditioned contact prior $C=\Phi_{\mathrm{contact}}(G,a)$ predicts pointwise contact probabilities on the object surface from its geometry and the parsed action, and a contact-conditioned grasp prior encodes the object-contact condition $P=\{(x_j,n_j,c_j)\}$ into a latent distribution over MANO hand articulations. The key move is to refine the grasp by optimizing the latent code $z$ and the wrist pose, rather than the raw MANO parameters, which keeps the hand on a plausible articulation manifold while contact and penetration objectives are enforced. The planned cubic-Bézier object trajectory and its collision-aware replanning complete the grounding.

What would settle it

Rerun PhotoHOI on the same tabletop photograph with the target object's recovered geometry rotated 90 degrees about the vertical axis before the contact and grasp stages; the paper's design predicts degradation because refinement only translates objects along the support normal, while success would indicate that the interaction priors do not actually depend on the recovered rotation.

Watch

Extended reading notes

Core claim

The central claim is that scene recovery can replace manual 3D input without sacrificing hand-motion quality. PhotoHOI treats the recovered scene $S=\{(G_i,T_i)\}$ as the grounding for everything downstream: a vision-language model converts image and instruction into a structured task specification, open-vocabulary segmentation and single-view reconstruction produce object geometry and initial poses, and a support-plane optimization adjusts translations along the support normal to remove floating and penetration. The paper further claims that transferable interaction priors, namely a task-conditioned contact prior and a contact-conditioned grasp prior learned from affordance and HOI data, allow the hand synthesizer to generalize to unseen objects, and that optimizing the grasp in the latent space of a conditional VAE yields plausible articulations while satisfying contact and penetration objectives. If these claims hold, PhotoHOI removes the need for predefined object geometry and trajectories in 3D hand-object interaction synthesis.

Load-bearing premise

The pipeline stands or falls on whether single-image reconstruction plus the translation-only support refinement yields object geometry and pose accurate enough for the contact and grasp priors and collision checks to work; the authors' own limitation section concedes that reconstruction errors can affect the generated results.

Editorial extensions

If this is right

  • Natural image-language input becomes sufficient for HOI synthesis, so AR/VR and digital-human pipelines no longer need pre-scanned object models or hand-specified interaction trajectories.
  • Because the contact prior is trained on affordance-level supervision before being aligned to HOI contact maps, the same priors should transfer to object categories never seen during hand-synthesis training.
  • Refining the grasp in the latent space of a contact-conditioned VAE should yield more stable finger configurations than direct articulation optimization, especially when the recovered object geometry is noisy.
  • The output format, per-frame 6DoF object pose plus MANO hand articulation, is directly usable as a motion-conditioning signal for downstream animation or simulation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A consequence the paper leaves implicit: the ceiling of the full pipeline is set by the one-dimensional support refinement, so a photograph where the reconstructed object orientation is wrong should break the contact prior and the latent grasp even though the hand synthesizer is unchanged.
  • The same contact-map-plus-latent-refinement recipe could be carried over to bimanual and articulated-object interactions, because the contact condition is expressed on the object surface rather than through a category-specific hand template.
  • A testable extension that isolates the two stages: replace the single-view reconstruction with ground-truth object meshes at the same poses while keeping every hand-synthesis stage fixed; the resulting change in contact and penetration metrics would show how much of the reported performance is carried by recovery and planning versus by the interaction priors.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper introduces PhotoHOI, a framework that takes a single RGB photograph and an open-vocabulary language instruction as input and produces a 3D hand-object interaction sequence. The pipeline parses the instruction with a VLM, recovers a task-relevant 3D scene from the image using segmentation and single-view reconstruction, refines object placement with a support-aware optimization, plans a collision-aware object trajectory, and synthesizes hand motion using learned contact and grasp priors followed by latent-space grasp refinement. The authors claim state-of-the-art results on GRAB and H2O (Tables 1-2) and on real-photo trials (Table 3, TSR 63.05, SCR 62.75), plus ablations in Table 4. The central claim is that PhotoHOI is the first system in this literature to operate without predefined object geometry or trajectories, working directly from natural image-language inputs.

Significance. If the claims hold, the contribution is significant: it addresses a practical and timely problem and would reduce the manual preprocessing burden for HOI synthesis. The evaluation structure has clear strengths: benchmark-specific training variants, held-out test splits, standard grasp-quality metrics, and an ablation study. The proposed pipeline is coherent, and the idea of using task-conditioned contact priors plus contact-conditioned grasp priors is a reasonable way to transfer to unseen objects. However, the current confidence in the headline result is limited by a lack of protocol transparency for the real-photo evaluation and by ambiguity about what inputs the GRAB/H2O benchmarks actually provide to the method. The paper is not circular: the benchmark evaluations use held-out test splits, so the reported numbers are not produced by fitted quantities by construction. The main risks are empirical verification of the end-to-end image-to-motion claim and sensitivity to single-view reconstruction errors.

major comments (4)
  1. [Experiments, Comparison with SOTA Methods (Tables 1-2)] The manuscript never states what input PhotoHOI receives on the GRAB and H2O benchmarks. If the dataset's ground-truth object meshes and poses are used (rather than the output of Eq. (4) and Eq. (6)), then Tables 1-2 validate only the hand-synthesis modules under clean geometry, not the full image-to-motion pipeline claimed in the abstract and introduction. This is load-bearing for the central "from a single RGB photograph" claim. Please state explicitly whether object geometry is recovered from an image or taken from the benchmark, for both PhotoHOI and the baselines, and clarify what role the VLM parsing and scene recovery stages play in these comparisons.
  2. [Experiments, Real-world Task Performance (Table 3)] TSR and SCR are defined only in one sentence each, and the adjudication protocol is unspecified. The authors report 2,000 randomized trials but do not say whether success and scene consistency are judged by human raters, by automatic geometric checks, or by a hybrid. If human raters were used, the number of raters, the instructions, and inter-annotator agreement are needed; if automatic, the thresholds for support, collision, and placement constraints must be given. Without this information, the headline numbers 63.05 and 62.75 cannot be independently assessed, nor can the claim that PhotoHOI outperforms baselines on real photographs.
  3. [Scene Recovery, Eq. (6) and Limitation] The support-aware refinement optimizes only the scalar displacement delta_i along the support normal, while each object's rotation R_i and scale s_i from single-view reconstruction remain fixed. Any orientation or scale error in the reconstruction propagates directly into the contact map C (Eq. 10), the conditioning points P (Eq. 11), the latent grasp optimization (Eq. 14), and the collision checks in trajectory planning. The Limitation section concedes that "reconstruction errors may affect the generated results," but no experiment quantifies this sensitivity. Please add a sensitivity analysis (e.g., perturbing object orientation and scale and reporting IV, CR, and TSR) or compare against a variant that optimizes full SE(3) or similarity transforms in Eq. (6).
  4. [Experiments, Real-World Photograph Results (Table 3)] The description states that "all compared methods are provided with the same task-relevant reconstructed scene geometry." This is a controlled comparison of hand-synthesis quality, but it does not assess whether baselines could also operate from a single photograph, and it somewhat conflates the claim that PhotoHOI removes the need for predefined geometry. The central claim about the practical interface would be strengthened by an ablation that removes the scene-recovery stage from PhotoHOI, or by comparing against baselines that also take image inputs and must recover geometry themselves; otherwise, the real-photo comparison isolates only the hand-synthesis contribution.
minor comments (5)
  1. [Experiments, Dataset] The sentence "For comparisons with SOTA methods, we additionally train benchmark-specific variants using only the training split of the corresponding benchmark" is ambiguous: it should state whether this applies to PhotoHOI alone or also to the baselines, and whether the baselines are retrained or used with their released checkpoints.
  2. [Method, Eqs. (6) and (14)] The weights lambda_pen and lambda_reg in Eq. (6) and lambda_prior, lambda_contact, and lambda_pen in Eq. (14) are never given; please report their values, along with the Bezier lift height h, the high-contact-probability threshold, and the replanning budget, either in the paper or in a supplement.
  3. [Experiments, Tables 1-4] No error bars, standard deviations, or significance tests are reported for any of the quantitative tables. Given the small metric differences in Table 4 (e.g., IV 3.83 vs. 4.08), reporting variance over multiple seeds or runs would strengthen the conclusions.
  4. [Experiments, Real-World Data] The relationship between "30 real-world scenes," "20 common objects," and "2,000 trials" should be clarified; in particular, how many distinct instructions were used, whether each object appears in multiple scenes, and how the 100 randomized trials per object were constructed.
  5. [Author list] The author line contains a typo: "Y ebin Liu" should be "Yebin Liu."

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: benchmark numbers come from held-out external test splits and no pipeline equation reduces to its own input; the self-citation present is minor and non-load-bearing.

full rationale

PhotoHOI's derivation chain is self-contained. The image-to-motion pipeline (Eqs. 3-9) uses external foundation models (Grounded SAM for segmentation, SAM 3D for single-view reconstruction), a support-plane fit (Eq. 5), and a translation-only refinement (Eq. 6); no output quantity is defined in terms of the predicted hand-object sequence. The contact prior (Eq. 10) and hand-pose prior (Eqs. 11-12) are trained on independent affordance and HOI datasets, and the GRAB/H2O evaluations use benchmark-specific variants whose test splits are excluded from all training stages, per the paper's statement: 'The corresponding test splits are excluded from all training stages.' Thus the reported IV/ID/CR/SP numbers are not fitted by construction. The latent optimization (Eq. 14) is a prior-regularized refinement, not a tautology. The only same-group citation is 'Inspired by (Zhang et al. 2025c), we train a conditional VAE to model task-conditioned contact distributions on object surfaces'; this is a method-lineage acknowledgment and is not load-bearing, since the model is trained and ablated here (Table 4). The limitation that 'reconstruction errors may affect the generated results' and the unspecified adjudication protocol for TSR/SCR are real evaluation-reliability risks, but they are upstream-sensitivity and reporting gaps, not circular reductions.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The performance claims rest on unstated weights and thresholds (Eqs. 6, 9, 14), on the correctness of black-box foundation models (Gemini, Grounded SAM, SAM 3D), and on the transferability of contact and grasp priors learned from HOI and affordance datasets. The paper's own Limitations concede the reconstruction-error dependency and the rigid-tabletop scope. No new physical or mathematical entities are postulated; the internal task specification tau, contact map C, and latent code z are learned representations, not invented entities.

free parameters (5)
  • Support optimization weights lambda_pen, lambda_reg
    Eq. (6): weights for support contact, penetration penalty, and displacement regularization. Values not reported.
  • Latent optimization weights lambda_prior, lambda_contact, lambda_pen
    Eq. (14): weights balancing latent prior, contact attraction, and penetration penalty. Values not reported.
  • Bezier lift height h
    Eq. (9): lift height in trajectory planning is task and scene dependent. Selection rule not given.
  • High-contact-probability threshold
    The contact term attracts to 'high-probability contact regions' from Eq. (10). The probability threshold is never defined.
  • Replanning budget
    Collision replanning repeats until 'the predefined replanning budget is reached'. The budget value is not reported.
assumptions (5)
  • domain assumption Objects are rigid and the scene is a tabletop with a single dominant support plane.
    Eqs. (5)-(6) fit one support plane and refine placements only along its normal. The Limitations section states the scope is rigid tabletop objects.
  • domain assumption The VLM parses the image plus instruction into correct objects, action, target, and spatial relation.
    Section 'VLM-based Task Parsing'. No parsing accuracy is reported, yet the structured spec tau drives segmentation, planning, and hand conditioning.
  • domain assumption Single-view reconstruction (SAM 3D) plus translation-only refinement yields geometry and poses accurate enough for contact prediction and collision planning.
    Eqs. (4)-(6) keep rotation and scale fixed, so orientation errors propagate into the contact map, grasp, and trajectory. Limitations concede reconstruction errors may affect results.
  • domain assumption Contact maps from HOI datasets plus affordance supervision define contact regions that transfer to unseen objects and photographs.
    Section 'Task-conditioned Contact Prior'. Transferability is the core generalization claim but is tested only through self-defined real-world metrics and no quantitative transfer analysis is given.
  • domain assumption The CVAE latent space of Eq. (12) spans plausible MANO hand configurations, so optimizing z keeps the hand on a plausible manifold.
    Eqs. (13)-(14) replace direct MANO optimization with latent optimization; the manifold claim rests on KL alignment and reconstruction losses at training time, not on independent evidence.

how reviews work

0 comments
Cite this review

Pith. "Pith review of PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph." pith.science (2026). https://pith.science/paper/VNYKIIEW

@misc{pith2026260801905,
  author       = {Pith},
  title        = {Pith review of: PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/VNYKIIEW}},
  note         = {Machine review of arXiv:2608.01905}
}
read the original abstract

Hand-object interaction (HOI) is a fundamental human behavior with broad applications in AR/VR, digital humans, and embodied interaction. Existing methods typically require predefined object geometry, object trajectories, or task-specific conditions, limiting their use with natural real-world inputs. To address this, we study a more practical problem of synthesizing 3D hand-object interaction sequences from a single RGB photograph and an open-vocabulary language instruction, and introduce PhotoHOI. PhotoHOI first uses a vision-language model to parse the input image and instruction into a structured task specification, including the interaction object, target region, and spatial relation. It then recovers a compact task-relevant 3D scene and plans a smooth collision-aware object trajectory based on the recovered object states, support relations, and surrounding scene geometry. To synthesize hand motion that generalizes to real-world photographs and unseen objects, it learns transferable task-conditioned contact and contact-conditioned grasp priors from large-scale affordance and HOI data. The grasp is further refined in a learned latent space, constraining the optimization to a plausible hand-pose manifold. Experiments on GRAB and H2O demonstrate improved contact quality and reduced penetration over representative baselines. Results on real-world photographs further demonstrate higher task success and scene consistency, together with generalization to unseen objects and open-vocabulary instructions.

Figures

Figures reproduced from arXiv: 2608.01905 by the authors.

Figure 1
Figure 1. Overview: Unlike existing methods that rely on known object geometry or given trajectories, PhotoHOI starts from a [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Given a single RGB photograph and an instruction, [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Qualitative results on real-world photograph inputs. PhotoHOI recovers task-relevant geometry, plans the object trajectory, and synthesizes the corresponding hand motion. Yellow hands indicate the approach stage, while purple hands indicate the manipulation stage [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Qualitative ablation results of key components in PhotoHOI. [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]

Review history (3 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

70 extracted references · 39 canonical work pages

  1. [1]

    Journal of neuroscience , volume=

    The coordination of arm movements: an experimentally confirmed mathematical model , author=. Journal of neuroscience , volume=. 1985 , publisher=

    work page 1985

  2. [2]

    arXiv preprint arXiv:2506.02444 , year=

    Svimo: Synchronized diffusion for video and motion generation in hand-object interaction scenarios , author=. arXiv preprint arXiv:2506.02444 , year=

    arXiv

  3. [3]

    arXiv preprint arXiv:2603.00732 , year=

    UniHM: Unified Dexterous Hand Manipulation with Vision Language Model , author=. arXiv preprint arXiv:2603.00732 , year=

    arXiv

  4. [4]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Unidexgrasp: Universal robotic dexterous grasping via learning diverse proposal generation and goal-conditioned policy , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    work page

  5. [5]

    European Conference on Computer Vision , pages=

    Graspxl: Generating grasping motions for diverse objects at scale , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    work page 2024

  6. [6]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Dexgrasp anything: Towards universal robotic dexterous grasping with physics awareness , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    work page

  7. [7]

    European Conference on Computer Vision , pages=

    Semgrasp: Semantic grasp generation via language aligned discretization , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    work page 2024

  8. [8]

    Advances in Neural Information Processing Systems , volume=

    Grasp as you say: Language-guided dexterous grasp generation , author=. Advances in Neural Information Processing Systems , volume=

    work page

Show all 70 references
  1. [9]

    arXiv preprint arXiv:2509.22149 , year=

    Demograsp: Universal dexterous grasping from a single demonstration , author=. arXiv preprint arXiv:2509.22149 , year=

  2. [10]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Text2hoi: Text-guided 3d motion generation for hand-object interaction , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  3. [11]

    SIGGRAPH Asia 2024 Conference Papers , pages=

    Diffh2o: Diffusion-based synthesis of hand-object interactions from textual descriptions , author=. SIGGRAPH Asia 2024 Conference Papers , pages=

    2024

  4. [12]

    Advances in Neural Information Processing Systems , volume=

    Motiongpt: Human motion as a foreign language , author=. Advances in Neural Information Processing Systems , volume=

  5. [13]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Hoigpt: Learning long-sequence hand-object interaction with language models , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  6. [14]

    arXiv preprint arXiv:2505.18947 , year=

    Openhoi: Open-world hand-object interaction synthesis with multimodal large language model , author=. arXiv preprint arXiv:2505.18947 , year=

  7. [15]

    arXiv preprint arXiv:2510.14874 , year=

    TOUCH: Text-guided Controllable Generation of Free-Form Hand-Object Interactions , author=. arXiv preprint arXiv:2510.14874 , year=

  8. [16]

    IEEE Transactions on Pattern Analysis and Machine Intelligence , year=

    Manidext: Hand-object manipulation synthesis via continuous correspondence embeddings and residual-guided diffusion , author=. IEEE Transactions on Pattern Analysis and Machine Intelligence , year=

  9. [17]

    arXiv preprint arXiv:2603.28766 , year=

    HandX: Scaling Bimanual Motion and Interaction Generation , author=. arXiv preprint arXiv:2603.28766 , year=

  10. [18]

    European conference on computer vision , pages=

    GRAB: A dataset of whole-body human grasping of objects , author=. European conference on computer vision , pages=. 2020 , organization=

    2020

  11. [19]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    ARCTIC: A dataset for dexterous bimanual hand-object manipulation , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  12. [20]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Taco: Benchmarking generalizable bimanual tool-action-object understanding , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  13. [21]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Oakink2: A dataset of bimanual hands-object manipulation in complex task completion , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  14. [22]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Structure-from-motion revisited , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  15. [23]

    Communications of the ACM , volume=

    Nerf: Representing scenes as neural radiance fields for view synthesis , author=. Communications of the ACM , volume=. 2021 , publisher=

    2021

  16. [24]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Vggt: Visual geometry grounded transformer , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  17. [25]

    Proceedings of the European conference on computer vision (ECCV) , pages=

    Pixel2mesh: Generating 3d mesh models from single rgb images , author=. Proceedings of the European conference on computer vision (ECCV) , pages=

  18. [26]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Deepsdf: Learning continuous signed distance functions for shape representation , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  19. [27]

    arXiv preprint arXiv:2511.16624 , year=

    Sam 3d: 3dfy anything in images , author=. arXiv preprint arXiv:2511.16624 , year=

    arXiv

  20. [28]

    European Conference on Computer Vision , pages=

    Motionchain: Conversational motion controllers via multimodal prompts , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  21. [29]

    arXiv preprint arXiv:2503.18349 , year=

    Human-object interaction via automatically designed vlm-guided motion policy , author=. arXiv preprint arXiv:2503.18349 , year=

  22. [30]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Hosig: Full-body human-object-scene interaction generation with hierarchical scene perception , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  23. [31]

    arXiv preprint arXiv:2312.11805 , year=

    Gemini: a family of highly capable multimodal models , author=. arXiv preprint arXiv:2312.11805 , year=

    arXiv

  24. [32]

    arXiv preprint arXiv:2401.14159 , year=

    Grounded sam: Assembling open-world models for diverse visual tasks , author=. arXiv preprint arXiv:2401.14159 , year=

    arXiv

  25. [33]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    GenH2R: Learning generalizable human-to-robot handover via scalable simulation demonstration and imitation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  26. [34]

    arXiv preprint arXiv:2508.01651 , year=

    DAG: Unleash the Potential of Diffusion Model for Open-Vocabulary 3D Affordance Grounding , author=. arXiv preprint arXiv:2508.01651 , year=

    arXiv

  27. [35]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Seqafford: Sequential 3d affordance reasoning via multimodal large language model , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  28. [36]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    H2o: Two hands manipulating objects for first person interaction recognition , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  29. [37]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Human-object interaction from human-level instructions , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  30. [38]

    European Conference on Computer Vision , pages=

    Controllable human-object interaction synthesis , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  31. [39]

    arXiv preprint arXiv:2209.14916 , year=

    Human motion diffusion model , author=. arXiv preprint arXiv:2209.14916 , year=

    arXiv

  32. [40]

    arXiv preprint arXiv:2210.02697 , year=

    Dexgraspnet: A large-scale robotic dexterous grasp dataset for general objects based on simulation , author=. arXiv preprint arXiv:2210.02697 , year=

    arXiv

  33. [41]

    2018 IEEE conference on virtual reality and 3D user interfaces (VR) , pages=

    Efficient physics-based implementation for realistic hand-object interaction in virtual reality , author=. 2018 IEEE conference on virtual reality and 3D user interfaces (VR) , pages=. 2018 , organization=

    2018

  34. [42]

    Virtual Reality , volume=

    Enhancing hand-object interactions in virtual reality for precision manual tasks , author=. Virtual Reality , volume=. 2024 , publisher=

    2024

  35. [43]

    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , volume=

    CAFI-AR: Contact-aware freehand interaction with ar objects , author=. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , volume=. 2023 , publisher=

    2023

  36. [44]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    InteractAvatar: Modeling Hand-Face Interaction in Photorealistic Avatars with Deformable Gaussians , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  37. [45]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Interact: Advancing large-scale versatile 3d human-object interaction generation , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  38. [46]

    arXiv preprint arXiv:2604.03305 , year=

    HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesis , author=. arXiv preprint arXiv:2604.03305 , year=

    arXiv

  39. [47]

    Proceedings IEEE Conf

    Expressive Body Capture: 3D Hands, Face, and Body from a Single Image , author =. Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) , year =

  40. [48]

    ACM Transactions on Graphics, (Proc

    Embodied Hands: Modeling and Capturing Hands and Bodies Together , author =. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia) , volume =. 2017 , month_numeric =

    2017

  41. [49]

    Advances in Neural Information Processing Systems , volume=

    Playerone: Egocentric world simulator , author=. Advances in Neural Information Processing Systems , volume=

  42. [50]

    arXiv preprint arXiv:2604.01001 , year=

    EgoSim: Egocentric World Simulator for Embodied Interaction Generation , author=. arXiv preprint arXiv:2604.01001 , year=

    arXiv

  43. [51]

    arXiv preprint arXiv:2510.21571 , year=

    Scalable vision-language-action model pretraining for robotic manipulation with real-life human activity videos , author=. arXiv preprint arXiv:2510.21571 , year=

  44. [52]

    arXiv preprint arXiv:2507.15597 , year=

    Being-h0: vision-language-action pretraining from large-scale human videos , author=. arXiv preprint arXiv:2507.15597 , year=

    arXiv

  45. [53]

    arXiv preprint arXiv:2604.22615 , year=

    GazeVLA: Learning Human Intention for Robotic Manipulation , author=. arXiv preprint arXiv:2604.22615 , year=

    arXiv

  46. [54]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Dexvlg: Dexterous vision-language-grasp model at scale , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  47. [55]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Evolvinggrasp: Evolutionary grasp generation via efficient preference alignment , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  48. [56]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Contactgen: Generative contact modeling for grasp generation , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  49. [57]

    Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

    Bimart: A unified approach for the synthesis of 3d bimanual interaction with articulated objects , author=. Proceedings of the Computer Vision and Pattern Recognition Conference , pages=

  50. [58]

    IEEE Robotics and Automation Letters , volume=

    Synthesizing diverse and physically stable grasps with arbitrary hand structures using differentiable force closure estimator , author=. IEEE Robotics and Automation Letters , volume=. 2021 , publisher=

    2021

  51. [59]

    European Conference on Computer Vision , pages=

    Grasp’d: Differentiable contact-rich grasp synthesis for multi-fingered hands , author=. European Conference on Computer Vision , pages=. 2022 , organization=

    2022

  52. [60]

    European Conference on Computer Vision , pages=

    ContactPose: A dataset of grasps with object contact and hand pose , author=. European Conference on Computer Vision , pages=. 2020 , organization=

    2020

  53. [61]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Dexycb: A benchmark for capturing hand grasping of objects , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  54. [62]

    European Conference on Computer Vision , pages=

    Dense hand-object (ho) graspnet with full grasping taxonomy and dynamics , author=. European Conference on Computer Vision , pages=. 2024 , organization=

    2024

  55. [63]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Oakink: A large-scale knowledge repository for understanding hand-object interaction , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  56. [64]

    2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages=

    Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge , author=. 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages=. 2025 , organization=

    2025

  57. [65]

    arXiv preprint arXiv:2502.16420 , year=

    Anydexgrasp: General dexterous grasping for different hands with human-level learning efficiency , author=. arXiv preprint arXiv:2502.16420 , year=

    arXiv

  58. [66]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Dynamic reconstruction of hand-object interaction with distributed force-aware contact representation , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  59. [67]

    arXiv preprint arXiv:2508.14441 , year=

    FBI: Learning Dexterous In-hand Manipulation with Dynamic Visuotactile Shortcut Policy , author=. arXiv preprint arXiv:2508.14441 , year=

    arXiv

  60. [68]

    2022 , eprint=

    Grasp'D: Differentiable Contact-rich Grasp Synthesis for Multi-fingered Hands , author=. 2022 , eprint=

    2022

  61. [69]

    2026 , eprint=

    HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis , author=. 2026 , eprint=

    2026

  62. [70]

    2026 , eprint=

    Diffusion Models are Open-World Affordance Learners: Leveraging Generative Priors for 3D Affordance Learning , author=. 2026 , eprint=

    2026

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.