Pith. sign in

REVIEW 5 major objections 5 minor 52 references

VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image

T0 review · 5 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read VM-BHINet claims that replacing attention with Mamba-style state-space blocks in 3D interacting-hand mesh recovery lowers MPVPE and MPJPE by 2–3% while using a fraction of the compute.

desk verdict First-to-apply Mamba for two-hand mesh recovery; efficiency gains look real, but the headline accuracy numbers rest on an implausible HIC comparison and a sloppy abstract, so the SOTA claim needs verification before I'd trust it. read the letter →

arxiv 2504.14618 v1 pith:EZQLTAWW submitted 2025-04-20 cs.CV cs.AI

Han Bi , Ge Yu , Yu He , Wenzhuo Liu , Zijie Zheng This is my paper · ORCID
classification cs.CVcs.AI
keywords 3DhandmeshrecoverybimanualinteractionstatespacemodelMambaVisionInterHand2.6MMANOmonocularRGB
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper aims to establish that state space models—specifically the Mamba variant—can replace much of the self-attention machinery in monocular 3D interacting-hand reconstruction, improving accuracy while cutting parameters and FLOPs. It proposes VM-BHINet, whose core Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock) couples a Mamba-based Vision Mamba Block with a non-local interaction module between left- and right-hand features. On InterHand2.6M the authors report overall MPVPE of 5.44 mm and MPJPE of 5.09 mm, roughly 2–3% better than the EANet baseline (6.16 and 5.73 mm), with 36.99M parameters and 12.97 GFLOPS versus EANet's 136.22M and 28.49. On the HIC dataset they report a much larger gap (overall MPVPE 28.98 mm vs. 41.34 mm). If the comparison holds, this is a concrete step toward faster, cheaper bimanual hand tracking for AR/VR and human-computer interaction.

What carries the argument

The load-bearing component is the Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock), which stacks a Vision Mamba Block (VMBlock) and an Interaction Feature Extraction Module (IFEM). VMBlock uses a state space model—a sequence model that propagates a hidden state across positions at linear cost—alongside convolutions, MLPs, LayerNorm, and linear layers to capture global dependencies; IFEM then applies non-local attention between left- and right-hand features to encode their interaction. A second application of VMBlock to joint features (Joint Vision Mamba Block, JVMBlock) refines per-hand joint representations before the Dual Hand Parameter Regressor maps them to MANO pose and shape parameters and relative translation, trained with a weighted sum of L1 losses over pose, shape, joints, meshes, and translation.

What would settle it

Run EANet's released model and VM-BHINet on the official InterHand2.6M test split using identical training data, augmentation, and evaluation code; if EANet's reproduced MPVPE/MPJPE differ from the 6.16/5.73 mm reported in Table II, or if the gap to VM-BHINet's 5.44/5.09 mm shrinks below the claimed 2–3%, the central SOTA claim is not established.

Watch

Extended reading notes

Core claim

VM-BHINet claims to be the first framework to bring state space models into 3D interacting hand mesh recovery. The network takes a single RGB image, extracts left/right features with a ResNet-50 backbone, concatenates them, and processes them through VM-IFEBlock: a VMBlock built on the Mamba selective SSM plus local convolutions, followed by an Interaction Feature Extraction Module that uses non-local attention to relate the two hands. The Hand Joint Feature Extractor and Joint Vision Mamba Block then refine per-hand joint features, and the Dual Hand Parameter Regressor predicts MANO pose and shape parameters plus the relative 3D translation between hands. The paper reports that this architecture lowers both per-vertex and per-joint errors on InterHand2.6M to 5.44 and 5.09 mm overall, surpassing EANet's 6.16 and 5.73 mm while using 27% of its parameters and 46% of its FLOPs; on HIC it reports even larger absolute gains. The central claim is that replacing quadratic self-attention with linear-time SSM-based blocks is enough to improve both accuracy and efficiency in tightly interacting hands.

Load-bearing premise

The load-bearing premise is that the 'Contrast' baseline row in the ablation table is a faithful, comparably trained reproduction of EANet on the same InterHand2.6M split and evaluation; the paper does not release code or evaluation scripts, so that comparability is unverified.

Editorial extensions

If this is right

  • If the reported numbers hold, SSM-based blocks can replace attention blocks in interacting-hand reconstruction without sacrificing accuracy—VM-BHINet's overall MPVPE/MPJPE on InterHand2.6M are 5.44/5.09 mm vs. EANet's 6.16/5.73 mm.
  • The parameter and FLOP reductions (36.99M/12.97 vs. 136.22M/28.49 for EANet) make real-time or embedded bimanual tracking a more plausible target for AR/VR and HCI.
  • The large HIC gains (overall MPVPE 28.98 mm vs. EANet's 41.34 mm) suggest, if reproducible, that the interaction feature extraction transfers beyond the InterHand2.6M capture setting.
  • Combining VM-IFEBlock and JVMBlock is reported to be necessary: ablation with only one of the two raises error and parameters, so the interaction between the two blocks is part of the claimed mechanism.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The 2–3% margin on InterHand2.6M is small enough that protocol differences (data split, augmentation, root alignment, evaluation code) could flip it; a re-run of EANet's released model under exactly VM-BHINet's training protocol would settle whether the SSM blocks are the cause of the gain.
  • Table I's odd parameter pattern—both blocks together giving 36.99M params while either block alone gives 61.15M or 112.07M—suggests the architecture also changes the backbone or parameter sharing; readers should verify what the 'Contrast' row actually is before attributing the saving to SSMs alone.
  • The paper's own Limitation & Future Work section states that robustness under complex backgrounds/extreme lighting, real-time speed, cross-domain generalization, and multi-hand scenarios remain open; the reported numbers are therefore a benchmark result, not a deployment claim.
  • A natural next experiment would be to drop VM-IFEBlock into an existing attention-based hand reconstruction model as a plug-in block and measure error change, isolating the SSM effect from the rest of the architecture.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper proposes VM-BHINet, a 3D interacting-hand mesh recovery network that introduces Mamba-style state space models into an EANet-like pipeline. The architecture consists of a ResNet-50 backbone, a Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock) that combines Mamba blocks with the IFEM interaction module from the authors' prior work, a Hand Joint Feature Extractor, a Joint Vision Mamba Block, and a Dual Hand Parameter Regressor. The authors report ablation studies and comparisons on InterHand2.6M and HIC, claiming that VM-BHINet reduces MPJPE and MPVPE by 2-3% and significantly surpasses state-of-the-art methods while also reducing parameters and GFLOPs.

Significance. If the reported numbers are reliable, the efficiency gains are substantial: the full model uses 36.99M parameters and 12.97 GFLOPs compared with 136.22M parameters and 28.49 GFLOPs for the EANet baseline, with lower MPVPE and MPJPE. A positive feature is that the asterisked comparisons use the authors' released models rather than numbers copied from previous papers. However, the central SOTA claim is not yet substantiated because the headline percentage reduction is inconsistent with the tables, the HIC baseline rows contain internally impossible aggregate values, and the experimental protocol and code are not provided.

major comments (5)
  1. [Abstract, Section I, Table II] The abstract and the third contribution state that VM-BHINet reduces MPJPE and MPVPE by 2-3%, but Table II reports overall MPVPE dropping from 6.16 to 5.44, a relative reduction of about 11.7%, and overall MPJPE dropping from 5.73 to 5.09, about 11.2%. The same discrepancy appears in Table I. The 2-3% claim is therefore unsupported by the paper's own tables and should be corrected or explicitly justified.
  2. [Table III] The HIC results for the asterisked baselines are internally inconsistent. For EANet, MPJPE is 43.97 for Single, 38.88 for Two, and 45.01 for All; for ACR, MPVPE is 46.02 for Single, 40.32 for Two, and 39.10 for All, and MPJPE is 45.38, 42.98, and 47.09 for Single, Two, and All respectively. If All is an aggregate of the Single and Two sets, these values are impossible because a weighted average cannot lie outside the range of its components. This makes the claimed HIC improvement (28.98 vs 41.34 MPVPE, 27.47 vs 45.01 MPJPE) unverifiable and points to a protocol or transcription problem in the baseline rows.
  3. [Section IV-A, Section IV-B] The HIC evaluation is not described. Section IV-A specifies training details only for InterHand2.6M, and Section IV-B merely says the model was evaluated on HIC. There is no information about HIC training epochs, learning rate schedule, batch size, input resolution, crop strategy, root alignment, or which split was used. Without these details, the large HIC gains cannot be assessed or reproduced. The authors should provide the full HIC protocol and, ideally, release code and evaluation scripts.
  4. [Table I vs Table II] The no-module ablation row in Table I (136.22M parameters, 28.49 GFLOPs, MPVPE 5.61/6.87/6.16, MPJPE 5.28/6.17/5.73) is numerically identical to the EANet row in Table II, yet the paper never identifies this baseline as EANet. The authors must state explicitly what this baseline is, how it was trained, and confirm that VM-BHINet and all asterisked baselines were evaluated under identical data splits, augmentation, and evaluation code. Without this, the comparability assumption that supports the central SOTA claim is unverified.
  5. [Section III-B, VMBlock] The core new component, VMBlock, is described only verbally. The paper does not provide the state-space equations, the selective scan configuration, the token ordering, or the manner in which the SSM is applied to 2D feature maps. As a result, the proposed block cannot be reimplemented from the text. The authors should give exact formulations or pseudocode for the VMBlock.
minor comments (5)
  1. [Title and Table I caption] There are typos in the title and in the Table I caption: 'VM-BHINet:Vision' is missing a space after the colon, and 'IFEB LOCK' should be 'IFEBlock'.
  2. [Equation (11)] The paragraph following Eq. (11) begins 'Whereθgt' without a space; this should be corrected to 'Where θgt'.
  3. [Equation (11)] The loss weights λ1 through λ9 are introduced but their numerical values are never reported. Since the loss weights directly affect the reported errors, the authors should list the values used.
  4. [Section IV-D] The paper should clarify whether all metrics come from a single training run and, if so, report variance across seeds or at least soften the word 'significantly' in the abstract.
  5. [Section III-B, IFEM] Because IFEM is explicitly credited to the authors' prior work [2], the paper should clearly delineate which parts of VM-IFEBlock are new and should include a comparison with InterHandNet [2] to justify the new contribution.

Circularity Check

0 steps flagged · score 2.0 of 10

No significant circularity: benchmark results against external methods carry the SOTA claim; only minor self-citation is the borrowed IFEM [2].

full rationale

The paper's claims are empirical: it reports test-set MPVPE/MPJPE on InterHand2.6M and HIC against published methods. No parameter is fitted to the test set, no predicted quantity is defined in terms of an input it is supposed to predict, and no uniqueness theorem or ansatz is imported to force the architecture. The only self-citation is the Interaction Feature Extraction Module credited to the authors' prior work [2] (Section III-B: 'The Interaction Feature Extraction Module (IFEM) [2] aims to enhance...'). This is a borrowed architectural component, not a load-bearing derivation: the central SOTA claim is established by benchmarking against external methods such as EANet, IntagHand, and ACR in Tables II and III, and the ablation in Table I independently measures the effect of adding VM-IFEBlock and JVMBlock. The abstract's '2-3%' phrase is inconsistent with the roughly 11% relative improvements in Table II, and the HIC baselines would need released code to verify protocol comparability, but these are correctness/reproducibility concerns, not circularity. Score 2 reflects only the minor, non-load-bearing self-citation of IFEM.

Assumptions & free parameters 3 free parameters · 4 assumptions · 1 invented entities

The central claim rests on the MANO hand model, the InterHand2.6M benchmark, the faithfulness of the EANet baseline, and the unproven applicability of Mamba to 2D hand features. The paper does not disclose loss weights, VMBlock hyperparameters, or HIC evaluation details, leaving several free parameters.

free parameters (3)
  • Loss weights λ1...λ9 = not reported
    Equation (11) defines the total loss as a weighted sum of nine terms, but the paper never states the values of λ1...λ9. These weights are hand-chosen and affect the reported error.
  • VMBlock configuration = not reported
    Number of VMBlocks, SSM state dimension, scan order, and channel widths are not specified in Section III-B or the figure captions, leaving the architecture underdetermined.
  • HIC training protocol = not reported
    The paper says VM-BHINet was evaluated on HIC but does not specify the training split, alignment, or metric convention used, which matters because HIC has no widely used official test split.
assumptions (4)
  • domain assumption MANO is an accurate parametric model of the human hand.
    The final meshes are generated by MANO(θ, β) in Equation (10); the paper relies on MANO's vertex and joint topology without questioning it.
  • domain assumption InterHand2.6M ground truth and official test split are correct and comparably evaluated.
    All main comparisons use the official test split of InterHand2.6M (Section IV-B), assuming the published ground truth is accurate.
  • ad hoc to paper The released EANet model's numbers, marked with *, are directly comparable to the authors' own training pipeline.
    Table II compares VM-BHINet with EANet [38]*, where the EANet result was obtained by the authors evaluating a released model, but training details, preprocessing, and evaluation code for VM-BHINet are not shown to match.
  • domain assumption A Vision Mamba state space model can be applied to 2D hand features by flattening them into a sequence with no loss of spatial structure.
    The paper states VMBlock 'captures temporal and spatial dependencies' via SSM but gives no equations for the scan or for how the two hands are ordered in the sequence.
invented entities (1)
  • VM-IFEBlock
    purpose: A block combining a Mamba SSM with a non-local interaction module to fuse left and right hand features.
    The block is introduced in this paper only; no code, weights, or external validation are provided, so its effectiveness rests entirely on the paper's own tables.

how reviews work

0 comments
Cite this review

Pith. "Pith review of VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image." pith.science (2026). https://pith.science/paper/EZQLTAWW

@misc{pith2026250414618,
  author       = {Pith},
  title        = {Pith review of: VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EZQLTAWW}},
  note         = {Machine review of arXiv:2504.14618}
}
read the original abstract

Understanding bimanual hand interactions is essential for realistic 3D pose and shape reconstruction. However, existing methods struggle with occlusions, ambiguous appearances, and computational inefficiencies. To address these challenges, we propose Vision Mamba Bimanual Hand Interaction Network (VM-BHINet), introducing state space models (SSMs) into hand reconstruction to enhance interaction modeling while improving computational efficiency. The core component, Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock), combines SSMs with local and global feature operations, enabling deep understanding of hand interactions. Experiments on the InterHand2.6M dataset show that VM-BHINet reduces Mean per-joint position error (MPJPE) and Mean per-vertex position error (MPVPE) by 2-3%, significantly surpassing state-of-the-art methods.

Figures

Figures reproduced from arXiv: 2504.14618 by the authors.

Figure 1
Figure 1. Visual results of the VM-BHINet. VM-BHINet achieves remarkable [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Our proposed Vision Mamba Bimanual Hand Interaction Network (VM-BHINet). It consists of five main components: the Backbone, the Vision [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. The illustration of the proposed VMblock. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Qualitative Ablation Study on InterHand2.6M [ [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: Qualitative comparison of the interacting hand reconstruction with [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

52 extracted references · 39 canonical work pages

  1. [1]

    Motion capture of hands in action using discriminative salient points

    Luca Ballan, Aparna Taneja, J ¨urgen Gall, Luc Van Gool, and Marc Pollefeys. Motion capture of hands in action using discriminative salient points. In Computer Vision–ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7-13, 2012, Proceedings, Part VI 12, pages 640–653. Springer, 2012

    work page 2012

  2. [2]

    Interhandnet: Enhancing 3d interacting hand mesh recovery through inter-hand feature extraction

    Han Bi, Ge Yu, and Yu He. Interhandnet: Enhancing 3d interacting hand mesh recovery through inter-hand feature extraction. In 2024 6th International Conference on Electronics and Communication, Network and Computer Technology (ECNCT) , pages 510–514. IEEE, 2024

    work page 2024

  3. [3]

    Handfoldingnet: A 3d hand pose estimation network using multiscale-feature guided folding of a 2d hand skeleton

    Wencan Cheng, Jae Hyun Park, and Jong Hwan Ko. Handfoldingnet: A 3d hand pose estimation network using multiscale-feature guided folding of a 2d hand skeleton. In Proceedings of the IEEE/CVF international conference on computer vision , pages 11260–11269, 2021

    work page 2021

  4. [4]

    Textnerf: A novel scene-text image synthesis method based on neural radiance fields

    Jialei Cui, Jianwei Du, Wenzhuo Liu, and Zhouhui Lian. Textnerf: A novel scene-text image synthesis method based on neural radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22272–22281, 2024

    work page 2024

  5. [5]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei- Fei. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition , pages 248–255. Ieee, 2009

    2009

  6. [6]

    Lwa-hand: Lightweight attention hand for interacting hand reconstruction

    Xinhan Di and Pengqian Yu. Lwa-hand: Lightweight attention hand for interacting hand reconstruction. In European Conference on Computer Vision, pages 722–738. Springer, 2022

    work page 2022

  7. [7]

    Learning to disambiguate strongly interacting hands via probabilistic per-pixel part segmentation

    Zicong Fan, Adrian Spurr, Muhammed Kocabas, Siyu Tang, Michael J Black, and Otmar Hilliges. Learning to disambiguate strongly interacting hands via probabilistic per-pixel part segmentation. In 2021 Interna- tional Conference on 3D Vision (3DV) , pages 1–10. IEEE, 2021

    work page 2021

  8. [8]

    A segmentation method based on boundary fracture correction for froth scale measurement

    Yongqi Gan, Wenzhuo Liu, Jianwang Gan, and Guoying Zhang. A segmentation method based on boundary fracture correction for froth scale measurement. Applied Intelligence, pages 1–22, 2024

    work page 2024

Show all 52 references
  1. [9]

    Sifdrivenet: Speed and image fusion for driving behavior classification network

    Yan Gong, Jianli Lu, Wenzhuo Liu, Zhiwei Li, Xinmin Jiang, Xin Gao, and Xingang Wu. Sifdrivenet: Speed and image fusion for driving behavior classification network. IEEE Transactions on Computational Social Systems, 2023

    2023

  2. [10]

    Multi-modal fusion technology based on vehicle information: A survey

    Yan Gong, Jianli Lu, Jiayi Wu, and Wenzhuo Liu. Multi-modal fusion technology based on vehicle information: A survey. arXiv preprint arXiv:2211.06080, 2022

    2022 arXiv

  3. [11]

    Mamba: Linear-time sequence modeling with selective state spaces

    Albert Gu and Tri Dao. Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.00752 , 2023

    2023 arXiv

  4. [12]

    Efficiently modeling long sequences with structured state spaces

    Albert Gu, Karan Goel, and Christopher R ´e. Efficiently modeling long sequences with structured state spaces. arXiv preprint arXiv:2111.00396, 2021

    2021 arXiv

  5. [13]

    Combining recurrent, convolutional, and continuous-time models with linear state space layers

    Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, and Christopher R ´e. Combining recurrent, convolutional, and continuous-time models with linear state space layers. Advances in neural information processing systems , 34:572–585, 2021

    2021

  6. [14]

    Keypoint transformer: Solving joint identification in challenging hands and object interactions for accurate 3d pose estimation

    Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, and Vincent Lepetit. Keypoint transformer: Solving joint identification in challenging hands and object interactions for accurate 3d pose estimation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogniti...

    2022

  7. [15]

    Megatrack: monochrome egocentric articulated hand-tracking for virtual reality

    Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Ak- bay, Zheng Wang, et al. Megatrack: monochrome egocentric articulated hand-tracking for virtual reality. ACM Transactions on Graphics (ToG), 39(4):8...

    2020

  8. [16]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 770–778, 2016

    2016

  9. [17]

    Mfe-ssnet: Multi-modal fusion-based end-to-end steering angle and vehicle speed prediction network

    Yi Huang, Wenzhuo Liu, Yaoyu Li, Lei Yang, Hanqi Jiang, Zhiwei Li, and Jun Li. Mfe-ssnet: Multi-modal fusion-based end-to-end steering angle and vehicle speed prediction network. Automotive Innovation , pages 1–14, 2024

    2024

  10. [18]

    A2j-transformer: Anchor-to- joint transformer network for 3d interacting hand pose estimation from a single rgb image

    Changlong Jiang, Yang Xiao, Cunlin Wu, Mingyang Zhang, Jinghong Zheng, Zhiguo Cao, and Joey Tianyi Zhou. A2j-transformer: Anchor-to- joint transformer network for 3d interacting hand pose estimation from a single rgb image. In Proceedings of the IEEE/CVF Conference on Computer...

    2023

  11. [19]

    Towards social artificial intelligence: Nonverbal social signal prediction in a triadic interaction

    Hanbyul Joo, Tomas Simon, Mina Cikara, and Yaser Sheikh. Towards social artificial intelligence: Nonverbal social signal prediction in a triadic interaction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 10873–10883, 2019

    2019

  12. [20]

    A new approach to linear filtering and prediction problems

    Rudolph Emil Kalman. A new approach to linear filtering and prediction problems. 1960

    1960

  13. [21]

    End-to-end detection and pose estimation of two interacting hands

    Dong Uk Kim, Kwang In Kim, and Seungryul Baek. End-to-end detection and pose estimation of two interacting hands. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 11189–11198, 2021

    2021

  14. [22]

    Adam: A method for stochastic optimization

    Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. Computer Science, 2014

    2014

  15. [23]

    H2o: Two hands manipulating objects for first person interaction recognition

    Taein Kwon, Bugra Tekin, Jan St ¨uhmer, Federica Bogo, and Marc Pollefeys. H2o: Two hands manipulating objects for first person interaction recognition. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 10138–10148, 2021

    2021

  16. [24]

    Scalable 3d tracking of multiple interacting objects

    Nikolaos Kyriazis and Antonis Argyros. Scalable 3d tracking of multiple interacting objects. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 3430–3437, 2014

    2014

  17. [25]

    Interacting attention graph for single image two-hand reconstruction

    Mengcheng Li, Liang An, Hongwen Zhang, Lianpeng Wu, Feng Chen, Tao Yu, and Yebin Liu. Interacting attention graph for single image two-hand reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 2761–2770, 2022

    2022

  18. [26]

    Mipd: A multi-sensory interactive perception dataset for embodied intelligent driving

    Zhiwei Li, Tingzhen Zhang, Meihua Zhou, Dandan Tang, Pengwei Zhang, Wenzhuo Liu, Qiaoning Yang, Tianyu Shen, Kunfeng Wang, and Huaping Liu. Mipd: A multi-sensory interactive perception dataset for embodied intelligent driving. arXiv preprint arXiv:2411.05881 , 2024

    2024 arXiv

  19. [27]

    Two-hand global 3d pose estimation using monocular rgb

    Fanqing Lin, Connor Wilhelm, and Tony Martinez. Two-hand global 3d pose estimation using monocular rgb. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2373–2381, 2021

    2021

  20. [28]

    Glmdrivenet: Global–local multimodal fusion driving behavior classification network

    Wenzhuo Liu, Yan Gong, Guoying Zhang, Jianli Lu, Yunlai Zhou, and Junbin Liao. Glmdrivenet: Global–local multimodal fusion driving behavior classification network. Engineering Applications of Artificial Intelligence, 129:107575, 2024

    2024

  21. [29]

    Fmdnet: Feature-attention- embedding-based multimodal-fusion driving-behavior-classification net- work

    Wenzhuo Liu, Jianli Lu, Junbin Liao, Yicheng Qiao, Guoying Zhang, Jiayin Zhu, Bozhang Xu, and Zhiwei Li. Fmdnet: Feature-attention- embedding-based multimodal-fusion driving-behavior-classification net- work. IEEE Transactions on Computational Social Systems , 2024

    2024

  22. [30]

    Umd-net: A unified multi-task assistive driving network based on multimodal fusion

    Wenzhuo Liu, Yicheng Qiao, Zhiwei Li, Wenshuo Wang, Wei Zhang, Jiayin Zhu, Yanhuan Jiang, Li Wang, Hong Wang, Huaping Liu, et al. Umd-net: A unified multi-task assistive driving network based on multimodal fusion. IEEE Transactions on Intelligent Transportation Systems, 2025

    2025

  23. [31]

    Mmtl-uniad: A unified framework for multimodal and multi-task learn- ing in assistive driving perception

    Wenzhuo Liu, Wenshuo Wang, Yicheng Qiao, Qiannan Guo, Jiayin Zhu, Pengfei Li, Zilong Chen, Huiming Yang, Zhiwei Li, Lening Wang, et al. Mmtl-uniad: A unified framework for multimodal and multi-task learn- ing in assistive driving perception. arXiv preprint arXiv:2504.02264 , 2025. 10

    2025 arXiv

  24. [32]

    3d interacting hand pose estimation by hand de-occlusion and removal

    Hao Meng, Sheng Jin, Wentao Liu, Chen Qian, Mengxiang Lin, Wanli Ouyang, and Ping Luo. 3d interacting hand pose estimation by hand de-occlusion and removal. In European Conference on Computer Vision, pages 380–397. Springer, 2022

    2022

  25. [33]

    Neuralannot: Neural annotator for 3d human mesh training sets

    Gyeongsik Moon, Hongsuk Choi, and Kyoung Mu Lee. Neuralannot: Neural annotator for 3d human mesh training sets. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2299–2307, 2022

    2022

  26. [34]

    Interhand2

    Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, and Ky- oung Mu Lee. Interhand2. 6m: A dataset and baseline for 3d interacting hand pose estimation from a single rgb image. In Computer Vision– ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceed...

    2020

  27. [35]

    Real-time pose and shape reconstruction of two interacting hands with a single depth camera

    Franziska Mueller, Micah Davis, Florian Bernard, Oleksandr Sotny- chenko, Mickeal Verschoor, Miguel A Otaduy, Dan Casas, and Christian Theobalt. Real-time pose and shape reconstruction of two interacting hands with a single depth camera. ACM Transactions on Graphics (ToG), 38(...

    2019

  28. [36]

    Body2hands: Learning to infer 3d hands from conversational gesture body dynamics

    Evonne Ng, Shiry Ginosar, Trevor Darrell, and Hanbyul Joo. Body2hands: Learning to infer 3d hands from conversational gesture body dynamics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 11865–11874, 2021

    2021

  29. [37]

    Track- ing the articulated motion of two strongly interacting hands

    Iasonas Oikonomidis, Nikolaos Kyriazis, and Antonis A Argyros. Track- ing the articulated motion of two strongly interacting hands. In 2012 IEEE conference on computer vision and pattern recognition , pages 1862–1869. IEEE, 2012

    2012

  30. [38]

    Extract-and-adaptation network for 3d interacting hand mesh recovery

    JoonKyu Park, Daniel Sungho Jung, Gyeongsik Moon, and Kyoung Mu Lee. Extract-and-adaptation network for 3d interacting hand mesh recovery. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 4200–4209, 2023

    2023

  31. [39]

    Automatic differentiation in pytorch

    Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in pytorch. 2017

    2017

  32. [40]

    Embodied hands: Modeling and capturing hands and bodies together.arXiv preprint arXiv:2201.02610, 2022

    Javier Romero, Dimitrios Tzionas, and Michael J Black. Embodied hands: Modeling and capturing hands and bodies together.arXiv preprint arXiv:2201.02610, 2022

    2022 arXiv

  33. [41]

    Monocular 3d reconstruction of interacting hands via collision-aware factorized refinements

    Yu Rong, Jingbo Wang, Ziwei Liu, and Chen Change Loy. Monocular 3d reconstruction of interacting hands via collision-aware factorized refinements. In 2021 International Conference on 3D Vision (3DV) , pages 432–441. IEEE, 2021

    2021

  34. [42]

    Bssnet: A real-time semantic segmentation network for road scenes inspired from autoencoder

    Xiaoqiang Shi, Zhenyu Yin, Guangjie Han, Wenzhuo Liu, Li Qin, Yuanguo Bi, and Shurui Li. Bssnet: A real-time semantic segmentation network for road scenes inspired from autoencoder. IEEE Transactions on Circuits and Systems for Video Technology , 2023

    2023

  35. [43]

    Advancing virtual reality interaction through real-time hand gesture recognition for immersive experiences

    Vinayak Kumar Singh, Lekshmi Kalinathan, Marimuthu Marimuthu, Sengazhani Murugesan Vadivel, and Saravanan Palani. Advancing virtual reality interaction through real-time hand gesture recognition for immersive experiences. In 2024 3rd International Conference on Artificial Inte...

    2024

  36. [44]

    Graph-based target association for multi-drone collaborative perception under imperfect detection conditions

    Qifan Tan, Xuqi Yang, Cheng Qiu, Wenzhuo Liu, Yize Li, Zhengxia Zou, and Jing Huang. Graph-based target association for multi-drone collaborative perception under imperfect detection conditions. Drones, 9(4):300, 2025

    2025

  37. [45]

    Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences

    Jonathan Taylor, Lucas Bordeaux, Thomas Cashman, Bob Corish, Cem Keskin, Toby Sharp, Eduardo Soto, David Sweeney, Julien Valentin, Benjamin Luff, et al. Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Tran...

    2016

  38. [46]

    Capturing hands in action using discriminative salient points and physics simulation

    Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, and Juergen Gall. Capturing hands in action using discriminative salient points and physics simulation. International Journal of Computer Vision , 118:172–193, 2016

    2016

  39. [47]

    Memahand: Exploiting mesh-mano interaction for single image two-hand reconstruction

    Congyi Wang, Feida Zhu, and Shilei Wen. Memahand: Exploiting mesh-mano interaction for single image two-hand reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 564–573, 2023

    2023

  40. [48]

    Rgb2hands: real-time tracking of 3d hand interac- tions from monocular rgb video

    Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Olek- sandr Sotnychenko, Neng Qian, Miguel A Otaduy, Dan Casas, and Christian Theobalt. Rgb2hands: real-time tracking of 3d hand interac- tions from monocular rgb video. ACM Transactions on Graphics (ToG), 39(6):1–16, 2020

    2020

  41. [49]

    Path planning for air- ground robot considering modal switching point optimization

    Xiaoyu Wang, Kangyao Huang, Xinyu Zhang, Honglin Sun, Wenzhuo Liu, Huaping Liu, Jun Li, and Pingping Lu. Path planning for air- ground robot considering modal switching point optimization. In 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pages 87–94. IEEE, 2023

    2023

  42. [50]

    Acr: Attention collaboration-based regressor for arbitrary two- hand reconstruction

    Zhengdi Yu, Shaoli Huang, Chen Fang, Toby P Breckon, and Jue Wang. Acr: Attention collaboration-based regressor for arbitrary two- hand reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 12955–12964, 2023

    2023

  43. [51]

    Interacting two-hand 3d pose and shape reconstruction from single color image

    Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma, and Hongan Wang. Interacting two-hand 3d pose and shape reconstruction from single color image. In Proceedings of the IEEE/CVF international conference on computer vision , pages 11354– 11363, 2021

    2021

  44. [52]

    Oblique convolution: A novel convolution idea for redefining lane detection

    Xinyu Zhang, Yan Gong, Jianli Lu, Zhiwei Li, Shixiang Li, Shu Wang, Wenzhuo Liu, Li Wang, and Jun Li. Oblique convolution: A novel convolution idea for redefining lane detection. IEEE Transactions on Intelligent Vehicles, 2023

    2023

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.