REVIEW 4 major objections 5 minor 132 references
ATOM: Geometry-Aware Microgesture towards Object-Agnostic Tangible Interaction
T0 review · 4 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read Corners, edges, and surfaces on everyday objects can become tap, slide, and swipe controls without per-object authoring.
desk verdict A genuinely useful integration of foundation models and human factors for on-object microgestures; the ablation story is credible, but the 'object-agnostic' claim should be scoped to offline-cached elements. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying mechanism is the fingertip-aware detection-and-ranking pipeline. It restricts the search for interaction elements to a reachable volume computed from a parameterized hand model with collision filtering, which both shrinks the problem and makes the results physically usable. Noisy scans are cleaned twice: a generative 3D mesh model sharpens the geometry, and a generative image model simplifies the 2D edge map, with the simplified sketch warped back into alignment so detected elements stay on the physical object. A weighted usability score then discards elements that are blocked, ambiguous, too small, or too smooth, and selects the top corner, edge, and surface for each degree of freedom. This chain of reachability, enhancement, and ergonomic ranking is what turns raw geometry into controls a user can reliably operate.
What would settle it
Scan a small object with one fine feature deliberately occluded, run the full pipeline, and measure the Chamfer distance between the pre- and post-enhancement geometries over that feature; if the displacement exceeds the system's own 0.5 cm fingertip-contact threshold, the detected tap or slide target no longer overlaps the physical one, and the reported task-completion benefit should disappear in a replication.
Extended reading notes
Core claim
The paper sets out to show that fine-grained local geometry is a universal tangible affordance: protruding corners, sharp edge segments, and flat surface patches on an everyday object can be mapped to 0D taps, 1D slides, and 2D swipes, so no object-level match between a physical prop and a virtual controller is needed. ATOM detects those elements only inside the fingertip's reachable space, enhances the scanned object with a generative 3D mesh model, cleans the resulting edge map with a generative image model, and then ranks candidates by reaching cost, accessibility, hand and fingertip ergonomics, gesture ambiguity, and geometric sharpness. The empirical claim is that this full pipeline completed every trial in the main user study, outperformed all three ablations on subjective usability and workload, and produced low failure rates across ten objects in a second study.
Load-bearing premise
The object-agnostic claim rests on the assumption that each object can be scanned once in advance and that the two generative cleaning steps preserve, rather than distort, the small corners, edges, and surfaces the interactions depend on.
Editorial extensions
If this is right
- With the full pipeline, users completed 100 percent of trials across all three tasks in Study 1, while every ablation produced failures, so each generative stage and the usability filter earns its place.
- Completion times around 4.91 seconds for 1D seeking and 7.53 seconds for 2D panning, with the smallest across-object variance of any condition, imply the same gesture vocabulary behaves consistently on objects of different shape and size.
- SUS of 74.75 versus 54.50 and NASA-TLX of 27.50 versus 41.17 over the best baseline indicate the detected elements feel more usable and less effortful, not merely more detectable.
- Failure rates of 6.67, 1.67, and 2.43 percent across ten objects in Study 2 support transfer across objects and grasps once each object has been pre-scanned.
Reading between the lines
- A testable extension the paper does not run: extract the same corner–edge–surface vocabulary from the AR device's live scene mesh instead of an offline pre-scan; if detection accuracy stays near the reported level, the system would approach true object-agnostic interaction instead of object-set-specific interaction.
- An inference left implicit: the five usability factors are independent of the generative stages, so they could rank elements from any future detector, including learned ones; the ergonomic formulation may be the most portable part of the contribution.
- The paper's 0D results—comparable accuracy with a reachable but geometrically wrong corner—suggest that for discrete taps, usability filtering matters more than geometric correctness, which implies a redesign could trade detection precision for speed on 0D controls.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents ATOM, a system that turns everyday handheld objects into AR tangible interfaces by detecting fine-grained geometric elements (corners, edges, and surfaces) in fingertip-reachable regions and mapping them to 0D, 1D, and 2D microgestures. The pipeline combines hand/object pose tracking, Canny edge detection on rendered normal maps, generative 3D enhancement via Hunyuan3D, generative 2D refinement via Gemini sketch simplification with ORB/RANSAC alignment, MANO-based reachability modeling, a five-factor usability scoring model, and a contact/voting interaction loop. The authors report two user studies: Study 1 (12 participants, within-subjects, 3 objects, 3 tasks, 4 trials per cell) compares the full pipeline against three ablations and reports 0% failed trials for the full system, significantly better completion times for the 1D and 2D tasks, and higher SUS/lower NASA-TLX scores; Study 2 extends to 10 objects under two poses and reports low failure rates; a system-level evaluation reports tracking stability and detection accuracy. The title and abstract claim 'object-agnostic' tangible interaction.
Significance. If supported, ATOM would be a useful contribution to opportunistic tangible AR interaction: the unified 0D/1D/2D metaphor over local geometry is elegant, and using generative foundation models to regularize noisy meshes and edge maps is a plausible way to avoid per-object training. The ablation study is well designed (within-subjects, counterbalanced, 1,728 planned trials), and the authors are admirably explicit about limitations, including non-real-time detection and occlusion sensitivity. However, the central 'object-agnostic' claim is materially narrower than what is demonstrated: because every object must be scanned offline (~10h) and per-pose detection runs offline (~2min) before elements are cached, the user studies exercise interaction with pre-computed caches under fixed poses, not runtime discovery on novel objects. The detection-accuracy evidence also lacks objective ground truth and inter-rater reliability metrics. These issues do not invalidate the cached-element framework, but they require either new evidence or a re-scoped claim.
major comments (4)
- [Abstract; Supplementary §3 'Setup requirements'; §6.1.1] The title and abstract claim 'object-agnostic' tangible interaction, but the system as evaluated is not object-agnostic at use time. The supplementary setup states that each object must be scanned offline with RealityKit Object Capture (~10h, object static and visible), and that for each grasp pose, 2D refinement (~20s), detection (~2min), and usability analysis (~10s) run before elements are cached; the online loop only performs contact detection on cached elements. Study 1 instructed participants to grasp objects in predefined poses, so detection had already succeeded offline for those poses, and Study 2 used only two fixed poses per object. The 100% task completion in Table 1 and the SUS/TLX results therefore demonstrate reliable interaction with pre-detected, cached elements under controlled postures, not generalization to novel objects or arbitrary grasps at runtime. The Limitations section concedes that detection is 'not real time.' The 'object-agnostic' claim should be re-scoped to pre-scanned objects after offline detection, or the paper should add an evaluation in which novel objects and unconstrained grasps are processed without pre-caching.
- [§6.3 'Detection accuracy'; §6.2] The central detection-accuracy claim rests on an unvalidated subjective assessment. The paper states that 'two independent users assess whether each detected element in User Study 2 is correct' and reports 'around 62%' before and 'above 90%' after usability analysis, but it gives no definition of 'correct,' no per-object/per-pose counts, no confidence intervals, and no inter-rater reliability statistic such as Cohen's kappa. Without agreement information, the two raters may simply reproduce the authors' criteria, and 'above 90%' cannot be assessed. Because Q1 in Study 1 is specifically about detection accuracy and the objective 0D accuracy is not significantly different from the best baseline (p>0.05), the paper should supply an objective or grounded accuracy protocol, and should report detection rates per object and per DoF.
- [Eq. (6); Supplementary 'Hyperparameters'] The usability weights and hard thresholds in the scoring function are load-bearing for the 'ours w/o UA' ablation, but their derivation is not reported in a way that prevents overfitting concerns. The supplementary states that the weights are 'empirically set ... from preliminary experiments' (w_rch=3.0, w_shp=3.0, etc.), and the thresholds (60% blocked, 30° sharpness, 1 cm, 4 cm²) appear hand-picked. If these values were tuned on the same objects and interaction tasks used in Study 1, the comparison between the full system and the no-UA baseline partly reflects the tuning rather than the general principle of usability analysis. The paper should report the preliminary experiment and tuning procedure, and ideally a sensitivity analysis or cross-validation across objects; at minimum it should state which objects and poses were used to set the weights and thresholds.
- [§6.1.2; Table 1] The statistical reporting is incomplete in ways that affect the strength of the headline claims. Table 1 gives failure percentages without absolute counts or denominators, and no inferential test is applied to failure rates despite the large differences (e.g., 69.79% vs 0.00% in the 2D task). The completion-time analyses exclude skipped trials as timeouts, which can bias comparisons when failure rates differ across conditions. The paper also reports 'all with p<0.05' for the custom Likert questions in Figure 13 without giving test statistics, means, or SDs. In addition, the 1D comparison with 'ours w/o UA' is not significant (p=0.244) and the 0D accuracy is not significantly different from the best baseline, so the Discussion should state those outcomes more cautiously. A complete reporting of the RM-ANOVA results, effect sizes, and failure-rate tests, or an explicit labeling of failure rates as descriptive, is needed to support the 'full pipeline outperforms ablations' conclusion.
minor comments (5)
- [§6.1.1; Supplementary §2] The procedure says target values were randomized, but the supplementary lists fixed arrays of initial/target timestamps and pan targets; please clarify whether the values were randomized per participant or fixed with trial order randomized.
- [Eq. (1)] Equation (1) is described as the proportion of rays blocked, but the formula sums ray hits without dividing by N×M; either normalize the expression or revise the description.
- [Figure 5] The label 'Warping Affinement' appears to be a typo for 'Warping Alignment' or 'Affine Refinement'; please correct.
- [§6.3] The tracking robustness protocol measures pose stability with the object stationary against a moving headset; this does not directly quantify occlusion by the interacting hand, so the claim that tracking stays within contact thresholds at <50% occlusion should distinguish head-motion stability from hand-occlusion robustness.
- [§6.2] Study 2 reports only aggregate failed-trial rates and means; per-object results would help identify which objects and grasps are easy or hard and would strengthen the generalizability claim.
Circularity Check
No significant circularity: the core detection pipeline and ablation comparisons are self-contained; the offline pre-scan limits scope but does not make the derivation circular.
full rationale
The central derivation chain is not circular. The detection pipeline (Section 4.2) combines Canny edge detection, Harris corners, DBSCAN, and generative 3D/2D enhancement; each component is an external method or a clearly specified addition, and the ablations (w/o Gen 3D, w/o Gen 2D, w/o UA) are evaluated on user task performance rather than on quantities that the components were fitted to reproduce. The usability weights in Eq. (6) are stated as empirical design choices from preliminary observations (Supplementary 'Hyperparameters'), not as parameters fitted to the reported SUS/TLX or task-completion data, and the 'ours w/o UA' ablation removes the whole usability ranking rather than predicting from the fitted weights. Author self-citations appear only in the related-work list for 3D modeling and hand-mesh reconstruction and are not load-bearing for the ATOM claims. The main limitation is a scope mismatch, not circularity: the supplementary 'Setup requirements' state that object scanning and per-pose element detection are offline and cached, so the user studies exercise cached elements under predefined poses; this weakens the 'object-agnostic' generalization claim but does not reduce any equation or prediction to its own input. No step was found where Eq. X equals Eq. Y by construction or where a fitted parameter is renamed as a prediction.
Assumptions & free parameters
free parameters (8)
- Usability weights w_rch, w_acc, w_erg, w_abg, w_shp =
3.0, 1.0, 1.0, 0.5, 3.0
- Threshold: accessibility blocked > 60% =
60% of emitted rays blocked
- Threshold: sharpness average angle < 30 deg =
30 degrees
- Threshold: minimum edge length and surface area =
edge shorter than 1 cm; surface smaller than 4 cm^2
- Threshold: proximity to other candidates =
1 cm
- Contact thresholds: proximity < 0.5 cm, motion > 2.5 cm/s =
Proximity 0.5 cm, speed 2.5 cm/s
- Voting temporal window size =
10 frames
- Dwell time for task success =
1 second
assumptions (6)
- domain assumption Canny edge detection on object normal maps yields a useful skeleton for finding interaction-relevant geometric elements.
- domain assumption Foundation image model output 'Clean and simplify this sketch' can be aligned back to the original edge map via ORB + RANSAC affine transformation without losing interaction-critical topology.
- domain assumption Hunyuan3D generates a mesh that is cleaner but geometrically faithful enough for interaction regions after point-cloud registration.
- ad hoc to paper The usability factors (reachability, accessibility, ergonomics, ambiguity, sharpness) with the chosen weights correspond to user preference.
- domain assumption MANO joint ranges from Nielsen et al. and the penetration filtering yield a physically plausible fingertip reachable space.
- ad hoc to paper The placement of four contact samples around the fingertip plus a 10-frame voting window correctly identifies the intended element.
invented entities (1)
-
The ATOM pipeline itself as a system-level construct
Cite this review
Pith. "Pith review of ATOM: Geometry-Aware Microgesture towards Object-Agnostic Tangible Interaction." pith.science (2026). https://pith.science/paper/2M7SNGPH
@misc{pith2026260811871,
author = {Pith},
title = {Pith review of: ATOM: Geometry-Aware Microgesture towards Object-Agnostic Tangible Interaction},
year = {2026},
howpublished = {\url{https://pith.science/paper/2M7SNGPH}},
note = {Machine review of arXiv:2608.11871}
}
read the original abstract
This paper presents ATOM, an integrated framework towards agnostic and tangible object interactions with microgestures. Our goal is to support microgesture interactions across different everyday objects, with the capability to automatically leverage the geometric affordance of each object. We formulate a fingertip-aware detection pipeline to leverage generative 2D and 3D models for geometry enhancement and refinement. We then introduce a usability-based method to prioritize the detected elements based on their ergonomic suitability for interactions. Building on this foundation, we further develop an AR system to transform everyday handheld objects into tangible user interfaces with 0D, 1D, and 2D microgesture interactions. Across transitions among everyday cooking objects of varying shapes and sizes, ATOM outperformed ablation baselines in task completion, usability (SUS), and workload (NASA-TLX). A further study with 10 objects demonstrates ATOM's generalizability across objects and grasps, highlighting its potential towards fluid, object-agnostic tangible interaction in real-world AR scenarios.
Figures
Figures from the paper (10 more)
Reference graph
Works this paper leans on
-
[1]
arXiv preprint arXiv:2503.09160 , year=
Wonderverse: Extendable 3d scene generation with video generative models , author=. arXiv preprint arXiv:2503.09160 , year=
-
[2]
ACM Transactions on Graphics (TOG) , volume=
EXIM: A hybrid explicit-implicit representation for text-guided 3D shape generation , author=. ACM Transactions on Graphics (TOG) , volume=
-
[3]
CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation
CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation , author=. arXiv preprint arXiv:2607.16577 , year=
-
[4]
arXiv preprint arXiv:2602.08198 , year=
Pegasus: 3d personalization of geometry and appearance , author=. arXiv preprint arXiv:2602.08198 , year=
-
[5]
SIGGRAPH Asia 2023 Conference Papers , pages=
Clipxplore: Coupled clip and shape spaces for 3d shape exploration , author=. SIGGRAPH Asia 2023 Conference Papers , pages=
2023
-
[6]
SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation , author=. arXiv preprint arXiv:2607.08246 , year=
-
[7]
arXiv preprint arXiv:2602.05362 , year=
Imagine a City: CityGenAgent for Procedural 3D City Generation , author=. arXiv preprint arXiv:2602.05362 , year=
-
[8]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Show all 132 references
-
[9]
arXiv preprint arXiv:2604.10125 , year=
PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization , author=. arXiv preprint arXiv:2604.10125 , year=
-
[10]
Proceedings of SIGGRAPH Asia , pages=
Hierarchical neural semantic representation for 3d semantic correspondence , author=. Proceedings of SIGGRAPH Asia , pages=
-
[11]
Proceedings of SIGGRAPH Asia , pages=
Neural Wavelet-domain Diffusion for 3D Shape Generation , author=. Proceedings of SIGGRAPH Asia , pages=
-
[12]
ACM SIGGRAPH 2024 Conference Papers , year =
CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization , author =. ACM SIGGRAPH 2024 Conference Papers , year =
2024
-
[13]
arXiv preprint arXiv:2602.18735 , year=
Las-comp: Zero-shot 3d completion with latent-spatial consistency , author=. arXiv preprint arXiv:2602.18735 , year=
-
[14]
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages=
Neural template: Topology-aware reconstruction and disentangled generation of 3d meshes , author=. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages=
2022
-
[15]
ACM transactions on graphics , volume=
Neural wavelet-domain diffusion for 3d shape generation, inversion, and manipulation , author=. ACM transactions on graphics , volume=
-
[16]
2023 , isbn =
He, Fengming and Hu, Xiyun and Shi, Jingyu and Qian, Xun and Wang, Tianyi and Ramani, Karthik , title =. 2023 , isbn =. doi:10.1145/3544548.3580704 , booktitle =
2023
-
[17]
2024 , issue_date =
He, Fengming and Hu, Xiyun and Qian, Xun and Zhu, Zhengzhe and Ramani, Karthik , title =. 2024 , issue_date =. doi:10.1145/3698127 , journal =
2024 doi
-
[18]
2020 , isbn =
Zhou, Qian and Sykes, Sarah and Fels, Sidney and Kin, Kenrick , title =. 2020 , isbn =
2020
-
[19]
2023 , isbn =
Jain, Rahul and Shi, Jingyu and Duan, Runlin and Zhu, Zhengzhe and Qian, Xun and Ramani, Karthik , title =. 2023 , isbn =
2023
-
[20]
2023 , isbn =
Monteiro, Kyzyl and Vatsal, Ritik and Chulpongsatorn, Neil and Parnami, Aman and Suzuki, Ryo , title =. 2023 , isbn =. doi:10.1145/3544548.3581449 , booktitle =
2023
-
[21]
Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects , year =
Sharma, Adwait and Roo, Joan Sol and Steimle, J\". Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects , year =. doi:10.1145/3290605.3300632 , booktitle =
-
[22]
2023 , isbn =
Kim, Jina and Kim, Minyung and Lee, Woo Suk and Yoon, Sang Ho , title =. 2023 , isbn =. doi:10.1145/3607822.3614544 , booktitle =
2023
-
[23]
Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand , year =
Lee, Chi-Jung and Li, Jiaxin and Yu, Tianhong Catherine and Zhang, Ruidong and Gunda, Vipin and Guimbreti\`. Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand , year =. doi:10.1145/3749469 , journal =
-
[24]
and Bhardwaj, Divyanshu and Fruchard, Bruno and McIntosh, Jess and Nittala, Aditya Shekhar and Klakow, Dietrich and Ashbrook, Daniel and Steimle, J\"
Sharma, Adwait and Hedderich, Michael A. and Bhardwaj, Divyanshu and Fruchard, Bruno and McIntosh, Jess and Nittala, Aditya Shekhar and Klakow, Dietrich and Ashbrook, Daniel and Steimle, J\". SoloFinger: Robust Microgestures while Grasping Everyday Objects , year =. doi:10.114...
-
[25]
SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger Microgestures , year =
Sharma, Adwait and Salchow-H\". SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger Microgestures , year =. doi:10.1145/3569894 , journal =
-
[26]
2025 , isbn =
Caetano, Arthur and Luo, Yunhao and Sharma, Adwait and Sra, Misha , title =. 2025 , isbn =. doi:10.1145/3746059.3747744 , articleno =
2025
-
[27]
STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input , year =
Kin, Kenrick and Wan, Chengde and Koh, Ken and Marin, Andrei and Camg\". STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input , year =. doi:10.1145/3613904.3642702 , booktitle =
-
[28]
2025 , isbn =
Kim, Jina and Zhang, Yang and Yoon, Sang Ho , title =. 2025 , isbn =. doi:10.1145/3706598.3713442 , booktitle =
2025
-
[29]
2016 , isbn =
Huang, Da-Yuan and Chan, Liwei and Yang, Shuo and Wang, Fan and Liang, Rong-Hao and Yang, De-Nian and Hung, Yi-Ping and Chen, Bing-Yu , title =. 2016 , isbn =. doi:10.1145/2858036.2858483 , booktitle =
2016
-
[30]
FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures , year =
Soliman, Mohamed and Mueller, Franziska and Hegemann, Lena and Roo, Joan Sol and Theobalt, Christian and Steimle, J\". FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures , year =. doi:10.1145/3279778.3279799 , booktitle =
-
[31]
2025 , isbn =
Hsu, Ming-Yun and Chan, Liwei , title =. 2025 , isbn =. doi:10.1145/3706599.3720213 , booktitle =
2025
-
[32]
and Schmandt, Chris , title =
Kao, Hsin-Liu (Cindy) and Dementyev, Artem and Paradiso, Joseph A. and Schmandt, Chris , title =. 2015 , isbn =. doi:10.1145/2702123.2702572 , booktitle =
2015
-
[33]
2021 , isbn =
Sun, Wei and Li, Franklin Mingzhe and Huang, Congshu and Lei, Zhenyu and Steeper, Benjamin and Tao, Songyun and Tian, Feng and Zhang, Cheng , title =. 2021 , isbn =. doi:10.1145/3447526.3472060 , booktitle =
2021
-
[34]
IEEE Access , volume=
Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing , author=. IEEE Access , volume=. 2018 , publisher=
2018
-
[35]
2025 , issue_date =
Han, Youfang and Zhao, Wei and Gao, Ge and Chen, Xiangjin and Yin, Jiliang and Wang, Lin and Meng, Xin and Yu, Yang and Zhang, Tengxiang , title =. 2025 , issue_date =. doi:10.1145/3729494 , journal =
2025 doi
-
[36]
SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Input on Side of Finger , year=
Hanayama, Shogo and Kitamura, Riku and Yamamoto, Takumi and Amesaka, Takashi and Chan, Liwei and Sugiura, Yuta , booktitle=. SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Input on Side of Finger , year=
-
[37]
2023 , isbn =
Perella-Holfeld, Francisco and Faleel, Shariff AM and Irani, Pourang , title =. 2023 , isbn =. doi:10.1145/3563657.3596117 , booktitle =
2023
-
[38]
2021 , issue_date =
Liang, Chen and Yu, Chun and Qin, Yue and Wang, Yuntao and Shi, Yuanchun , title =. 2021 , issue_date =. doi:10.1145/3478114 , month = sep, articleno =
2021 doi
-
[39]
2023 , isbn =
Chaffangeon Caillet, Adrien and Goguey, Alix and Nigay, Laurence , title =. 2023 , isbn =. doi:10.1145/3544548.3580693 , booktitle =
2023
-
[40]
2025 , issue_date =
Li, Bu and Huang, Xincheng and Xiao, Robert , title =. 2025 , issue_date =. doi:10.1145/3733052 , journal =
2025 doi
-
[41]
2023 , isbn =
Kitamura, Riku and Yamamoto, Takumi and Sugiura, Yuta , title =. 2023 , isbn =. doi:10.1145/3594738.3611371 , booktitle =
2023
-
[42]
2023 , isbn =
Gong, Weilun and Santosa, Stephanie and Grossman, Tovi and Glueck, Michael and Clarke, Daniel and Lai, Frances , title =. 2023 , isbn =. doi:10.1145/3563657.3596032 , booktitle =
2023
-
[43]
2024 , isbn =
Pei, Siyou and Kim, David and Olwal, Alex and Zhang, Yang and Du, Ruofei , title =. 2024 , isbn =. doi:10.1145/3613904.3642220 , booktitle =
2024
-
[44]
2025 , isbn =
Gil, Hyunjae and Pratap, Ashish and Joseph, Iniyan and Kim, Jin Ryong , title =. 2025 , isbn =. doi:10.1145/3706598.3714056 , booktitle =
2025
-
[45]
2016 , isbn =
Hettiarachchi, Anuruddha and Wigdor, Daniel , title =. 2016 , isbn =. doi:10.1145/2858036.2858134 , pages =
2016
-
[46]
TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking Only , year =
Dupr\'. TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking Only , year =. doi:10.1145/3613904.3642323 , booktitle =
-
[47]
2022 , isbn =
Du, Ruofei and Olwal, Alex and Le Goc, Mathieu and Wu, Shengzhi and Tang, Danhang and Zhang, Yinda and Zhang, Jun and Tan, David Joseph and Tombari, Federico and Kim, David , title =. 2022 , isbn =. doi:10.1145/3491101.3519911 , booktitle =
2022
-
[49]
2024 , isbn =
Sharma, Adwait and Ivanov, Alexander and Lai, Frances and Grossman, Tovi and Santosa, Stephanie , title =. 2024 , isbn =. doi:10.1145/3643834.3661551 , booktitle =
2024
-
[50]
and Van Wyk, Karl and Iqbal, Umar and Birchfield, Stan and others , booktitle=CVPR, pages=
Chao, Yu-Wei and Yang, Wei and Xiang, Yu and Molchanov, Pavlo and Handa, Ankur and Tremblay, Jonathan and Narang, Yashraj S. and Van Wyk, Karl and Iqbal, Umar and Birchfield, Stan and others , booktitle=CVPR, pages=
-
[51]
Hampali, Shreyas and Rad, Mahdi and Oberweger, Markus and Lepetit, Vincent , booktitle=CVPR, pages=
-
[52]
Hand Pose Estimation via Latent
Iqbal, Umar and Molchanov, Pavlo and Breuel, Thomas and Gall, Juergen and Kautz, Jan , booktitle=. Hand Pose Estimation via Latent
-
[53]
End-to-end Hand Mesh Recovery from a Aonocular
Zhang, Xiong and Li, Qiang and Mo, Hong and Zhang, Wenbo and Zheng, Wen , booktitle=. End-to-end Hand Mesh Recovery from a Aonocular
-
[54]
Moon, Gyeongsik and Lee, Kyoung Mu , booktitle=
-
[55]
CVPR , pages=
Monocular Real-time Hand Shape and Motion Capture Using Multi-modal Data , author=. CVPR , pages=
-
[56]
ICCV , pages=
Hand Image Understanding via Deep Multi-task Learning , author=. ICCV , pages=
-
[57]
Chen, Xingyu and Liu, Yufeng and Dong, Yajiao and Zhang, Xiong and Ma, Chongyang and Xiong, Yanmin and Zhang, Yuan and Guo, Xiaoyan , booktitle=
-
[58]
Xu, Hao and Wang, Tianyu and Tang, Xiao and Fu, Chi-Wing , booktitle=
-
[59]
Neural Voting Field for Camera-Space
Huang, Lin and Lin, Chung-Ching and Lin, Kevin and Liang, Lin and Wang, Lijuan and Yuan, Junsong and Liu, Zicheng , booktitle=. Neural Voting Field for Camera-Space
-
[60]
CVPR , pages=
A Simple Baseline for Efficient Hand Mesh Reconstruction , author=. CVPR , pages=
-
[61]
Reconstructing Hands in
Pavlakos, Georgios and Shan, Dandan and Radosavovic, Ilija and Kanazawa, Angjoo and Fouhey, David and Malik, Jitendra , booktitle=. Reconstructing Hands in
-
[62]
Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR) , month =
Potamias, Rolandos Alexandros and Zhang, Jinglei and Deng, Jiankang and Zafeiriou, Stefanos , title =. Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR) , month =. 2025 , pages =
2025
-
[63]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Camera , author =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
-
[64]
arXiv preprint arXiv:2512.16727 , year=
OMG-Bench: A New Challenging Benchmark for Skeleton-based Online Micro Hand Gesture Recognition , author=. arXiv preprint arXiv:2512.16727 , year=
-
[65]
2016 , isbn =
Chan, Edwin and Seyed, Teddy and Stuerzlinger, Wolfgang and Yang, Xing-Dong and Maurer, Frank , title =. 2016 , isbn =. doi:10.1145/2858036.2858589 , booktitle =
2016
-
[66]
u ller, J \
Wolf, Katrin and Naumann, Anja and Rohs, Michael and M \"u ller, J \"o rg. A Taxonomy of Microinteractions: Defining Microgestures Based on Ergonomic and Scenario-Dependent Requirements. Human-Computer Interaction -- INTERACT 2011. 2011
2011
-
[67]
2025 , eprint=
Evaluating the Usability of Microgestures for Text Editing Tasks in Virtual Reality , author=. 2025 , eprint=
2025
-
[68]
Functional Workspace for One-Handed Tap and Swipe Microgestures
Dewitz, Bastian and Steinicke, Frank and Geiger, Christian. Functional Workspace for One-Handed Tap and Swipe Microgestures. doi:10.18420/muc2019-ws-440
-
[69]
Choi, Changhyun and Trevor, Alexander J. B. and Christensen, Henrik I. , booktitle=. RGB-D edge detection and edge-based registration , year=
-
[70]
2025 , eprint=
Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details , author=. 2025 , eprint=
2025
-
[71]
2025 , eprint=
Gemini: A Family of Highly Capable Multimodal Models , author =. 2025 , eprint=
2025
-
[72]
2016 , isbn =
Wolf, Katrin and Mayer, Sven and Meyer, Stephan , title =. 2016 , isbn =. doi:10.1145/2957265.2961865 , booktitle =
2016
-
[73]
2020 , booktitle=
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis , author=. 2020 , booktitle=
2020
-
[74]
3D Gaussian Splatting for Real-Time Radiance Field Rendering , journal =
Kerbl, Bernhard and Kopanas, Georgios and Leimk. 3D Gaussian Splatting for Real-Time Radiance Field Rendering , journal =. 2023 , url =
2023
-
[75]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month=
Geometric Transformer for Fast and Robust Point Cloud Registration , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month=. 2022 , pages=
2022
-
[76]
and Cline, Harvey E
Lorensen, William E. and Cline, Harvey E. , title =. Seminal Graphics: Pioneering Efforts That Shaped the Field, Volume 1 , pages =. 1998 , isbn =
1998
-
[77]
and Cline, Harvey E
Lorensen, William E. and Cline, Harvey E. , title =. 1987 , isbn =. doi:10.1145/37401.37422 , booktitle =
1987
-
[78]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
Lin, Zhifeng and Ding, Changxing and Yao, Huan and Kuang, Zengsheng and Huang, Shaoli , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2023 , pages =
2023
-
[79]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[80]
Pavlakos, Georgios and Choutas, Vasileios and Ghorbani, Nima and Bolkart, Timo and Osman, Ahmed A. A. and Tzionas, Dimitrios and Black, Michael J. , booktitle =. Expressive body capture:
-
[82]
Yang, Lixin and Zhan, Xinyu and Li, Kailin and Xu, Wenqiang and Li, Jiefeng and Lu, Cewu , booktitle =
-
[83]
2023 , issue_date =
Tang, Xiao and Li, Ruihui and Fu, Chi-Wing , title =. 2023 , issue_date =. doi:10.1145/3569499 , month = jan, articleno =
2023 doi
-
[84]
and Granum, Erik
Nielsen, Michael and St \"o rring, Moritz and Moeslund, Thomas B. and Granum, Erik. A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. Gesture-Based Communication in Human-Computer Interaction. 2004
2004
-
[85]
2023 , note =
XR Hands package documentation , author =. 2023 , note =
2023
-
[86]
ARKit Documentation , year =
-
[87]
and Feiner, Steven , title =
Henderson, Steven J. and Feiner, Steven , title =. 2008 , isbn =. doi:10.1145/1450579.1450625 , booktitle =
2008
-
[89]
2001 , publisher=
Passive haptics significantly enhances virtual environments , author=. 2001 , publisher=
2001
-
[90]
and Van Den Hoven, Elise , title =
Bakker, Saskia and Antle, Alissa N. and Van Den Hoven, Elise , title =. 2012 , issue_date =. doi:10.1007/s00779-011-0410-4 , journal =
2012 doi
-
[91]
2020 , isbn =
Gupta, Aakar and Lin, Bo Rui and Ji, Siyi and Patel, Arjav and Vogel, Daniel , title =. 2020 , isbn =. doi:10.1145/3313831.3376139 , booktitle =
2020
-
[92]
2006 , isbn =
Hornecker, Eva and Buur, Jacob , title =. 2006 , isbn =. doi:10.1145/1124772.1124838 , booktitle =
2006
-
[93]
2010 , issue_date =
Shaer, Orit and Hornecker, Eva , title =. 2010 , issue_date =. doi:10.1561/1100000026 , journal =
2010 doi
-
[94]
2018 , isbn =
Cheng, Lung-Pan and Chang, Li and Marwecki, Sebastian and Baudisch, Patrick , title =. 2018 , isbn =. doi:10.1145/3173574.3173663 , booktitle =
2018
-
[95]
1997 , isbn =
Ishii, Hiroshi and Ullmer, Brygg , title =. 1997 , isbn =. doi:10.1145/258549.258715 , booktitle =
1997
-
[96]
2010 , isbn =
Cheng, Kai-Yin and Liang, Rong-Hao and Chen, Bing-Yu and Laing, Rung-Huei and Kuo, Sy-Yen , title =. 2010 , isbn =. doi:10.1145/1753326.1753499 , booktitle =
2010
-
[97]
Instant user interfaces: repurposing everyday objects as input devices , year =
Corsten, Christian and Avellino, Ignacio and M\". Instant user interfaces: repurposing everyday objects as input devices , year =. doi:10.1145/2512349.2512799 , booktitle =
-
[98]
2014 , isbn =
Funk, Markus and Korn, Oliver and Schmidt, Albrecht , title =. 2014 , isbn =. doi:10.1145/2559206.2581142 , booktitle =
2014
-
[99]
2019 , issue_date =
Tian, Yang and Fu, Chi-Wing and Zhao, Shengdong and Li, Ruihui and Tang, Xiao and Hu, Xiaowei and Heng, Pheng-Ann , title =. 2019 , issue_date =. doi:10.1145/3351263 , journal =
2019 doi
-
[100]
2019 , isbn =
Joshi, Nikhita and Vogel, Daniel , title =. 2019 , isbn =. doi:10.1145/3290605.3300476 , booktitle =
2019
-
[101]
, title =
Xiao, Robert and Harrison, Chris and Hudson, Scott E. , title =. 2013 , isbn =. doi:10.1145/2470654.2466113 , booktitle =
2013
-
[102]
2023 , isbn =
Joshi, Nikhita and Abtahi, Parastoo and Sodhi, Raj and Bartov, Nitzan and Rushing, Jackson and Collins, Christopher and Vogel, Daniel and Glueck, Michael , title =. 2023 , isbn =. doi:10.1145/3586183.3606713 , booktitle =
2023
-
[103]
2022 , isbn =
Rudolph, Julius Cosmo Romeo and Holman, David and De Araujo, Bruno and Jota, Ricardo and Wigdor, Daniel and Savage, Valkyrie , title =. 2022 , isbn =. doi:10.1145/3490149.3501320 , booktitle =
2022
-
[104]
2023 , issue_date =
Greenslade, Mac and Clark, Adrian and Lukosch, Stephan , title =. 2023 , issue_date =. doi:10.1145/3611052 , journal =
2023 doi
-
[105]
2014 , isbn =
Niikura, Takehiro and Watanabe, Yoshihiro and Ishikawa, Masatoshi , title =. 2014 , isbn =. doi:10.1145/2582051.2582090 , booktitle =
2014
-
[106]
2017 , issue_date =
Xiao, Robert and Hudson, Scott and Harrison, Chris , title =. 2017 , issue_date =. doi:10.1145/3095814 , journal =
2017 doi
-
[107]
2023 , issue_date =
Han, Violet Yinuo and Cho, Hyunsung and Maeda, Kiyosu and Ion, Alexandra and Lindlbauer, David , title =. 2023 , issue_date =. doi:10.1145/3626472 , journal =
2023 doi
-
[108]
and Bergmann Tiest, Wouter M
Plaisier, Myrthe A. and Bergmann Tiest, Wouter M. and Kappers, Astrid M. L. , title =. Attention, Perception, & Psychophysics , year =. doi:10.3758/APP.71.2.421 , url =
-
[109]
2011 , isbn =
Rublee, Ethan and Rabaud, Vincent and Konolige, Kurt and Bradski, Gary , title =. 2011 , isbn =. doi:10.1109/ICCV.2011.6126544 , booktitle =
2011
-
[110]
, title =
Romero, Javier and Tzionas, Dimitrios and Black, Michael J. , title =. 2017 , issue_date =. doi:10.1145/3130800.3130883 , journal =
2017
-
[111]
Alec Jacobson and Daniele Panozzo and others , note =
-
[112]
A density-based algorithm for discovering clusters in large spatial databases with noise , year =
Ester, Martin and Kriegel, Hans-Peter and Sander, J\". A density-based algorithm for discovering clusters in large spatial databases with noise , year =. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining , pages =
-
[113]
1986 , issue_date =
Canny, J , title =. 1986 , issue_date =. doi:10.1109/TPAMI.1986.4767851 , journal =
1986
-
[114]
Alvey Vision Conference , year=
A Combined Corner and Edge Detector , author=. Alvey Vision Conference , year=
-
[115]
and McKay, Neil D
Besl, Paul J. and McKay, Neil D. , title =. 1992 , issue_date =. doi:10.1109/34.121791 , journal =
1992 doi
-
[116]
and Thomas, Bruce H
Cordeil, Maxime and Bach, Benjamin and Cunningham, Andrew and Montoya, Bastian and Smith, Ross T. and Thomas, Bruce H. and Dwyer, Tim , title =. 2020 , isbn =. doi:10.1145/3313831.3376613 , booktitle =
2020
-
[117]
2012 , isbn =
Jansen, Yvonne and Dragicevic, Pierre and Fekete, Jean-Daniel , title =. 2012 , isbn =. doi:10.1145/2207676.2208691 , pages =
2012
-
[118]
and Tanner, Kesler and Ishii, Hiroshi and Follmer, Sean , title =
Jang, Sungjune and Kim, Lawrence H. and Tanner, Kesler and Ishii, Hiroshi and Follmer, Sean , title =. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems , pages =. 2016 , isbn =
2016
-
[119]
and Colaço, Andrea and Hoffmann, Henry and Gonzalez-Franco, Mar and Ahuja, Karan , journal=
Xu, Vasco and Chen, Brian and Gonzalez, Eric J. and Colaço, Andrea and Hoffmann, Henry and Gonzalez-Franco, Mar and Ahuja, Karan , journal=. SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions , year=
-
[120]
2025 , isbn =
Fan, Xu and Huang, Xincheng and Xiao, Robert , title =. 2025 , isbn =. doi:10.1145/3756884.3766028 , booktitle =
2025
-
[121]
2026 , howpublished =
2026
-
[122]
European Conference on Computer Vision , pages=
Pcf-lift: Panoptic lifting by probabilistic contrastive fusion , author=. European Conference on Computer Vision , pages=. 2024 , organization=
2024
-
[123]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Rethinking end-to-end 2d to 3d scene segmentation in gaussian splatting , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[124]
Advances in Neural Information Processing Systems , volume=
Cos3d: Collaborative open-vocabulary 3d segmentation , author=. Advances in Neural Information Processing Systems , volume=
-
[125]
EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation , author=
-
[126]
Proceedings of the IEEE/CVF international conference on computer vision , pages=
AdaFit: Rethinking learning-based normal estimation on point clouds , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
-
[127]
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
Ssp: Semi-signed prioritized neural fitting for surface reconstruction from unoriented point clouds , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
-
[128]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
Xu, Hao and Wang, Tianyu and Tang, Xiao and Fu, Chi-Wing , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2023 , pages =
2023
-
[129]
2024 , isbn =
Wang, Yinqiao and Xu, Hao and Heng, Pheng-Ann and Fu, Chi-Wing , title =. 2024 , isbn =. doi:10.1609/aaai.v38i6.28382 , booktitle =
2024 doi
-
[130]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
Xu, Hao and Li, Haipeng and Wang, Yinqiao and Liu, Shuaicheng and Fu, Chi-Wing , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2024 , pages =
2024
-
[131]
2025 , doi=
Xu, Hao and Li, Haipeng and Wang, Yinqiao and Liu, Shuaicheng and Fu, Chi-Wing , journal=. 2025 , doi=
2025
-
[132]
and Liu, Shuaicheng and Heng, Pheng-Ann and Fu, Chi-Wing , year=
Xu, Hao and Wang, Yinqiao and Mitra, Niloy J. and Liu, Shuaicheng and Heng, Pheng-Ann and Fu, Chi-Wing , year=. Hand-Shadow Poser , volume=. ACM Transactions on Graphics , publisher=. doi:10.1145/3730836 , number=
-
[133]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =
Wang, Yinqiao and Xu, Hao and Heng, Pheng-Ann and Fu, Chi-Wing , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2025 , pages =
2025
-
[134]
2601.19850 , archivePrefix=
Xie, Binzhu and Qiu, Shi and Zhang, Sicheng and Wang, Yinqiao and Xu, Hao and Naseer, Muzammal and Fu, Chi-Wing and Heng, Pheng-Ann , year=. 2601.19850 , archivePrefix=
-
[135]
Xu, Hao and Liu, Yilin and Wang, Yinqiao and Fu, Chi-Wing and Mitra, Niloy J. , year=. 2605.20992 , archivePrefix=
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.