Computer Vision and Pattern Recognition · arXiv:2611.16339 v1 · submitted 12 Nov 2026 · 65 references
Hand in Silhouette: Synthetic-to-Real Multi-View Hand Reconstruction via Binary Masks
The paper says
“Calibrated multi-view hand reconstruction has advanced rapidly, yet the effectiveness of existing methods depends strongly on real captured data, which is costly to acquire, limited in hand-geometry diversity, and often affected by imperfect annotations.”
more of the abstract
Synthetic data offers a scalable alternative with accurate supervision, but a substantial synthetic-to-real appearance gap hinders its use. To address this, we introduce Hand in Silhouette (SilHand), a calibrated multi-view hand reconstruction framework that operates on binary hand masks, obtainable at low cost either automatically or manually, to reduce the synthetic-to-real observation gap. Rather than relying on RGB features for 3D lifting, SilHand projects metric 3D hypotheses into each view to query and fuse mask-ray evidence for hand reconstruction. This mask-centric formulation enables training on a large-scale synthetic dataset comprising 46.8k grasping poses and 60k free-hand samples, providing broad coverage of hand geometry while directly transferring to real captured hand geometry. Across five real-world benchmarks, SilHand improves relative reconstruction accuracy from 49.2% to 63.4% using masks rendered from reference hands. Moreover, reconstruction accuracy improves consistently as the synthetic training set grows, indicating that broader geometric coverage translates into better real-world performance. While achieving such diversity is difficult with real captured data, it becomes practical under our mask-centric formulation. Finally, SilHand remains robust under mask corruption, with reconstruction error increasing by at most 1.63 mm. Together, these results support binary masks as an effective interface for learning hand reconstruction from synthetic geometry.
from the abstract
Pith says
Machine review · deepseek-v4-flash · 13 Nov 2026 · what was read was not recorded · not checked by a person
It can be wrong. Challenge this review or reply to it.
The passes disagreed. Reader: holds up. Skeptic: holds up only with conditions. Referee: major revision.
SilHand is a solid, well-executed paper that makes a real contribution to multi-view hand reconstruction by using binary masks to sidestep the synthetic-to-real appearance gap. The central claim is supported, but the headline numbers (49–63% improvement) come from an idealized evaluation that removes the very challenge the method is designed to solve. This line is wrong
4 major objections · 6 minor
How often objections from reviews like this one are right: not yet measured
Not checked: figures, code, what the 65 references say.
The paper says, at §4.2, Table 1
The review did not quote this passage.
A classifier read this sentence of the paper as acknowledging the concern (probability 0.84):
“Such annotation biases and errors are not captured by SilHand, as it is trained on aligned synthetic data.”
Pith says: Objection 1 of 4 · major
The primary quantitative claim (49.2%–63.4% MPVPE reduction) is based on annotation-oriented evaluation using masks rendered from ground-truth annotations. This setting removes the very challenge the method is designed to solve: real, imperfect masks. The paper acknowledges this limitation (Section 4.2: 'annotation discrepancies... are not captured by SilHand') but does not report 3D reconstruction error (MPVPE/MPJPE) on real masks for all five datasets.
more of objection 1
The observation-oriented evaluation (Table 2) only reports held-out-view IoU, not 3D error. The PALM evaluation (Table 10) uses real masks and reports surface distance, but only on one dataset and without the dramatic improvement ratios. Therefore, the central claim that SilHand achieves 49.2%–63.4% improvement under realistic input conditions is not directly supported. The authors should report 3D reconstruction metrics on real masks (e.g., SAM3) for all five datasets, or clearly state that the headline numbers are under idealized conditions and provide a more complete picture of performance under realistic mask quality.
The paper says, at §4.2, Table 2
The review did not quote this passage.
Pith says: Objection 2 of 4 · major
The observation-oriented evaluation (Table 2) reports held-out-view mask IoU, which is a 2D metric and does not directly measure 3D reconstruction accuracy. While it provides complementary evidence, it does not substitute for 3D error metrics on real masks. The paper should include 3D reconstruction error (MPVPE/MPJPE) on real masks for at least a subset of datasets to substantiate the claim that the method works under realistic conditions.
The paper says, at §3.6, §4.3
The review did not quote this passage.
Pith says: Objection 3 of 4 · major
The synthetic dataset includes 46.8k grasping poses and 60k free-hand samples, but the paper does not provide a clear analysis of how the distribution of synthetic poses compares to the real test distributions. The scaling experiment (Fig. 2b) shows improvement with more data, but it is not shown whether the synthetic data covers the test distribution adequately. The paper should discuss potential distribution mismatch and its impact on the results.
The paper says, at §5, §A.7
The review did not quote this passage.
A classifier read this sentence of the paper as acknowledging the concern (probability 0.86):
“While calibrated observations from multiple viewpoints help reduce this ambiguity (Eq. (6)), they cannot always uniquely determine the underlying geometry, especially when informative contours are missing across views (Sec. A.7).”
Pith says: Objection 4 of 4 · major
The paper acknowledges the inherent ambiguity of binary masks (Section 5) and provides a controlled experiment (Section A.7) showing that SilHand struggles with nearly identical masks. However, this limitation is not quantified in the main results. The paper should discuss how often such ambiguous cases occur in real-world benchmarks and how they affect the reported improvements.
6 minor objections
The paper says, at §1
Pith says: minor objection 1 of 6
The abstract and introduction claim 'improves relative reconstruction accuracy from 49.2% to 63.4%' but this is the improvement ratio, not the absolute error reduction. Clarify that this is relative improvement.
The paper says, at §4.2, Table 1
Pith says: minor objection 2 of 6
The table includes 'Visual Hull' baseline but only reports PA-V and PA-J. It would be helpful to also report MPVPE and MPJPE for completeness, even if they are not directly comparable.
show 4 more
The paper says, at §A.2.1
Pith says: minor objection 3 of 6
The workspace estimation method (Eq. 17-19) is described in detail, but it would be helpful to mention the inlier tolerance value used in practice.
The paper says, at §A.3
Pith says: minor objection 4 of 6
The training details mention 'single NVIDIA RTX 5090' but this GPU is not yet released (as of 2026). Please verify the hardware specification.
The paper says, at §A.8
Pith says: minor objection 5 of 6
The mask corruption calibration uses SAM3 on synthetic RGB images. It would be more realistic to calibrate on real images, but the authors acknowledge this limitation. Consider adding a note about potential domain gap in calibration.
The paper says, at §A.9, Table 13
Pith says: minor objection 6 of 6
The view ablation shows that performance degrades significantly with fewer views (e.g., 2 views on ARCTIC-MV: 74.94 mm). This is an important limitation that should be discussed in the main text.
What would settle it
Run the full SilHand evaluation on all five datasets (DexYCB-MV, HO3D-MV, OakInk-MV, ARCTIC-MV, InterHand-MV) using SAM3-predicted masks as input instead of masks rendered from reference annotations. Report MPVPE, MPJPE, RR-V, PA-V, RR-J, PA-J for each dataset, and compare against the same RGB-based baselines (POEM, MLPHand, POEMv2, JUMP-Hand). If the improvement over baselines shrinks substantially (e.g., below 20% reduction in MPVPE), then the central claim is significantly weakened.
from the skeptic's reading
How the review went
4 readings by deepseek-v4-flash · 13 Nov 2026
- Reader holds up
- Skeptic partly agrees: says it holds up only with conditions Annotation-oriented evaluation uses masks rendered from reference hands, conflating mask quality with geometric accuracy; the claimed 49.2%–63.4% improvement may partly reflect overfitting to annotation geometry rather than genuine multi-view reconstruction from real masks.
- Editor wrote the verdict above
- Referee major revision: 4 major objections, 6 minor
Not run on this paper: the simulated authors' defence.
Pith did not check this review's objections against the paper.
The review in full
The review in brief, machine-written
Hey,
You should know about this paper. It's a good one. The core idea is clean: instead of trying to make synthetic RGB look real, just throw away texture and use binary masks. Train on synthetic geometry, evaluate on real masks. The architecture is well-designed—projecting 3D grid points into views, cross-view attention on mask and ray features, global-to-canonical decoding. The synthetic dataset is large and diverse (106k samples). The experiments are thorough: five benchmarks, ablations, robustness tests, scaling analysis. The method clearly works.
What's actually new: the specific combination of mask-centric representation with cross-view attention and synthetic-only training, plus the demonstration that this transfers to real data without fine-tuning. The paper does not claim to have invented mask-based reconstruction (it cites Lee et al. 2019, Chang et al. 2023). The novelty is in the architecture and the systematic evaluation showing that synthetic-only training on masks beats RGB-based methods that train on real data.
Now the soft spots. The headline claim—49.2% to 63.4% improvement—comes from the annotation-oriented evaluation (Table 1), where input masks are rendered from the ground-truth annotations themselves. This is an idealized setting: perfect masks perfectly aligned with the target geometry. The paper acknowledges this explicitly (Section 4.2: "annotation discrepancies... are not captured by SilHand") and provides complementary observation-oriented evaluation (Table 2) and PALM evaluation (Table 10) using real SAM3 masks. But those evaluations either report only held-out-view IoU (not 3D error) or only on one dataset. So we don't actually know the 3D reconstruction error (MPVPE/MPJPE) on real masks across all five datasets. The stress-test concern is real: the primary quantitative evidence for the central claim is based on a protocol that removes the main challenge the method is designed to solve. The paper is transparent about this, but it means the headline numbers should be taken with a grain of salt.
Other concerns are minor. The method assumes accurate camera calibration (acknowledged). The mask ambiguity limitation is real but fundamental to the approach (acknowledged). The self-citation pattern is noticeable but not abusive—the cited works are relevant and published.
Who this is for: anyone working on multi-view hand reconstruction, synthetic-to-real transfer, or mask-based 3D reconstruction. The paper is well-written, the method is clearly described, and the experiments are extensive. It deserves a serious peer review.
Recommendation: accept with minor revisions. The authors should be asked to report 3D reconstruction error on real masks (not just IoU) for at least one or two datasets, to give readers a sense of how the method performs under realistic input conditions. The current PALM evaluation is a step in this direction but only covers one dataset. If the authors can show that the 49–63% improvement holds (even partially) under real masks, the paper is very strong. If not, the paper is still good but the claims need to be calibrated.
Best,
[Your name]
The strongest objection
The paper's central quantitative claim (Table 1, Section 4.2) is that SilHand reduces MPVPE by 49.2% to 63.4% compared to RGB-based methods. However, this evaluation uses masks rendered from the reference hand annotations themselves (annotation-oriented evaluation, Section 4.2). This means the input masks are perfectly aligned with the ground-truth geometry, which is an unrealistic best-case scenario. The paper acknowledges that 'distinct 3D hand geometries may produce similar 2D masks' (Section 5) and that 'annotation discrepancies... are not captured by SilHand' (Section 4.2), but the headline numbers come from this idealised setting. The observation-oriented evaluation (Table 2) uses real SAM3 masks but only reports held-out-view IoU, not 3D reconstruction error. The PALM evaluation (Table 10) uses real masks and reports surface distance, but only on one dataset and without the dramatic improvement ratios. The load-bearing issue is that the primary evidence for the central claim is based on an evaluation protocol that removes the very challenge the method is designed to solve: real, imperfect masks. The paper does not report 3D reconstruction error (MPVPE/MPJPE) on real masks for all five datasets, so we cannot assess whether the 49.2%–63.4% improvement holds under realistic input conditions.
The reader's verdict is ACCEPT with high confidence, citing strong empirical evidence. However, the reader's weakest_assumption focuses on camera calibration and mask ambiguity, but does not flag the critical distinction between annotation-oriented and observation-oriented evaluation. The paper's own Table 1 (the main quantitative result) uses masks rendered from reference hands, which is acknowledged in Section 4.2 but presented as the primary evidence. The observation-oriented evaluation (Table 2) only reports held-out-view IoU, not 3D reconstruction error. The PALM evaluation (Table 10) does report surface distance on real masks, but only on one dataset and the improvement over POEMv2 is modest (3.109 vs 3.498 mm, about 11%). The paper's central claim of 49.2%–63.4% improvement is therefore not directly supported for real-world usage with imperfect masks. The paper does include robustness experiments (C1–C4 corruption) showing graceful degradation, but these are synthetic corruptions calibrated to SAM3 quality, not actual SAM3 masks. The concrete test would settle whether the headline improvement holds under realistic input conditions. I recommend CONDITIONAL: accept only if the authors provide 3D reconstruction metrics on real masks for all five datasets, or clearly state that the headline claim is limited to the annotation-oriented protocol.
The referee's report
If the results hold, this work could significantly reduce the need for expensive real-world data collection and annotation for hand reconstruction, enabling scalable geometric diversity. The approach is well-motivated and the experiments are extensive.
Pith's reading of the paper (a machine's summary, not the authors')
The paper introduces SilHand, a multi-view hand reconstruction system that uses only binary hand silhouettes as input, trained entirely on synthetic data. By discarding color and texture, SilHand avoids the costly photorealistic rendering that typically blocks synthetic-to-real transfer. Across five real-world benchmarks, it reduces reconstruction error by 49 to 63 percent compared to RGB-based methods, without any real-data fine-tuning. The system also scales with synthetic data volume: more diverse hand poses in training directly improve real-world accuracy. These results argue that binary masks, which are cheap to obtain, can serve as a practical interface between synthetic geometry and real observations.
What carries the argument. The central mechanism is a point-wise multi-view feature aggregation that projects points from a regular metric 3D grid into each calibrated camera view to query binary mask features and Plücker ray features, then fuses them via cross-view attention into a shared 3D representation. From this representation, the system estimates global hand pose by aligning predicted palm joints with a canonical MANO template, canonicalizes the evidence, and decodes articulation and shape using a token-query decoder. This design replaces RGB-based feature lifting with purely geometric cues, enabling direct transfer from synthetic masks to real observations.
Core claim. SilHand demonstrates that a multi-view hand reconstruction network trained exclusively on synthetic binary masks can outperform state-of-the-art RGB-based methods on real-world benchmarks, without any fine-tuning on real data. The key claim is that binary masks, by discarding appearance, eliminate the synthetic-to-real domain gap that has limited the use of synthetic data. The paper shows that a mask-centric architecture—projecting 3D grid points into each calibrated view to query and fuse mask and ray features—can extract sufficient geometric information to recover full hand pose, shape, and articulation. Across five datasets (HO3D, InterHand2.6M, DexYCB, OakInk, ARCTIC), SilHand reduces mean per-vertex position error (MPVPE) by 49.2% to 63.4% relative to the best RGB-based baseline. The method also remains robust to mask corruption, with error increasing by at most 1.63 mm under severe degradation.
The premise it rests on. The method assumes that accurate camera calibration is available, because the entire feature aggregation pipeline depends on projecting 3D grid points into calibrated views, and errors in calibration lead to misaligned cross-view evidence that degrades reconstruction accuracy.
If the paper is right (Pith's inferences, not the authors')
Multi-view hand reconstruction can be performed using only binary masks, which are far cheaper to acquire than RGB images with accurate 3D annotations.
Synthetic data becomes a scalable source of geometric supervision: as the training set grows from 1.7k to 106.8k samples, reconstruction error steadily decreases, showing that broader geometric coverage translates to better real-world performance.
The method's robustness to mask corruption (≤1.63 mm error increase under severe degradation) suggests it can work with imperfect segmentation from automatic tools like SAM3, reducing the need for manual annotation.
The mask-centric formulation avoids the need for photorealistic rendering, which has been a major bottleneck in using synthetic data for hand reconstruction.
The same mask-centric architecture could be extended to reconstruct other articulated objects (e.g., full body, animal poses) where obtaining diverse real 3D data is expensive, as long as calibrated multi-view masks are available.
The paper's controlled experiment on articulation disambiguation (Tab. 11) suggests a fundamental limit: when different hand configurations produce nearly identical masks across all views, the method cannot distinguish them. This implies that any purely silhouette-based system will have irreducible ambiguity for certain poses, especially under self-occlusion.
The observation that SilHand sometimes aligns better with image evidence than the dataset's own 3D annotations (Fig. 5) raises the possibility that existing real-world benchmarks may contain systematic annotation errors, which could affect the reported performance of all methods trained or evaluated on them.
Check this review
Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.
How often reviews like this one are right
Reviews like this one: written by deepseek-v4-flash, where what was read was not recorded.
How often objections from reviews like this one are right: not yet measured
Reviews by people
This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
Calibrated multi-view hand reconstruction has advanced rapidly, yet the effectiveness of existing methods depends strongly on real captured data, which is costly to acquire, limited in hand-geometry diversity, and often affected by imperfect annotations. Synthetic data offers a scalable alternative with accurate supervision, but a substantial synthetic-to-real appearance gap hinders its use. To address this, we introduce Hand in Silhouette (SilHand), a calibrated multi-view hand reconstruction framework that operates on binary hand masks, obtainable at low cost either automatically or manually, to reduce the synthetic-to-real observation gap. Rather than relying on RGB features for 3D lifting, SilHand projects metric 3D hypotheses into each view to query and fuse mask-ray evidence for hand reconstruction. This mask-centric formulation enables training on a large-scale synthetic dataset comprising 46.8k grasping poses and 60k free-hand samples, providing broad coverage of hand geometry while directly transferring to real captured hand geometry. Across five real-world benchmarks, SilHand improves relative reconstruction accuracy from 49.2% to 63.4% using masks rendered from reference hands. Moreover, reconstruction accuracy improves consistently as the synthetic training set grows, indicating that broader geometric coverage translates into better real-world performance. While achieving such diversity is difficult with real captured data, it becomes practical under our mask-centric formulation. Finally, SilHand remains robust under mask corruption, with reconstruction error increasing by at most 1.63 mm. Together, these results support binary masks as an effective interface for learning hand reconstruction from synthetic geometry.
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-11-13
The authors' main claim, as the classifier picked it out 1.00
“Together, these results support binary masks as an effective interface for learning hand reconstruction from synthetic geometry.”
How the main claim is stated: asserted 0.69
What the abstract itself states, as probabilities: claims first 0.05 · states limitation 0.40 · human participants 0.17 · controlled comparison 0.68 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.89 · mentions code or data availability 0.03
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| Calibrated multi-view hand reconstruction has advanced rapidly, yet the effectiveness of existing methods depends strongly on real captured data, which is costly to acquire, limited in hand-geometry diversity, and often affected by imperfect annotations. | background 0.94 | 0.05 | 0.02 | asserted 1.00 |
| Synthetic data offers a scalable alternative with accurate supervision, but a substantial synthetic-to-real appearance gap hinders its use. | background 0.53 | 0.06 | 0.03 | asserted 1.00 |
| To address this, we introduce Hand in Silhouette (SilHand), a calibrated multi-view hand reconstruction framework that operates on binary hand masks, obtainable at low cost either automatically or manually, to reduce the synthetic-to-real observation gap. | contribution 0.96 | 0.88 | 0.17 | asserted 0.99 |
| Rather than relying on RGB features for 3D lifting, SilHand projects metric 3D hypotheses into each view to query and fuse mask-ray evidence for hand reconstruction. | method 1.00 | 0.85 | 0.05 | asserted 1.00 |
| This mask-centric formulation enables training on a large-scale synthetic dataset comprising 46.8k grasping poses and 60k free-hand samples, providing broad coverage of hand geometry while directly transferring to real captured hand geometry. | method 0.91 | 0.92 | 0.13 | asserted 0.99 |
| Across five real-world benchmarks, SilHand improves relative reconstruction accuracy from 49.2% to 63.4% using masks rendered from reference hands. | result 1.00 | 0.95 | 0.22 | asserted 1.00 |
| Moreover, reconstruction accuracy improves consistently as the synthetic training set grows, indicating that broader geometric coverage translates into better real-world performance. | interpretation 0.55 | 0.93 | 0.11 | hedged possibility 0.59 |
| While achieving such diversity is difficult with real captured data, it becomes practical under our mask-centric formulation. | interpretation 0.86 | 0.45 | 0.06 | asserted 0.98 |
| Finally, SilHand remains robust under mask corruption, with reconstruction error increasing by at most 1.63 mm. | result 1.00 | 0.94 | 0.06 | asserted 1.00 |
| Together, these results support binary masks as an effective interface for learning hand reconstruction from synthetic geometry. | interpretation 1.00 | 0.68 | 0.89 | asserted 0.69 |
What kind of paper the classifier reports this is: method or tool 1.00 · evidence from observation or experiment 0.96
What was examined, and what was not
Sources read
- arXiv listing abstract v1
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-11-13: 1 request, 7,635 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Figures (14)
Figures are the authors', reproduced from the paper.
References (65)
- [1] Prithviraj Banerjee, Sindi Shkodrani, Pierre Moulon, Shreyas Hampali, Shangchen Han, Fan Zhang, Linguang Zhang, Jade Fountain, Edward Miller, Selen Basol, Richard Newcombe, and Robert Wang. HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos. In Proceedings... on Pith
- [2] Alexey Bokhovkin and Evgeny Burnaev. Boundary Loss for Remote Sensing Imagery Semantic Segmentation. In International Symposium on Neural Networks, pp.\ 388--401. Springer, 2019 on Pith
- [3] Berk Calli, Arjun Singh, Aaron Walsman, Siddhartha Srinivasa, Pieter Abbeel, and Aaron M Dollar. The YCB object and Model set: Towards common benchmarks for manipulation research. In International Conference on Advanced Robotics (ICAR), pp.\ 510--517. IEEE, 2015 on Pith
- [4] Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Didac Suris Coll-Vinent, Chaitanya Ryali, Kalyan Vasudev Alwala, Haitham Khedr, Andrew Huang, Jie Lei, Tengyu Ma, Baishan Guo, Arpit Kalla, Markus Marks, Joseph Greer, Meng Wang, Peize Sun, Roman R\"... on Pith
- [5] Li-Jen Chang, Yu-Cheng Liao, Chia-Hui Lin, Shih-Fang Yang-Mao, and Hwann-Tzong Chen. Mask2hand: Learning to predict the 3d hand pose and shape from shadow. In Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp.\ 591--598. I... on Pith
- [6] Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, and Dieter Fox. DexYCB: A Benchmark for Capturing Hand Grasping of Objects. In Proceedings of the IEEE/CVF Conference on C... on Pith
- [7] Jiayi Chen, Yubin Ke, Lin Peng, and He Wang. Dexonomy: Synthesizing All Dexterous Grasp Types in a Grasp Taxonomy. In Proceedings of Robotics: Science and Systems (RSS) , 2025 on Pith
- [8] Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, and Xiaohui Xie. MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 836--845. IEEE, 2021 on Pith
- [9] Leiyao Cui, Zihang Zhao, Sirui Xie, Wenhuan Zhang, Zhi Han, and Yixin Zhu. Vi- T ac M an: Articulated Object Manipulation via Vision and Touch. In IEEE International Conference on Robotics and Automation (ICRA) , pp.\ 13756--13763. IEEE, 2026 on Pith
- [10] Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 248--255. IEEE, 2009 on Pith
- [11] Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael J Black, and Otmar Hilliges. ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , ... on Pith
- [12] Zicong Fan, Edoardo Remelli, David Dimond, Fadime Sener, Liuhao Ge, Bugra Tekin, Cem Keskin, and Shreyas Hampali. PALM: A Dataset and Baseline for Learning Multi-Subject Hand Prior. In International Conference on 3D Vision (3DV) , pp.\ 693--703. IEEE, 2026 on Pith
- [13] Thomas Feix, Javier Romero, Heinz-Bodo Schmiedmayer, Aaron M Dollar, and Danica Kragic. The GRASP Taxonomy of Human Grasp Types. IEEE Transactions on Human-Machine Systems, 46 0 (1): 0 66--77, 2015 on Pith
- [14] Aaron Ferguson, Ahmed A. A. Osman, Berta Bescos, Carsten Stoll, Chris Twigg, Christoph Lassner, David Otte, Eric Vignola, Fabian Prada, Federica Bogo, Igor Santesteban, Javier Romero, Jenna Zarate, Jeongseok Lee, Jinhyung Park, Jinlong Yang, John Doublestein, Kishore Venkatesh... on PitharXiv
- [15] Rao Fu, Dingxi Zhang, Alex Jiang, Wanjia Fu, Austin Funk, Daniel Ritchie, and Srinath Sridhar. GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 17461--17474. I... on Pith
- [16] Daiheng Gao, Yuliang Xiu, Kailin Li, Lixin Yang, Feng Wang, Peng Zhang, Bang Zhang, Cewu Lu, and Ping Tan. Dart: Articulated hand model with diverse accessories and rich textures. Advances in Neural Information Processing Systems (NeurIPS) , 35: 0 37055--37067, 2022 on Pith
- [17] Shreyas Hampali, Mahdi Rad, Markus Oberweger, and Vincent Lepetit. HOnnotate: A Method for 3D Annotation of Hand and Object Poses. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 3193--3203. IEEE, 2020 on Pith
- [18] Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D Twigg, and Kenrick Kin. Online optical marker-based hand tracking with deep labels. ACM Transactions on Graphics (TOG) , 37 0 (4): 0 1--10, 2018 on Pith
- [19] Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D. Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, Asaf Nitzan, Gang Dong, Yuting Ye, Lingling Tao, Chengde Wan, and Robert Wang. MEgATrack: monochrome egocentric articulated hand-tr... on Pith
- [20] Shangchen Han, Po-Chen Wu, Yubo Zhang, Beibei Liu, Linguang Zhang, Zheng Wang, Weiguang Si, Peizhao Zhang, Yujun Cai, Tomas Hodan, Randi Cabezas, Luan Tran, Muzaffer Akbay, Tsz-Ho Yu, Cem Keskin, and Robert Wang. UmeTrack: Unified multi-view end-to-end hand tracking for VR. In... on Pith
show 45 more
- [21] Yana Hasson, Gul Varol, Dimitrios Tzionas, Igor Kalevatykh, Michael J Black, Ivan Laptev, and Cordelia Schmid. Learning joint reconstruction of hands and manipulated objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 118... on Pith
- [22] Kaiming He, Georgia Gkioxari, Piotr Doll \'a r, and Ross Girshick. Mask R-CNN. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 2961--2969. IEEE, 2017 on Pith
- [23] Haohong Kuang, Yang Xiao, Changlong Jiang, Jinghong Zheng, Hang Xu, Ran Wang, Zhiguo Cao, and Joey Tianyi Zhou. JUMP-Hand: Learning Joint-wise Uncertainty to Gate Mixture of View Experts for Multi-View 3D Hand Reconstruction. In Proceedings of the IEEE/CVF Conference on Comput... on Pith
- [24] Dominik Kulon, Riza Alp Guler, Iasonas Kokkinos, Michael M Bronstein, and Stefanos Zafeiriou. Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 4990--5000. IEEE, 2020 on Pith
- [25] Aldo Laurentini. The visual hull concept for silhouette-based image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 16 0 (2): 0 150--162, 1994 on Pith
- [26] Kuo-Wei Lee, Shih-Hung Liu, Hwann-Tzong Chen, and Koichi Ito. Silhouette-Net: 3D Hand Pose Estimation from Silhouettes. arXiv preprint arXiv:1912.12436, 2019 on PithPith's reviewarXiv
- [27] Lijun Li, Linrui Tian, Xindi Zhang, Qi Wang, Bang Zhang, Liefeng Bo, Mengyuan Liu, and Chen Chen. RenderIH: A Large-Scale Synthetic Dataset for 3D Interacting Hand Pose Estimation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 20395--... on Pith
- [28] Yuwei Li, Longwen Zhang, Zesong Qiu, Yingwenqi Jiang, Nianyi Li, Yuexin Ma, Yuyao Zhang, Lan Xu, and Jingyi Yu. NIMBLE: a non-rigid hand model with bones and muscles. ACM Transactions on Graphics (TOG) , 41 0 (4): 0 1--16, 2022 on Pith
- [29] Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll \'a r, and C Lawrence Zitnick. Microsoft COCO: Common Objects in Context. In European Conference on Computer Vision (ECCV) , pp.\ 740--755. Springer, 2014 on Pith
- [30] Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. A ConvNet for the 2020s. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 11976--11986. IEEE, 2022 on Pith
- [31] Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. SMPL: A skinned multi-person linear model. ACM Transactions on Graphics (TOG) , 34 0 (6): 0 851--866, 2023 on Pith
- [32] Haoyang Luo, Zihang Zhao, Leiyao Cui, Saiyao Zhang, Liu Yang, Zhi Han, Xiyuan Tang, and Yixin Zhu. T-800: An 800 Hz Data Glove for Precise Hand Gesture Tracking. SmartBot, 2 0 (3): 0 e70045, 2026 on Pith
- [33] Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, and Kyoung Mu Lee. InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image. In European Conference on Computer Vision (ECCV) , pp.\ 548--564. Springer, 2020 on Pith
- [34] Gyeongsik Moon, Shunsuke Saito, Weipeng Xu, Rohan Joshi, Julia Buffalini, Harley Bellan, Nicholas Rosen, Jesse Richardson, Mallorie Mize, Philippe De Bree, Tomas Simon, Bo Peng, Shubham Garg, Kevyn McPhail, and Takaaki Shiratori. A Dataset of Relighted 3D Interacting Hands. In... on Pith
- [35] Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, and Christian Theobalt. GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognitio... on Pith
- [36] Karthik S Narayan, James Sha, Arjun Singh, and Pieter Abbeel. Range sensor and silhouette fusion for high-quality 3D Scanning. In IEEE International Conference on Robotics and Automation (ICRA) , pp.\ 3617--3624. IEEE, 2015 on Pith
- [37] Julius Pl \"u cker. Analytisch-geometrische Entwicklungen. GD Baedeker, 1828 on Pith
- [38] Patrick Rim, Kevin Harris, Braden Copple, Shangchen Han, Xu Xie, Ivan Shugurov, Sizhe An, He Wen, Alex Wong, Tomas Hodan, and Kun He. SHOW3D: Capturing Scenes of 3D Hands and Objects in the Wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognit... on Pith
- [39] Javier Romero, Dimitrios Tzionas, and Michael J Black. Embodied hands: modeling and capturing hands and bodies together. ACM Transactions on Graphics (TOG) , 36 0 (6): 0 1--17, 2017 on Pith
- [40] Hanno Scharr, Christoph Briese, Patrick Embgenbroich, Andreas Fischbach, Fabio Fiorani, and Mark M \"u ller-Linow. Fast High Resolution Volume Carving for 3D Plant Shoot Reconstruction. Frontiers in Plant Science, 8: 0 1680, 2017 on Pith
- [41] Chen Si, Yulin Liu, Bo Ai, Jianwen Xie, Rolandos Alexandros Potamias, Chuanxia Zheng, and Hao Su. AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation. arXiv preprint arXiv:2603.25726, 2026 on PithPith's reviewarXiv
- [42] Tze Ho Elden Tse, Franziska Mueller, Zhengyang Shen, Danhang Tang, Thabo Beeler, Mingsong Dou, Yinda Zhang, Sasa Petrovic, Hyung Jin Chang, Jonathan Taylor, and Bardia Doosti. Spectral Graphormer: Spectral Graph-Based Transformer for Egocentric Two-Hand Reconstruction using Mu... on Pith
- [43] Etsuko Ueda, Yoshio Matsumoto, Masakazu Imai, and Tsukasa Ogasawara. Hand pose estimation using multi-viewpoint silhouette images. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , volume 4, pp.\ 1989--1996. IEEE, 2001 on Pith
- [44] Shinji Umeyama. Least-squares estimation of transformation parameters between two point patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 13 0 (4): 0 376--380, 1991 on Pith
- [45] Congyi Wang, Feida Zhu, and Shilei Wen. MeMaHand: Exploiting Mesh-Mano Interaction for Single Image Two-Hand Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 564--573. IEEE, 2023 on Pith
- [46] Jikai Wang, Qifan Zhang, Yu-Wei Chao, Bowen Wen, Xiaohu Guo, and Yu Xiang. HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. In Advances in Neural Information Processing Systems (NeurIPS) , volume 38. Curran Associates, In... on Pith
- [47] Ti Wang, Xiaohang Yu, and Mackenzie Weygandt Mathis. FMPose3D: monocular 3D pose estimation via flow matching. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 14669--14679. IEEE, 2026 on Pith
- [48] Zhi-Min Wang, Mao-Hang Rao, Shang-Hua Ye, Wei-Tao Song, and Feng Lu. Towards spatial computing: recent advances in multimodal natural interaction for Extended Reality headsets. Frontiers of Computer Science, 19 0 (12): 0 1912708, 2025 b on Pith
- [49] Tom Wehrbein, Marco Rudolph, Bodo Rosenhahn, and Bastian Wandt. Probabilistic monocular 3d human pose estimation with normalizing flows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 11179--11188. IEEE, 2021 on Pith
- [50] Sanghyun Woo, Shoubhik Debnath, Ronghang Hu, Xinlei Chen, Zhuang Liu, In So Kweon, and Saining Xie. ConvNeXt V2: Co-Designing and Scaling ConvNets With Masked Autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 16133... on Pith
- [51] Jian Yang, Jiakun Li, Guoming Li, Huai-Yu Wu, Zhen Shen, and Zhaoxin Fan. MLPHand: Real Time Multi-view 3D Hand Reconstruction via MLP Modeling. In European Conference on Computer Vision (ECCV) , pp.\ 407--424. Springer, 2024 on Pith
- [52] Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Jiefeng Li, and Cewu Lu. CPF: Learning a Contact Potential Field To Model the Hand-Object Interaction. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 11097--11106. IEEE, 2021 on Pith
- [53] Lixin Yang, Kailin Li, Xinyu Zhan, Fei Wu, Anran Xu, Liu Liu, and Cewu Lu. OakInk: A Large-Scale Knowledge Repository for Understanding Hand-Object Interaction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 20953--20962. IEEE, 2022 on Pith
- [54] Lixin Yang, Jian Xu, Licheng Zhong, Xinyu Zhan, Zhicheng Wang, Kejian Wu, and Cewu Lu. POEM: Reconstructing Hand in a Point Embedded Multi-View Stereo. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 21108--21117. IEEE, 2023 on Pith
- [55] Lixin Yang, Licheng Zhong, Pengxiang Zhu, Xinyu Zhan, Junxiao Kong, Jian Xu, and Cewu Lu. Multi-view Hand Reconstruction with a Point-Embedded Transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 47 0 (11): 0 10680--10695, 2025 on Pith
- [56] Ziwei Yu, Chen Li, Linlin Yang, Xiaoxu Zheng, Michael Bi Mi, Gim Hee Lee, and Angela Yao. Overcoming the Trade-off Between Accuracy and Plausibility in 3D Hand Shape Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , p... on Pith
- [57] Jason Zhang, Amy Lin, Moneish Kumar, Tzu-Hsuan Yang, Deva Ramanan, and Shubham Tulsiani. Cameras as Rays: Pose Estimation via Ray Diffusion. In International Conference on Learning Representations (ICLR) , volume 2024, pp.\ 23345--23366, 2024 on Pith
- [58] Jinglei Zhang, Jiankang Deng, Chao Ma, and Rolandos Alexandros Potamias. HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 1805--1815. IEEE, 2025 on Pith
- [59] Zhuoran Zhao, Linlin Yang, Pengzhan Sun, Pan Hui, and Angela Yao. Analyzing the Synthetic-to-Real Domain Gap in 3D Hand Pose Estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp.\ 12255--12265. IEEE, 2025 a on Pith
- [60] Zihang Zhao, Wanlin Li, Yuyang Li, Tengyu Liu, Boren Li, Meng Wang, Kai Du, Hangxin Liu, Yixin Zhu, Qining Wang, Kaspar Althoefer, and Song-Chun Zhu. Embedding high-resolution touch across robotic hands enables adaptive human-like grasping. Nature Machine Intelligence, 7 0 (6)... on Pith
- [61] Zihang Zhao, Yuyang Li, Wanlin Li, Zhenghao Qi, Lecheng Ruan, Yixin Zhu, and Kaspar Althoefer. Tac-Man: Tactile-informed prior-free manipulation of articulated objects. IEEE Transactions on Robotics, 41: 0 538--557, 2025 c on Pith
- [62] Zihang Zhao, Zhenghao Qi, Yuyang Li, Leiyao Cui, Zhi Han, Lecheng Ruan, and Yixin Zhu. TacMan-Turbo : Proactive Tactile Control for Robust and Efficient Articulated Object Manipulation. IEEE Transactions on Automation Science and Engineering (T-ASE) , 23: 0 8296--8317, 2026 on Pith
- [63] Xiaozheng Zheng, Chao Wen, Zhou Xue, Pengfei Ren, and Jingyu Wang. HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 20763--20773. IEEE, 2023 on Pith
- [64] Christian Zimmermann and Thomas Brox. Learning to Estimate 3D Hand Pose from Single RGB Images. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 4913--4921. IEEE, 2017 on Pith
- [65] Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, and Thomas Brox. FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp.\ 813--82... on Pith
Challenges and discussion
Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment