Pith. sign in

REVIEW 3 major objections 4 minor 56 references

MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices

T0 review · 3 major / 4 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A phone, watch, or earbuds alone can drive real-time full-body pose and walking-path tracking, with no cameras or mocap suit.

desk verdict A genuinely new capability—full-body pose plus global translation from 1-3 commodity IMUs—with solid pose gains over IMUPoser, but the translation evaluation protocol is internally inconsistent and the headline translation numbers are not reproducible from the paper alone. read the letter →

arxiv 2504.12492 v1 pith:AT3JWJ55 submitted 2025-04-16 cs.HC cs.CV

Vasco Xu , Chenfeng Gao , Henry Hoffmann , Karan Ahuja This is my paper · ORCID
classification cs.HCcs.CV
keywords full-bodyposeestimationinertialmeasurementunitsglobaltranslationconsumerdevicessparsesensingdeepneuralnetworkphysics-basedoptimizationreal-time
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that the inertial sensors already inside consumer devices — a phone, a smartwatch, or earbuds — carry enough information to reconstruct a person's full-body pose and their movement through space in real time, using as few as one device and no more than three. The proposed system, MobilePoser, estimates joint positions and then joint rotations from sparse, partially absent IMU streams with a multi-stage neural network, then passes the result through a physics-based optimizer that removes jitter, foot sliding, and floor penetration. Global translation is obtained by fusing a foot-ground-contact velocity estimator with a direct neural regressor of root velocity, a combination that handles both walking and aerial phases like running or jumping. Across the DIP-IMU, TotalCapture, and IMUPoser benchmarks, the paper reports pose errors 8.7–24.1% lower than the closest consumer-device baseline (IMUPoser) and a mean root translation error of 17.63 cm on consumer-device data, at 60 frames per second on an iPhone 15 Pro. If the claims hold, motion capture becomes an infrastructure-free capability of devices people already own, relevant to fitness, gaming, and indoor navigation.

What carries the argument

The central mechanism is a zero-masked input representation over five fixed body locations — right and left pockets, right and left wrists, head — combined with a two-stage pose network and a fused translation estimator. The input vector $\boldsymbol{x} \in \mathbb{R}^{60}$ (acceleration and orientation for each of five locations) has zeros substituted for absent devices, so a single unified model handles any 1–3 device subset without retraining per combination. Pose estimation proceeds from joint positions (chosen because positions correlate linearly with acceleration) to joint rotations (regressed from positions plus IMU data), with a jerk loss enforcing temporal smoothness. Translation estimation is the load-bearing fusion: the foot-ground-contact submodule tracks the supporting foot's displacement, which is reliable during stance but fails in flight phases, so a direct LSTM regressor of root velocity covers the gaps, and a confidence-weighted sum of the two produces the final global velocity. A physics-based optimizer from prior work [48] is the final stage, refining both pose and translation to satisfy the equation of motion and reduce jitter and foot-floor penetration.

What would settle it

Run MobilePoser's trained model with a phone carried in a left chest pocket, a backpack strap, or an ankle holster — locations outside the five predefined sites — while a reference optical mocap system records ground truth. If per-joint vertex error or root translation error degrades substantially compared to the same user wearing the phone in a supported location, or if the model fails to track at all, the claim that 'any available subset of IMUs already present in these consumer devices' suffices is falsified; the paper's own stated drift sensitivity when devices deviate from calibrated positions makes this the direct check.

Watch

Extended reading notes

Core claim

On the paper's own terms, the discovery is that low-fidelity, heterogeneous, and extremely sparse IMUs — one to three streams coming from phones, watches, or earbuds — are enough for real-time full-body pose and global translation estimation, a problem previously requiring six or more specialized sensors. The system's design is multi-stage: a bi-LSTM predicts 3D joint positions (an intermediate representation with linear correlation to acceleration), a second bi-LSTM regresses 18 joint rotations from those positions plus raw IMU data, and a translation module fuses foot-ground-contact-derived root velocity with a direct LSTM root-velocity regressor using a confidence-weighted sum. A physics-aware optimizer from prior work [48] then enforces physical plausibility, reducing jitter and ground penetration. The reported results — lower vertex error than IMUPoser across all device counts on the IMUPoser dataset, and translation errors comparable to some six-IMU systems at a fraction of the instrumentation — support the paper's positioning of MobilePoser as a practical, on-device digitization technique. The system also demonstrates that higher-order digitization (full-body pose) can be used to improve lower-order digitization (steps and translation), a key architectural insight of the ablation study.

Load-bearing premise

The system assumes that a user's devices are always worn or carried at one of exactly five fixed body locations — right and left pockets, right and left wrists, and head — and that a T-pose calibration plus zero-masking of absent devices fully captures how consumers carry them; if a device rides somewhere else, such as a chest pocket, backpack, or belt clip, or shifts within clothing after calibration, the input representation and calibration are no longer valid.

Editorial extensions

If this is right

  • Fitness and wellness apps can offer real-time exercise-form feedback, rep counting, and calorie estimates using only a phone in a pocket or a watch on a wrist, with no camera or lab setup.
  • Indoor navigation and localization can be driven by the same IMU streams, giving walking path and direction without GPS or fixed beacons.
  • Immersive mobile gaming and VR/AR avatars can be controlled by full-body motion from devices the player already wears, removing external sensors and specialized controllers.
  • Because the pose network is trained on large synthetic motion-capture data and fine-tunes to different IMU noise profiles, the method can adapt to new device placements and activities without collecting new paired sensor data.
  • The 60 fps on-device performance means the whole pipeline can be embedded in consumer apps, enabling passive, continuous user digitization in everyday settings.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: The first real-world failure mode is probably the five-location assumption: if a phone rides in a chest pocket, backpack, or belt clip, or shifts inside loose clothing after calibration, the zero-masked representation silently encodes the wrong body site, and the paper's acknowledged drift sensitivity implies the model will hallucinate poses rather than signal the error.
  • Editorial inference: The physics optimizer's residual could be recycled as an online self-diagnostic: an increasing penalty over time would indicate that the device configuration no longer matches the calibration, enabling automatic re-calibration without user intervention.
  • Editorial inference: Since the paper's evaluations are all on lab-collected datasets, the natural next test is an in-the-wild benchmark with a portable optical ground-truth system; the current evidence does not establish how the method behaves under the full range of real-world device malpositioning.
  • Editorial inference: The 'higher-order digitization helps lower-order digitization' insight could extend to other downstream tasks like fall detection or gait analysis, where a pose prior might regularize noisy raw IMU features in the same way it improves translation.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. MobilePoser proposes a real-time system for full-body pose estimation and global 3D translation tracking using IMUs already present in consumer devices (smartphones, smartwatches, earbuds), with as few as one and up to three devices. The pipeline first estimates joint positions and rotations from masked IMU inputs using bi-LSTMs, then estimates root translation by fusing a foot-contact-based velocity estimate with a neural-network regressed root velocity, and finally applies a physics-based optimizer for temporal and physical plausibility. Evaluation is performed on DIP-IMU, TotalCapture, and IMUPoser datasets, with comparisons to IMUPoser and to 6-IMU systems such as TransPose and PIP. The manuscript also reports real-time on-device performance on an iPhone 15 Pro and describes proof-of-concept applications in indoor navigation, gaming, and fitness.

Significance. If the results hold, MobilePoser would be a meaningful advance for ubiquitous motion capture: it is, to my knowledge, the first system to demonstrate both full-body pose and global translation from 1-3 commodity IMUs, and it reports consistent pose-estimation improvements over IMUPoser on shared benchmarks, with a useful ablation showing that pose-aware translation regression reduces translation error. The real-time on-device implementation and the open-source release are also concrete strengths. However, the central novelty—global translation—is currently not verifiable from the manuscript because the evaluation protocol described in Section 5.3.1 is internally inconsistent with the dataset description in Section 5.1 and Table 2. The pose contribution is on firmer ground, but the paper's headline claim depends on the translation evaluation being corrected.

major comments (3)
  1. [Section 5.3.1, Section 5.1, Table 2] The translation evaluation protocol is not executable as written. Section 5.3.1 states that 'we train on AMASS and fine-tune on 8 participants of DIP-IMU to track the Root Translation Error,' but Section 5.1 explicitly states that DIP-IMU 'does not contain global translation data' and Table 2 marks DIP-IMU as lacking translation data. Since the translation submodules v_e and v_f are supervised with root velocities and foot-contact labels derived from translation data (Section 4.2), the described protocol cannot be carried out. Please specify exactly which submodules are fine-tuned on DIP-IMU and which labels are used. If the pose modules are fine-tuned on DIP-IMU while the translation modules remain trained on AMASS only, then the numbers 27.55 cm (TotalCapture) and 17.63 cm (IMUPoser) should be reported under a protocol that is clearly distinguished from the pose fine-tuning protocol, and the comparability to TransPose's fine-tuned translation results should be discussed. As written, the reported translation errors are not reproducible from the manuscript alone.
  2. [Equation (6)] Equation (6) as typeset is not a valid weighted average: the two fractions are identical, reading v = (q - q)/(q - q) * v_e + (q - q)/(q - q) * v_f. This would trivially reduce to v_e + v_f, not to a weighted blend. The surrounding text mentions an upper threshold and a lower threshold, and later gives q = 0.5 and q = 0.9, but the symbols in the equation are indistinguishable. Please introduce distinct notation, e.g., q_l and q_u, and typeset the formula correctly. Since this equation defines the core fusion mechanism for translation estimation, the intended form must be unambiguous.
  3. [Section 3.1, Section 1, Section 8] The claimed generality of the system is broader than what the method actually supports. The abstract and Section 1 claim estimation of pose and translation from 'any available subset of IMUs already present in these consumer devices' and 'various on-body configurations,' but Section 3.1 fixes the input to five predefined body locations (right/left pockets, right/left wrists, head) and restricts to 24 specific device-location combinations. Devices carried in unmodeled locations, such as a chest pocket, backpack, or belt clip, are outside the representation. Section 8 acknowledges drift when devices shift within clothing, but it does not acknowledge this representational restriction. Please temper the abstract and Section 1 claims, or explicitly state the supported set of locations and combinations in the contributions.
minor comments (4)
  1. [Section 8] The text reads 'akin to prior wor' and should read 'akin to prior work.'
  2. [Figure 8 caption] The caption contains a duplicated article: 'shows the the cumulative distance error' should be 'shows the cumulative distance error.'
  3. [Section 5.3.2] The sentence 'This can be attributed to the legs capturing most of the locomotion data during translation' is slightly awkward; consider 'the legs capture most of the locomotion information.'
  4. [Section 3.5] Please clarify the deployment setup: the text first says the iPhone streams data to a MacBook Air 2022 via socket for inference, then later says a CoreML model is evaluated on an iPhone 15 Pro. It should be explicit whether the reported 60 fps real-time performance refers to the iPhone 15 Pro deployment only, and what role the laptop streaming prototype plays in the evaluation.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: MobilePoser's accuracy claims are established by external benchmark comparisons rather than by construction.

full rationale

MobilePoser's central claims are empirical: full-body pose and global translation accuracy are evaluated on the DIP-IMU, TotalCapture, and IMUPoser datasets. The pose pipeline is trained from synthesized AMASS IMU data with standard L2, forward-kinematics, and jerk losses, and the reported improvements over IMUPoser (12.4% and 18.2% lower MPJVE on DIP-IMU and TotalCapture, and 24.1%/14.2%/8.7% lower error for 1/2/3 devices on IMUPoser) come from holdout participants, so no predicted quantity is identical by construction to a fitted input. The components inherited by citation are not load-bearing in the circularity sense: the 24 device-location combinations and active-device selection follow IMUPoser, and the fusion thresholds q=0.5/q=0.9 and foot-contact threshold u=0.008 follow TransPose, but these are input-space definitions and hyperparameters, not outputs whose evaluation is forced by the fit. I do not count the Section 5.3.1 statement that the translation module is fine-tuned on 8 DIP-IMU participants as circularity, because Section 5.1 states DIP-IMU has no translation data; this is an internal reproducibility and consistency flaw in the translation evaluation protocol, not a reduction of the translation predictions to their training labels. The translation errors (27.55 cm on TotalCapture, 17.63 cm on IMUPoser) are benchmark numbers that could be falsified by reimplementation, and the open-source release is claimed. No equation in the paper defines a target quantity in terms of itself, and no uniqueness claim is imported from the authors' prior work to force the architecture choice.

Assumptions & free parameters 7 free parameters · 6 assumptions · 0 invented entities

The central claim rests on several hand-set hyperparameters and domain assumptions about sensor placement, calibration, and synthetic training data. The paper is transparent about some of these, such as fine-tuning protocols and the calibration requirement, but less so about others, including the window length N, physics optimizer gains, and the garbled fusion formula.

free parameters (7)
  • Gaussian noise sigma for joint positions during training = 0.04
    Chosen to prevent overfitting when training F_theta, v_e, and v_f (Section 4.3); ad hoc data augmentation strength.
  • Rotation loss jerk weight lambda = 1e-5
    Empirically set when training F_theta (Section 4.3) to encourage temporal smoothness; affects pose quality.
  • Acceleration scaling factor = 30 m/s^2
    Synthetic accelerations are divided by 30 to bring values to the orientation scale (Section 4.1); a preprocessing choice that changes the effective input distribution.
  • Foot-ground contact threshold u = 0.008
    Movement below this threshold labels a foot as contacting the ground when generating training labels from AMASS (Section 4.2); inherited from TransPose.
  • Translation fusion thresholds = q_low = 0.5, q_high = 0.9
    Weights for blending foot-contact and neural velocities in Equation (6) (Section 3.3.3); taken from prior work, but the equation is garbled in the preprint.
  • Sliding-window length N
    Window length for the bi-LSTM inputs is never specified in the paper; it is a free architectural choice that affects latency and accuracy.
  • PD controller gains in physics optimizer
    The physics optimizer is taken from PIP, and its internal gains are not reported, so the refinement strength is an uncontrolled inherited parameter.
assumptions (6)
  • domain assumption Synthetic IMU measurements generated from AMASS via DIP's method are a valid proxy for real consumer-device IMU signals.
    Used to train the base model (Section 4.1); if the simulation does not capture consumer IMU noise, placement, and body dynamics, the learned mappings transfer poorly. The paper's own fine-tuning results show real data still helps.
  • domain assumption Device-to-body orientation can be aligned by a T-pose calibration and remains fixed during use.
    Sections 3.5 and 8 rely on a calibration step to align IMU measurements with the SMPL body model; loose clothing or device movement breaks this, and the paper acknowledges resulting drift.
  • domain assumption The 24 combinations across five fixed body locations cover the ways users carry devices.
    Section 3.1 defines inputs only for right and left pockets, right and left wrists, and head; any other carrying location is outside the input representation.
  • domain assumption Foot-ground contact probability trained from a displacement threshold is a reliable signal for translation estimation.
    The supporting-foot velocity in Section 3.3.1 assumes the foot with higher contact probability is roughly stationary; this fails during airborne phases, which the fusion with v_e is designed to handle.
  • domain assumption A human motion prior learned from AMASS is general enough for the evaluated activities.
    The neural networks are trained on roughly 40 hours of AMASS mocap; activities outside that distribution, such as push-ups, show higher error (16.1 cm in Section 5.2.4).
  • standard math The SMPL model and forward kinematics correctly map joint rotations to body mesh vertices.
    The pose losses L_pos and the body mesh output in Section 3.2.2 rely on SMPL and FK as accurate body representations; these are established tools from prior literature.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices." pith.science (2026). https://pith.science/paper/AT3JWJ55

@misc{pith2026250412492,
  author       = {Pith},
  title        = {Pith review of: MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/AT3JWJ55}},
  note         = {Machine review of arXiv:2504.12492}
}
read the original abstract

There has been a continued trend towards minimizing instrumentation for full-body motion capture, going from specialized rooms and equipment, to arrays of worn sensors and recently sparse inertial pose capture methods. However, as these techniques migrate towards lower-fidelity IMUs on ubiquitous commodity devices, like phones, watches, and earbuds, challenges arise including compromised online performance, temporal consistency, and loss of global translation due to sensor noise and drift. Addressing these challenges, we introduce MobilePoser, a real-time system for full-body pose and global translation estimation using any available subset of IMUs already present in these consumer devices. MobilePoser employs a multi-stage deep neural network for kinematic pose estimation followed by a physics-based motion optimizer, achieving state-of-the-art accuracy while remaining lightweight. We conclude with a series of demonstrative applications to illustrate the unique potential of MobilePoser across a variety of fields, such as health and wellness, gaming, and indoor navigation to name a few.

Figures

Figures reproduced from arXiv: 2504.12492 by the authors.

Figure 1
Figure 1. MobilePoser uses any subset of consumer mobile devices (phones, watches, earbuds) available to estimate full-body [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Real-time global pose estimation powered by MobilePoser: (A) Person with smartwatch (left wrist) waving their hands. [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. MobilePoser system overview. MobilePoser accepts any available subset of IMU data from the user and masks absent [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: Demonstration of the physics optimizer’s ability to [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Comparison of MobilePoser’s Full-Body Pose Es [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Qualitative comparisons between our method and [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: MPJVE comparison between IMUPoser and MobilePoser (our system) on the IMUPoser Dataset for: (A) Different [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]
Figure 8
Figure 8. Figure 8: (A) Comparison of cumulative translation error for [PITH_FULL_IMAGE:figures/full_fig_p008_8.png]
Figure 10
Figure 10. Figure 10: Example indoor navigation application where Mo [PITH_FULL_IMAGE:figures/full_fig_p009_10.png]
Figure 12
Figure 12. Figure 12: MobilePoser’s full-body pose and locomotion can [PITH_FULL_IMAGE:figures/full_fig_p010_12.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

56 extracted references · 43 canonical work pages

  1. [1]

    [n. d.]. PlayStation VR. https://www.playstation.com/en-us/explore/playstation- vr/

    work page

  2. [2]

    HTC Vive

    2023. HTC Vive. https://www.vive.com

    work page 2023

  3. [3]

    Karan Ahuja. 2024. Practical and Rich User Digitization. arXiv:2403.00153 [cs.HC] https://arxiv.org/abs/2403.00153

    arXiv 2024

  4. [4]

    Karan Ahuja, Sven Mayer, Mayank Goel, and Chris Harrison. 2021. Pose-on- the-go: Approximating user pose with smartphone sensor fusion and inverse kinematics. In Proceedings of the 2021 CHI Conference on Human Factors in Com- puting Systems. 1–12

    2021

  5. [5]

    Karan Ahuja, Vivian Shen, Cathy Mengying Fang, Nathan Riopelle, Andy Kong, and Chris Harrison. 2022. Controllerpose: inside-out body capture with VR controller cameras. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13

    work page 2022

  6. [6]

    Riku Arakawa, Karan Ahuja, Kristie Mak, Gwendolyn Thompson, Sam Shaaban, Oliver Lindhiem, and Mayank Goel. 2023. LemurDx: Using Unconstrained Pas- sive Sensing for an Objective Measurement of Hyperactivity in Children with no Parent Input. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 2 (2023), 1–23

    work page 2023

  7. [7]

    Riku Arakawa, Bing Zhou, Gurunandan Krishnan, Mayank Goel, and Shree K Nayar. 2023. MI-Poser: Human Body Pose Tracking Using Magnetic and Inertial Sensor Fusion with Metal Interference Mitigation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1–24. MobilePoser: Real-Time Full-Body Pose Estimation and 3D H...

    work page 2023

  8. [8]

    Rayan Armani, Changlin Qian, Jiaxi Jiang, and Christian Holz. 2024. Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging. In ACM SIGGRAPH 2024 Conference Papers . 1–11

    work page 2024

Show all 56 references
  1. [9]

    Federica Bogo, Angjoo Kanazawa, Christoph Lassner, Peter Gehler, Javier Romero, and Michael J Black. 2016. Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, Oct...

    2016

  2. [10]

    Nathan Devrio and Chris Harrison. 2022. DiscoBand: Multiview Depth-Sensing Smartwatch Strap for Hand, Body and Environment Tracking. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology . 1–13

    2022

  3. [11]

    Nathan DeVrio, Vimal Mollyn, and Chris Harrison. 2023. SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–11

    2023

  4. [12]

    Roy Featherstone. 2014. Rigid body dynamics algorithms . Springer

    2014

  5. [13]

    Shubham Goel, Georgios Pavlakos, Jathushan Rajasegaran, Angjoo Kanazawa, and Jitendra Malik. 2023. Humans in 4d: Reconstructing and tracking humans with transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 14783–14794

    2023

  6. [14]

    Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J Black, Otmar Hilliges, and Gerard Pons-Moll. 2018. Deep inertial poser: Learning to reconstruct human pose from sparse inertial measurements in real time. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–15

    2018

  7. [15]

    Fan Jiang, Xubo Yang, and Lele Feng. 2016. Real-time full-body motion recon- struction and recognition for off-the-shelf VR devices. In Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry-Volume 1. 309–318

    2016

  8. [16]

    Jiaxi Jiang, Paul Streli, Huajian Qiu, Andreas Fender, Larissa Laich, Patrick Snape, and Christian Holz. 2022. Avatarposer: Articulated full-body pose tracking from sparse motion sensing. In European Conference on Computer Vision . Springer, 443–460

    2022

  9. [17]

    Yifeng Jiang, Yuting Ye, Deepak Gopinath, Jungdam Won, Alexander W Winkler, and C Karen Liu. 2022. Transformer Inertial Poser: Real-time human motion reconstruction from sparse IMUs with simultaneous terrain generation. In SIG- GRAPH Asia 2022 Conference Papers . 1–9

    2022

  10. [18]

    Haojian Jin, Zhijian Yang, Swarun Kumar, and Jason I Hong. 2018. Towards wearable everyday body-frame tracking using passive RFIDs. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1–23

    2018

  11. [19]

    Daehwa Kim and Chris Harrison. 2022. Etherpose: Continuous hand pose tracking with wrist-worn antenna impedance characteristic sensing. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology . 1–12

    2022

  12. [20]

    David Kim, Otmar Hilliges, Shahram Izadi, Alex D Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: freehand 3D interactions any- where using a wrist-worn gloveless sensor. InProceedings of the 25th annual ACM symposium on User interface software and te...

    2012

  13. [21]

    Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic opti- mization. arXiv preprint arXiv:1412.6980 (2014)

    2014 arXiv

  14. [22]

    Alexander Kyu, Hongyu Mao, Junyi Zhu, Mayank Goel, and Karan Ahuja. 2024. EITPose: Wearable and Practical Electrical Impedance Tomography for Continu- ous Hand Pose Estimation. InProceedings of the CHI Conference on Human Factors in Computing Systems. 1–10

    2024

  15. [23]

    Jiye Lee and Hanbyul Joo. 2024. Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera.arXiv preprint arXiv:2401.00847 (2024)

    2024 arXiv

  16. [24]

    Yilin Liu, Shijia Zhang, and Mahanth Gowda. 2021. NeuroPose: 3D hand pose tracking using EMG wearables. In Proceedings of the Web Conference 2021 . 1471– 1482

    2021

  17. [25]

    Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 34, 6 (Oct. 2015), 248:1–248:16

    2015

  18. [26]

    Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black. 2019. AMASS: Archive of motion capture as surface shapes. In Proceedings of the IEEE/CVF international conference on computer vision . 5442– 5451

    2019

  19. [27]

    Microsoft Corporation. [n. d.]. Microsoft Kinect

  20. [28]

    Vimal Mollyn, Riku Arakawa, Mayank Goel, Chris Harrison, and Karan Ahuja

  21. [29]

    NaturalPoint, Inc. [n. d.]. OptiTrack. https://www.optitrack.com

  22. [30]

    Shu Nishiguchi, Minoru Yamada, Koutatsu Nagai, Shuhei Mori, Yuu Kajiwara, Takuya Sonoda, Kazuya Yoshimura, Hiroyuki Yoshitomi, Hiromu Ito, Kazuya Okamoto, et al. 2012. Reliability and validity of gait analysis by android-based smartphone. Telemedicine and e-Health 18, 4 (2012)...

    2012

  23. [31]

    Northern Digital Inc. 2020. trakSTAR. https://www.ndigital.com/msci/products/ drivebay-trakstar

    2020

  24. [32]

    Mathias Parger, Joerg H Mueller, Dieter Schmalstieg, and Markus Steinberger

  25. [33]

    Polhemus. 2020. Polhemus Motion Capture System. https://polhemus.com/

    2020

  26. [34]

    PolyCam. [n. d.]. PolyCam. https://poly.cam/

  27. [35]

    Jose Luis Ponton, Haoran Yun, Andreas Aristidou, Carlos Andujar, and Nuria Pelechano. 2023. SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data. ACM Transactions on Graphics 43, 1 (2023), 1–14

    2023

  28. [36]

    Jathushan Rajasegaran, Georgios Pavlakos, Angjoo Kanazawa, and Jitendra Malik

  29. [37]

    Nirupam Roy, He Wang, and Romit Roy Choudhury. 2014. I am a smartphone and i can tell my user’s walking direction. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services . 329–342

    2014

  30. [38]

    Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica K Hodgins. 2011. Motion capture from body-mounted cameras. In ACM SIGGRAPH 2011 papers. 1–10

    2011

  31. [39]

    Ivan E Sutherland. 1968. A head-mounted three dimensional display. In Proceed- ings of the December 9-11, 1968, fall joint computer conference, part I . 757–764

    1968

  32. [40]

    Matthew Trumble, Andrew Gilbert, Charles Malleson, Adrian Hilton, and John Collomosse. 2017. Total capture: 3d human pose estimation fusing video and inertial sensors. In Proceedings of 28th British Machine Vision Conference . 1–13

    2017

  33. [41]

    Vicon Motion Systems Ltd. [n. d.]. Vicon. https://www.vicon.com

  34. [42]

    Daniel Vlasic, Rolf Adelsberger, Giovanni Vannucci, John Barnwell, Markus Gross, Wojciech Matusik, and Jovan Popović. 2007. Practical motion capture in everyday surroundings. ACM transactions on graphics (TOG) 26, 3 (2007), 35–es

    2007

  35. [43]

    Timo Von Marcard, Bodo Rosenhahn, Michael J Black, and Gerard Pons-Moll

  36. [44]

    Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, and Kris M Kitani. 2020. Back-hand-pose: 3d hand pose estimation for a wrist-worn cam- era via dorsum deformation network. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology ...

    2020

  37. [45]

    Xsens Technologies B.V. [n. d.]. Xsens IMU Systems. https://www.xsens.com. Accessed: 2024-03-07

    2024

  38. [46]

    Hang Yan, Qi Shan, and Yasutaka Furukawa. 2018. RIDI: Robust IMU double integration. In Proceedings of the European conference on computer vision (ECCV) . 621–636

    2018

  39. [47]

    Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua Pan, Christian Theobalt, and Feng Xu. 2023. EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors. arXiv preprint arXiv:2305.01599 (2023)

    2023 arXiv

  40. [48]

    Xinyu Yi, Yuxiao Zhou, Marc Habermann, Soshi Shimada, Vladislav Golyanik, Christian Theobalt, and Feng Xu. 2022. Physical inertial poser (pip): Physics- aware real-time human motion tracking from sparse inertial sensors. In Pro- ceedings of the IEEE/CVF Conference on Computer ...

    2022

  41. [49]

    Xinyu Yi, Yuxiao Zhou, and Feng Xu. 2021. Transpose: Real-time 3d human translation and pose estimation with six inertial sensors. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–13

    2021

  42. [50]

    Yang Zhang, Chouchang Yang, Scott E Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++ room-scale interactive and context-aware sensing. In Proceedings of the 2018 chi conference on human factors in computing systems . 1–15

    2018

  43. [51]

    Mingmin Zhao, Tianhong Li, Mohammad Abu Alsheikh, Yonglong Tian, Hang Zhao, Antonio Torralba, and Dina Katabi. 2018. Through-wall human pose estimation using radio signals. In Proceedings of the IEEE conference on computer vision and pattern recognition . 7356–7365

    2018

  44. [52]

    Li’an Zhuo, Jian Cao, Qi Wang, Bang Zhang, and Liefeng Bo. 2023. Towards Stable Human Pose Estimation via Cross-View Fusion and Foot Stabilization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 650–659

    2023

  45. [2017]

    In Computer graphics forum, Vol

    Sparse inertial poser: Automatic 3d human pose estimation from sparse imus. In Computer graphics forum, Vol. 36. Wiley Online Library, 349–360

  46. [2018]

    In Proceedings of the 24th ACM symposium on virtual reality software and technology

    Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality. In Proceedings of the 24th ACM symposium on virtual reality software and technology . 1–10

  47. [2021]

    arXiv preprint arXiv:2111.07868 (2021)

    Tracking people with 3D representations. arXiv preprint arXiv:2111.07868 (2021)

    2021 arXiv

  48. [2023]

    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

    IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–12

    2023

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.