PFM-HR: Pose Flow Matching for Humanoid Robots

Fanghai Zhang; Hanyang Cao; Ji Ma; Lei Han; Renjing Xu; Runhan Zhang; Xingyu Chen; Yangchen Zhou; Yi Gu; Yukang Gao

REVIEW 4 major objections 5 minor 41 references

PFM-HR: Pose Flow Matching for Humanoid Robots

T0 review · 4 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read PFM-HR claims that scoring a rollout's joint-change pattern against the Jacobian of a flow-matching denoiser trained on unordered poses improves humanoid tracking, especially acrobatic motions.

desk verdict A frozen flow-matching pose prior used as a directional geometry reward is a genuinely new and useful idea; the main weakness is that the geometric interpretation rests on an unverified approximation of the learned Jacobian to the population-optimal one. read the letter →

arxiv 2608.03227 v1 pith:HPCNLKWK submitted 2026-08-04 cs.RO

Yukang Gao , Yi Gu , Yangchen Zhou , Xingyu Chen , Zhaorui Wang , Fanghai Zhang , Hanyang Cao , Zhengyang Shen

show 4 more authors

Ji Ma Runhan Zhang Lei Han Renjing Xu

This is my paper

classification cs.RO

keywords flowmatchingposepriorhumanoidrobotsreinforcementlearningmotiontrackinggeometryscoredenoiserJacobianrewardmodulation

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

PFM-HR sets out to show that a flow-matching denoiser trained only on unordered humanoid poses — no timestamps, no ordered motion clips, no pose-distance labels — still encodes how joints co-vary, and that this local geometry can be turned into a dense reward signal for reinforcement-learned tracking. The signal is the Pose Geometry Score: take the normalized joint-coordinate change between consecutive rollout poses, push it through the denoiser's Jacobian, and measure the squared response; a high score means the policy's pose transition aligns with strong co-variation modes of real poses. The score is mapped to a reference percentile and used to attenuate the tracking reward for unsupported change patterns while the prior stays frozen. Experiments report better sample efficiency and tracking accuracy than an adversarial-motion-prior backbone and a frozen pose-distance prior, including solving backflip and double-kong tracking that the backbone fails and cutting real-robot training samples by 15–31 percent.

What carries the argument

The Pose Geometry Score (PGS), carried by the Jacobian–conditional covariance identity of the flow-matching clean-pose predictor. Because the denoiser is trained on the marginal pose distribution, its input Jacobian $J_\varphi$ approximates the population-optimal map $\nabla_z \mathbb{E}[x \mid z_t = z] = \frac{t}{(1-t)^2}\,\mathrm{Cov}[x \mid z_t = z]$; the score $s_{\mathrm{PGS}} = \lVert J_\varphi d \rVert_2^2$ is the squared response of that Jacobian to the normalized joint-coordinate change direction $d$ of a rollout transition. This makes PGS a reader of the local direction-pattern geometry of poses, computable as a single Jacobian–vector product; after mapping to the reference motion'

What would settle it

At online queries $\tilde{q} = t_{\mathrm{eval}} q + (1-t_{\mathrm{eval}})\varepsilon$, estimate the conditional covariance $C = \mathrm{Cov}[x \mid z = \tilde{q}]$ by importance-weighted Monte Carlo over the pose corpus (weights proportional to $\exp(-\lVert \tilde{q} - t_{\mathrm{eval}} x \rVert^2 / 2(1-t_{\mathrm{eval}})^2)$), then compare the leading eigendirections of the learned Jacobian product $J^\top J$ with those of $\left(\frac{t_{\mathrm{eval}}}{(1-t_{\mathrm{eval}})^2}\right)^2 C^2$. If the average eigenvector alignment is no better than random, or if replacing the neural PGS with

Watch

Extended reading notes

Core claim

PFM-HR's central discovery is that the input Jacobian of a clean-pose-predicting flow-matching network trained only on the marginal pose distribution encodes local joint co-variation geometry. For the population-optimal denoiser, $\nabla_z \mathbb{E}[x \mid z_t = z] = \frac{t}{(1-t)^2}\,\mathrm{Cov}[x \mid z_t = z]$; applying the learned Jacobian to the normalized joint-coordinate change of a rollout step and squaring the norm gives the Pose Geometry Score — sensitive to the inter-joint pattern of a pose change, insensitive to its overall magnitude and global sign. A high score means the transition aligns with strongly represented co-variation modes of the pose prior; the tracking reward is

Load-bearing premise

The load-bearing premise is that the finite-capacity denoiser's Jacobian, evaluated at the stochastically corrupted rollout queries, behaves like the population-optimal conditional covariance of clean poses — a faithfulness the paper derives in theory but never measures directly at those query points.

Editorial extensions

If this is right

A pose prior becomes a plug-in: one frozen model, trained once on 60M unordered poses, can be attached to different tracking policies and tasks with no retraining and no ordered data.
Scale is cheap: growing the prior corpus from 30M to 60M poses costs 65 GPU-hours by continued training, versus 100 from scratch and over 500 for the pose-distance supervision the PDF-HR baseline needs.
Dynamic skills gain most: on Backflip and Double Kong the vanilla backbone never converges, but both prior-based variants solve them and PFM-HR converges fastest.
In general motion tracking over 10/20/30 s horizons, averaged position error falls 7.6% versus the ADD backbone and 10.3% versus PDF-HR, with rotation error down 3.6% and 7.3%.
The reward is cheap: one Jacobian–vector product per step (0.75 ms for a batch of 4096) versus 1.8 ms for three reconstruction evaluations, so dense geometric guidance adds little overhead to RL.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

If the Jacobian-geometry reading is right, the recipe transfers: any RL problem with a static state-data manifold — dexterous manipulation, loco-manipulation — could score the policy's state-space update direction against a frozen generative prior's Jacobian, without needing temporal clips.
The paper's own limitation — PGS is sign-invariant and blind to transition direction and ordering, so a motion and its exact reverse can score alike — points to a natural next step that the authors also flag: a sign-sensitive or temporally conditioned variant that distinguishes direction, likely preserving the efficiency of the current score.
The ablation comparing PGS with a reconstruction-based score (FM-Recon) suggests the benefit comes from directional Jacobian response rather than pose plausibility per se; a cheaper surrogate for tangent-manifold alignment might achieve similar gains in other settings.
Because the single-noise-sample estimator already agrees with a 128-sample reference on 97.9% of calibration regions, the practical variance of the score is small; the open question the paper leaves is how close the learned Jacobian is to the true conditional covariance at online queries — a diagnostic that would settle whether the guidance is genuinely geometric or a smoothness bias.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Here's my read. The genuinely new thing is using a frozen flow-matching denoiser's Jacobian as a directional reward signal for RL pose tracking. The identity in Eq. (11) is known, but pointing out that you can score the rollout's joint-change direction with a Jacobian-vector product and calibrate it per reference is a real, practical contribution. The paper does good work: the derivation in Appendix A is correct, the ablations (FM-Recon vs. PGS, v-pred vs. x-pred, data scale) are informative, and the experimental evidence is consistent and includes a real-robot deployment. The gains on acrobatic tasks and the two tasks where vanilla ADD fails (Backflip, Double Kong) are believable, and the 0.75ms per-step cost is a strong practical point.

The soft spots, in order. First, the central interpretation: PGS is sold as measuring alignment with "co-variation modes" of the pose prior, but that interpretation requires the learned Jacobian J_phi to approximate the population-optimal J* at the online query points. Appendix A says this is approximate "to the extent" the Jacobians agree, but the paper never quantifies that extent. Appendix B checks internal consistency (discriminability, magnitude-invariance, rank correlation against a 128-sample oracle), but those checks would pass for any smooth network whose Jacobian is roughly oriented; they do not show J_phi is close to the true conditional covariance. So the mechanism could partly just be a smoothness regularizer. That doesn't kill the paper—the empirical gains stand on their own—but it does weaken the conceptual claim.

The second issue is the t_eval selection: the timestep is chosen by a validation sweep on the same 34-sequence LaFAN1 set used for the headline general-tracking numbers. That makes the general-tracking results less clean, though the neighboring timesteps (0.7, 0.8) perform nearly as well, so the tuning isn't knife-edged. Third, a minor point: no code or data release, which limits reproducibility. I also note the paper itself acknowledges the sign-invariance limitation for temporal transitions; that is honest and appropriate.

Overall: the central method is sound enough, the experiments support the main empirical claims, and the weaknesses are addressable. I would send this to peer review with a request to see a faithfulness check of J_phi vs. J* and an evaluation of t_eval on held-out tasks. This is a useful paper for anyone working on physics-based character control or reusable motion priors; it will also be of interest to the flow-matching community as an application of denoiser geometry.

Referee Report

4 major / 5 minor

Summary. This paper proposes PFM-HR, a frozen flow-matching pose prior trained on unordered humanoid poses, and uses the Jacobian of its clean-pose denoiser to define a Pose Geometry Score (PGS). PGS is inserted into an ADD-style tracking reward after reference-percentile calibration. The authors derive the population-optimal identity J* = t/(1-t)^2 Cov[x|z] (Eq. 11, Appendix A) and use it to motivate PGS as a projection of the joint-change direction onto high-variance conditional co-variation modes. Experiments cover nine single-trajectory MimicKit skills, a 34-sequence general-tracking benchmark, ablations on prior scale, prediction parameterization, and reward formulation, and real-robot deployment with BeyondMimic. The paper claims improved sample efficiency and tracking accuracy, especially for dynamic motions.

Significance. If the central interpretation is accepted, the contribution is meaningful: a controller-independent pose prior that provides a cheap (one Jacobian-vector product), frozen, scaling-friendly reward signal for dynamic humanoid tracking, including tasks where vanilla ADD fails, with a plausible real-robot deployment. The strength of the paper is that PGS is derived rather than fitted: Eq. (11) and Eq. (16) follow from the conditional-mean regression objective, and the Appendix A derivation is verifiable step by step. The robustness study (Appendix B) usefully shows internal consistency and magnitude invariance. However, the paper's own Appendix A and Limitations statements explicitly identify the main approximation—agreement of the learned Jacobian with the population-optimal Jacobian—as unquantified, and this is the central load-bearing assumption for the geometric interpretation.

major comments (4)

[III-C, Eq. (11)-(16), Appendix A] The geometric interpretation of PGS relies on J_phi(z,t_eval) approximating the population-optimal Jacobian J* at online rollout queries. Eq. (16) is proved for J*, but the method actually uses the Jacobian of a 10-block residual MLP. Appendix A itself concludes 'the interpretation is approximate to the extent that its input Jacobian agrees with the population-optimal Jacobian at the queried point,' and Appendix B explicitly notes that its perturbation study uses transitions drawn from the prior's training corpus and measures internal consistency only. No experiment quantifies agreement with the conditional covariance C_t(z) at held-out or online queries. If J_phi does not track the true conditional covariance, PGS is an arbitrary smoothness regularizer and the central claim is unsupported. Please add a quantitative faithfulness check, e.g., comparing J_phi d to an empirical covariance-v
[III-D, Fig. 3, Table V] The evaluation timestep t_eval is selected by a validation sweep on the same 34-sequence LaFAN1 subset that is later used to report general-motion tracking results (Fig. 3). The reward-shaping hyperparameters p_good, p_bad, and alpha are set without a reported sensitivity analysis. This means the headline general-tracking gains may partly reflect selection on the evaluation benchmark. The robustness table (Table V) shows neighboring t_eval values behave similarly, which mitigates the concern, but final error metrics are only reported at t_eval=0.75. Please report the main general-tracking metrics across the t_eval sweep, or use a held-out validation split and show that the selected value transfers.
[VI Limitations / Eq. (15)] PGS is sign-invariant at a fixed query because it is quadratic in d_k. The paper acknowledges in Limitations that 'opposite transitions may receive similar geometric evaluations' and that direction/order cannot be assessed. This substantially weakens the interpretation in Section I that PGS measures alignment with directional joint co-variation: a reversal of a coordinated transition receives the same score. For acrobatic skills such as backflip vs frontflip, direction is decisive. PGS may still serve as a subspace-alignment regularizer, and the signed tracking reward supplies the direction, but the mechanistic language should be revised (or a sign-sensitive score introduced) to avoid overstating what the prior reveals.
[IV-B Table II; Appendix D Table IX] The abstract's 'improves tracking accuracy' is not equally supported across all metrics. On single-trajectory tasks, the positional-error margins over PDF-HR are often within one standard deviation (e.g., Cartwheel 0.028±0.003 vs 0.028±0.003; Sideflip 0.049±0.001 vs 0.050±0.003; Speed Vault 0.021±0.003 vs 0.023±0.000). In general tracking, rotation errors overlap heavily (10 s: 0.119±0.009 vs 0.121±0.007). With only three seeds and no significance testing, the accuracy claim should be limited to the tasks and metrics where the gain is clear (sample efficiency, solving previously-failed Backflip and Double Kong) or supported by confidence intervals or effect sizes.

minor comments (5)

[Eq. (14) / Appendix A] The stabilization constant is written epsilon_num in the main paper and eta_num in Appendix A. Use a single symbol throughout.
[Table II] Formatting is broken in the position-error rows for Backflip and Double Kong: 'Failed0.048' and 'Failed0.031' should be separated into 'Failed' and the numeric value.
[Fig. 2] The caption says 'min-normalized' without defining the normalization. State how the metrics are scaled and over which set of tasks.
[IV-C] The text notes that PDF-HR yields errors comparable to or higher than vanilla ADD in general tracking, while Table II shows PDF-HR improves some single-trajectory tasks. A sentence explaining why the pose-distance field transfers less successfully to the multi-motion setting would be useful.
[References] Several references are arXiv preprints with future-dated numbers (e.g., 2608.03227 itself, 2602.04851, 2603.03279, 2603.27756). Please verify that all citation numbers and years are correct and add DOIs or URLs where available.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the PGS reward is derived from an external conditional-covariance identity and evaluated on external benchmarks.

full rationale

The central derivation is self-contained: Eq. (11) follows from the population-optimal clean-pose predictor F*_t(z) = E[x|z_t=z] and the Gaussian likelihood of the linear Flow Matching path, giving J*_t(z) = (t/(1-t)^2) Cov[x|z_t=z]; Eq. (16) is then an algebraic consequence for the squared Jacobian-vector response. No equation reduces to a fitted parameter or to a self-citation. The learned finite-capacity Jacobian J_phi is acknowledged to be only approximately equal to J* (Appendix A: 'the interpretation is approximate to the extent that its input Jacobian agrees with the population-optimal Jacobian'), and Appendix B's robustness checks are explicitly internal-consistency studies on the prior's training corpus, not circular evidence. Hyperparameters such as t_eval, p_good, p_bad, and alpha are chosen by validation sweeps or fixed constants; they are reward-shaping choices rather than quantities derived from the claimed geometric identity, and single-motion results are evaluated on separate tasks. Self-citations (e.g., PDF-HR [5]) appear only as baselines and related work, never as the load-bearing justification for PGS. The paper's limitation section further discloses that PGS is direction-invariant and depends on dataset coverage, which is a scope restriction rather than a circular step.

Assumptions & free parameters 6 free parameters · 4 assumptions · 1 invented entities

The paper's central claim rests on the flow matching prior learning the marginal pose distribution, on the learned Jacobian approximating the population-optimal conditional covariance, and on the hand-set reward calibration constants. The first is standard in generative modeling; the second is an empirical assumption that is not directly verified; the third introduces fitted hyperparameters.

free parameters (6)

t_eval = 0.75
Chosen by sweeping on the 34-sequence LaFAN1 subset that is also used for the main general tracking result; also selected in a separate discrimination study (Appendix B).
p_good = 0.05
Hand-set threshold above which the tracking reward is unchanged.
p_bad = 0.01
Hand-set threshold below which the tracking reward is maximally attenuated.
alpha = 0.5
Hand-set exponent in the reward mapping exp(-alpha * rho).
delta = 1e-3
Stability clamp in velocity parameterization, standard choice, not task-fitted.
eta_num = 1e-6
Stabilization constant for direction normalization, standard.

assumptions (4)

standard math Smoothness/regularity conditions on the pose distribution to exchange differentiation and integration in the conditional mean derivation
Appendix A uses these to derive the Jacobian-conditional covariance identity.
domain assumption The learned denoiser's Jacobian J_phi approximates the population-optimal J* at rollout query points
Section III-C and Appendix B rely on this for the geometric interpretation of PGS; no quantitative check on actual online queries is provided.
domain assumption The marginal pose distribution learned from the BONES-SEED corpus captures the joint co-variation structure relevant for the tracked motions
Section III-B trains the prior on unordered poses; the method assumes this transfer to the LaFAN1 and MimicKit tasks.
domain assumption Reference-calibrated empirical CDF of PGS over reference transitions provides a meaningful normalization for reward attenuation
Section III-D constructs the CDF from the reference motion; this assumes the policy's rollout transitions stay in a comparable PGS range.

invented entities (1)

Pose Geometry Score (PGS)
purpose: Measures alignment of the normalized joint-coordinate change with the local geometry of the pose prior
PGS is defined in this paper from the denoiser Jacobian; it is a new mathematical metric, not a physical entity, and no outside-the-paper falsifiable prediction is attached to it.

how reviews work

0 comments

Cite this review

Pith. "Pith review of PFM-HR: Pose Flow Matching for Humanoid Robots." pith.science (2026). https://pith.science/paper/HPCNLKWK

@misc{pith2026260803227,
  author       = {Pith},
  title        = {Pith review of: PFM-HR: Pose Flow Matching for Humanoid Robots},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/HPCNLKWK}},
  note         = {Machine review of arXiv:2608.03227}
}

read the original abstract

Motion priors improve reinforcement learning for physics-based humanoid tracking, but temporal priors require ordered motion clips, while pose priors provide limited guidance for policy-induced pose transitions. We present Pose Flow Matching for Humanoid Robots (PFM-HR), a reusable flow matching prior trained directly on large scale unordered pose data. PFM-HR introduces the Pose Geometry Score (PGS), which quantifies how joint coordinate changes during rollouts align with the local geometry of pose variation captured by the prior. Using PGS to modulate the tracking reward guides policy exploration toward structured pose changes while keeping the prior frozen across tracking tasks. Experiments demonstrate that PFM-HR improves both single motion and general motion tracking, especially for highly dynamic motions.

Figures

Figures reproduced from arXiv: 2608.03227 by the authors.

**Figure 2.** Impact of prior-training data scale. Tracking perfor [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

**Figure 3.** Sensitivity to the PGS evaluation timestep in general [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗

Figures from the paper (4 more)

**Figure 4.** Figure 4: Real-world deployment with PFM-HR. Motion tracking [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]

**Figure 5.** Figure 5: Qualitative comparison of motion tracking performance. The target reference motion is depicted by the blue humanoid, [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]

**Figure 6.** Figure 6: Training curves for general-motion tracking on the 34-sequence LaFAN1 subset. The three panels report success rates [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]

**Figure 7.** Figure 7: Training curves on nine single-motion tracking tasks. We compare ADD (blue), ADD with PDF-HR (orange), and [PITH_FULL_IMAGE:figures/full_fig_p016_7.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

41 extracted references · 20 canonical work pages

[1]

Visual imitation enables contextual humanoid control

Arthur Allshire, Hongsuk Choi, Junyi Zhang, David McAllister, Anthony Zhang, Chung Min Kim, Trevor Darrell, Pieter Abbeel, Jitendra Malik, and Angjoo Kanazawa. Visual imitation enables contextual humanoid control. InProceedings of the Conference on Robot Learning (CoRL), 2025

2025
[2]

Ai datasets for machine learning and motion capture

Bones Studio. Ai datasets for machine learning and motion capture. https://bones.studio/ai-datasets/, 2026. Accessed: 2026-05-06

work page 2026
[3]

Gmt: Gen- eral motion tracking for humanoid whole-body control

Zixuan Chen, Mazeyu Ji, Xuxin Cheng, Xuanbin Peng, Xue Bin Peng, and Xiaolong Wang. Gmt: Gen- eral motion tracking for humanoid whole-body control. arXiv:2506.14770, 2025

arXiv 2025
[4]

Adversarial motion priors make good substitutes for complex reward functions

Alejandro Escontrela, Xue Bin Peng, Wenhao Yu, Tingnan Zhang, Atil Iscen, Ken Goldberg, and Pieter Abbeel. Adversarial motion priors make good substitutes for complex reward functions. In2022 IEEE/RSJ Inter- national Conference on Intelligent Robots and Systems (IROS), pages 25–32. IEEE, 2022

work page 2022
[5]

Pdf-hr: Pose distance fields for humanoid robots.arXiv preprint arXiv:2602.04851, 2026

Yi Gu, Yukang Gao, Yangchen Zhou, Xingyu Chen, Yixiao Feng, Mingle Zhao, Yunyang Mo, Zhaorui Wang, Lixin Xu, and Renjing Xu. Pdf-hr: Pose distance fields for humanoid robots.arXiv preprint arXiv:2602.04851, 2026

work page arXiv 2026
[6]

Robust motion in-betweening.ACM Transactions on Graphics (TOG), 39(4):60–1, 2020

F ´elix G Harvey, Mike Yurick, Derek Nowrouzezahrai, and Christopher Pal. Robust motion in-betweening.ACM Transactions on Graphics (TOG), 39(4):60–1, 2020

work page 2020
[7]

Ul- tra: Unified multimodal control for autonomous hu- manoid whole-body loco-manipulation.arXiv preprint arXiv:2603.03279, 2026

Xialin He, Sirui Xu, Xinyao Li, Runpei Dong, Li- uyu Bian, Yu-Xiong Wang, and Liang-Yan Gui. Ul- tra: Unified multimodal control for autonomous hu- manoid whole-body loco-manipulation.arXiv preprint arXiv:2603.03279, 2026

arXiv 2026
[8]

Nrdf: Neural riemannian distance fields for learning articulated pose priors

Yannan He, Garvita Tiwari, Tolga Birdal, Jan Eric Lenssen, and Gerard Pons-Moll. Nrdf: Neural riemannian distance fields for learning articulated pose priors. In Conference on Computer Vision and Pattern Recognition (CVPR), 2024

work page 2024

Show all 41 references

[9]

Back to basics: Let denoising generative models denoise.arXiv preprint arXiv:2511.13720, 2025

Tianhong Li and Kaiming He. Back to basics: Let denoising generative models denoise.arXiv preprint arXiv:2511.13720, 2025

2025 arXiv
[10]

Truong, Xiaoyu Huang, Yu- man Gao, Guy Tevet, Koushil Sreenath, and C

Qiayuan Liao, Takara E. Truong, Xiaoyu Huang, Yu- man Gao, Guy Tevet, Koushil Sreenath, and C. Karen Liu. Beyondmimic: From motion tracking to versatile humanoid control via guided diffusion, 2025. URL https://arxiv.org/abs/2508.08241

2025 arXiv
[11]

Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, and Matthew Le. Flow matching for generative modeling. InThe Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=PqvMRDCJT9t

2023
[12]

Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022

Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022

2022 arXiv
[13]

Dposer: Diffu- sion model as robust 3d human pose prior, 2024

Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng, Yue Deng, Yulun Zhang, and Haoqian Wang. Dposer: Diffu- sion model as robust 3d human pose prior, 2024. URL https://arxiv.org/abs/2312.05541

2024 arXiv
[14]

Dposer-x: Diffusion model as robust 3d whole-body human pose prior.arXiv preprint arXiv:2508.00599, 2025

Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng, Yue Deng, Xian Liu, Zhongang Cai, Lei Yang, Yulun Zhang, Haoqian Wang, and Ziwei Liu. Dposer-x: Diffusion model as robust 3d whole-body human pose prior.arXiv preprint arXiv:2508.00599, 2025

2025 arXiv
[15]

Perpetual humanoid control for real-time simulated avatars

Zhengyi Luo, Jinkun Cao, Kris Kitani, Weipeng Xu, et al. Perpetual humanoid control for real-time simulated avatars. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 10895–10904, 2023

2023
[16]

Univer- sal humanoid motion representations for physics-based control

Zhengyi Luo, Jinkun Cao, Josh Merel, Alexander Win- kler, Jing Huang, Kris Kitani, and Weipeng Xu. Univer- sal humanoid motion representations for physics-based control. InInternational Conference on Learning Repre- sentations, volume 2024, pages 56766–56782, 2024

2024
[17]

Sonic: Supersizing motion tracking for natural humanoid whole-body control.arXiv preprint arXiv:2511.07820, 2025

Zhengyi Luo, Ye Yuan, Tingwu Wang, Chenran Li, Sirui Chen, Fernando Casta ˜neda, Zi-Ang Cao, Jiefeng Li, David Minor, Qingwei Ben, Xingye Da, Runyu Ding, Cyrus Hogg, Lina Song, Edy Lim, Eugene Jeong, Tairan He, Haoru Xue, Wenli Xiao, Zi Wang, Simon Yuen, Jan Kautz, Yan Chang, ...

2025 arXiv
[18]

Amass: Archive of motion capture as surface shapes

Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black. Amass: Archive of motion capture as surface shapes. InProceedings of the IEEE/CVF international conference on computer vision, pages 5442–5451, 2019

2019
[19]

On the posterior dis- tribution in denoising: Application to uncertainty quan- tification.arXiv preprint arXiv:2309.13598, 2023

Hila Manor and Tomer Michaeli. On the posterior dis- tribution in denoising: Application to uncertainty quan- tification.arXiv preprint arXiv:2309.13598, 2023

2023 arXiv
[20]

Smp: Reusable score-matching motion priors for physics-based character control.ACM Transactions on Graphics (Proceedings of SIGGRAPH 2026), 2026

Yuxuan Mu, Ziyu Zhang, Yi Shi, Dun Yang, Minami Matsumoto, Kotaro Imamura, Guy Tevet, Chuan Guo, Michael Taylor, Chang Shu, Pengcheng Xi, and Xue Bin Peng. Smp: Reusable score-matching motion priors for physics-based character control.ACM Transactions on Graphics (Proceedings ...

2026
[21]

Posed- flow: Versatile and guided flow matching model of hu- man pose

Jebastin Nadar, Simone Foti, and Tolga Birdal. Posed- flow: Versatile and guided flow matching model of hu- man pose. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21165–21175, 2026

2026
[22]

Scalable diffu- sion models with transformers

William Peebles and Saining Xie. Scalable diffu- sion models with transformers. InProceedings of the IEEE/CVF international conference on computer vision, pages 4195–4205, 2023

2023
[23]

Mimickit: A reinforcement learning framework for motion imitation and control.arXiv preprint arXiv:2510.13794, 2025

Xue Bin Peng. Mimickit: A reinforcement learning framework for motion imitation and control.arXiv preprint arXiv:2510.13794, 2025

2025
[24]

Deepmimic: Example-guided deep re- inforcement learning of physics-based character skills

Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel Van de Panne. Deepmimic: Example-guided deep re- inforcement learning of physics-based character skills. ACM Transactions On Graphics (TOG), 37(4):1–14, 2018

2018
[25]

Amp: Adversarial motion priors for stylized physics-based character control.ACM Transac- tions on Graphics (ToG), 40(4):1–20, 2021

Xue Bin Peng, Ze Ma, Pieter Abbeel, Sergey Levine, and Angjoo Kanazawa. Amp: Adversarial motion priors for stylized physics-based character control.ACM Transac- tions on Graphics (ToG), 40(4):1–20, 2021

2021
[26]

Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters.ACM Transactions On Graphics (TOG), 41 (4):1–17, 2022

Xue Bin Peng, Yunrong Guo, Lina Halper, Sergey Levine, and Sanja Fidler. Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters.ACM Transactions On Graphics (TOG), 41 (4):1–17, 2022

2022
[27]

Heracles: Bridging precise tracking and generative synthesis for general humanoid control.arXiv preprint arXiv:2603.27756, 2026

Zelin Tao, Zeran Su, Peiran Liu, Jingkai Sun, Wenqiang Que, Jiahao Ma, Jialin Yu, Jiahang Cao, Pihai Sun, Hao Liang, et al. Heracles: Bridging precise tracking and generative synthesis for general humanoid control.arXiv preprint arXiv:2603.27756, 2026

2026
[28]

Calm: Conditional adversarial latent models for directable virtual characters

Chen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor, Gal Chechik, and Xue Bin Peng. Calm: Conditional adversarial latent models for directable virtual characters. InACM SIGGRAPH 2023 conference proceedings, pages 1–9, 2023

2023
[29]

Maskedmimic: Unified physics-based character control through masked motion inpainting

Chen Tessler, Yunrong Guo, Ofir Nabati, Gal Chechik, and Xue Bin Peng. Maskedmimic: Unified physics-based character control through masked motion inpainting. ACM Transactions on Graphics (TOG), 2024

2024
[30]

Pose- ndf: Modeling human pose manifolds with neural dis- tance fields

Garvita Tiwari, Dimitrije Anti ´c, Jan Eric Lenssen, Niko- laos Sarafianos, Tony Tung, and Gerard Pons-Moll. Pose- ndf: Modeling human pose manifolds with neural dis- tance fields. InEuropean Conference on Computer Vision, pages 572–589. Springer, 2022

2022
[31]

Physics-based character controllers using conditional vaes.ACM Trans

Jungdam Won, Deepak Gopinath, and Jessica Hodgins. Physics-based character controllers using conditional vaes.ACM Trans. Graph., 41(4), 2022. URL https: //doi.org/10.1145/3528223.3530067

2022
[32]

Text-to-image rectified flow as plug-and-play priors

Xiaofeng Yang, Cheng Chen, Fayao Liu, Guosheng Lin, et al. Text-to-image rectified flow as plug-and-play priors. InInternational Conference on Learning Rep- resentations, volume 2025, pages 13896–13920, 2025

2025
[33]

ControlV AE: Model-Based Learning of Generative Controllers for Physics-Based Characters.ACM Trans- actions on Graphics, 41(6):183:1–183:16, 2022

Heyuan Yao, Zhenhua Song, Baoquan Chen, and Libin Liu. ControlV AE: Model-Based Learning of Generative Controllers for Physics-Based Characters.ACM Trans- actions on Graphics, 41(6):183:1–183:16, 2022. ISSN 0730-0301

2022
[34]

Moconvq: Unified physics-based motion control via scalable discrete rep- resentations.ACM Transactions on Graphics (TOG), 43 (4):1–21, 2024

Heyuan Yao, Zhenhua Song, Yuyang Zhou, Tenglong Ao, Baoquan Chen, and Libin Liu. Moconvq: Unified physics-based motion control via scalable discrete rep- resentations.ACM Transactions on Graphics (TOG), 43 (4):1–21, 2024

2024
[35]

Karen Liu, and Jiajun Wu

Shaofeng Yin, Yanjie Ze, Hong-Xing Yu, C. Karen Liu, and Jiajun Wu. Visualmimic: Visual humanoid loco- manipulation via motion tracking and generation.arXiv preprint arXiv:2509.20322, 2025

2025
[36]

Geo- metric neural distance fields for learning human motion priors.arXiv preprint arXiv:2509.09667, 2025

Zhengdi Yu, Simone Foti, Linguang Zhang, Amy Zhao, Cem Keskin, Stefanos Zafeiriou, and Tolga Birdal. Geo- metric neural distance fields for learning human motion priors.arXiv preprint arXiv:2509.09667, 2025

2025 arXiv
[37]

Rohm: Robust human motion reconstruction via diffusion

Siwei Zhang, Bharat Lal Bhatnagar, Yuanlu Xu, Alexan- der Winkler, Petr Kadlecek, Siyu Tang, and Federica Bogo. Rohm: Robust human motion reconstruction via diffusion. InCVPR, 2024

2024
[38]

Physics-based motion imitation with adversarial differential discriminators

Ziyu Zhang, Sergey Bashkirov, Dun Yang, Yi Shi, Michael Taylor, and Xue Bin Peng. Physics-based motion imitation with adversarial differential discriminators. In Proceedings of the SIGGRAPH Asia 2025 Conference Papers, pages 1–12, 2025

2025
[39]

Karen Liu, Pieter Abbeel, Guanya Shi, and Rocky Duan

Siheng Zhao, Yanjie Ze, Yue Wang, C. Karen Liu, Pieter Abbeel, Guanya Shi, and Rocky Duan. Resmimic: From general motion tracking to humanoid whole-body loco- manipulation via residual learning, 2025. URL https: //arxiv.org/abs/2510.05070

2025
[40]

Score distillation of flow matching models.arXiv preprint arXiv:2509.25127, 2025

Mingyuan Zhou, Yi Gu, Huangjie Zheng, Liangchen Song, Guande He, Yizhe Zhang, Wenze Hu, and Yinfei Yang. Score distillation of flow matching models.arXiv preprint arXiv:2509.25127, 2025

2025
[41]

Neural categorical priors for physics-based character control.ACM Transactions on Graphics (TOG), 42(6): 1–16, 2023

Qingxu Zhu, He Zhang, Mengting Lan, and Lei Han. Neural categorical priors for physics-based character control.ACM Transactions on Graphics (TOG), 42(6): 1–16, 2023. Supplementary Material APPENDIXA DENOISER-INDUCEDPOSEGEOMETRY This section establishes the connection between t...

2023

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.

[1] [1]

Visual imitation enables contextual humanoid control

Arthur Allshire, Hongsuk Choi, Junyi Zhang, David McAllister, Anthony Zhang, Chung Min Kim, Trevor Darrell, Pieter Abbeel, Jitendra Malik, and Angjoo Kanazawa. Visual imitation enables contextual humanoid control. InProceedings of the Conference on Robot Learning (CoRL), 2025

2025

[2] [2]

Ai datasets for machine learning and motion capture

Bones Studio. Ai datasets for machine learning and motion capture. https://bones.studio/ai-datasets/, 2026. Accessed: 2026-05-06

work page 2026

[3] [3]

Gmt: Gen- eral motion tracking for humanoid whole-body control

Zixuan Chen, Mazeyu Ji, Xuxin Cheng, Xuanbin Peng, Xue Bin Peng, and Xiaolong Wang. Gmt: Gen- eral motion tracking for humanoid whole-body control. arXiv:2506.14770, 2025

arXiv 2025

[4] [4]

Adversarial motion priors make good substitutes for complex reward functions

Alejandro Escontrela, Xue Bin Peng, Wenhao Yu, Tingnan Zhang, Atil Iscen, Ken Goldberg, and Pieter Abbeel. Adversarial motion priors make good substitutes for complex reward functions. In2022 IEEE/RSJ Inter- national Conference on Intelligent Robots and Systems (IROS), pages 25–32. IEEE, 2022

work page 2022

[5] [5]

Pdf-hr: Pose distance fields for humanoid robots.arXiv preprint arXiv:2602.04851, 2026

Yi Gu, Yukang Gao, Yangchen Zhou, Xingyu Chen, Yixiao Feng, Mingle Zhao, Yunyang Mo, Zhaorui Wang, Lixin Xu, and Renjing Xu. Pdf-hr: Pose distance fields for humanoid robots.arXiv preprint arXiv:2602.04851, 2026

work page arXiv 2026

[6] [6]

Robust motion in-betweening.ACM Transactions on Graphics (TOG), 39(4):60–1, 2020

F ´elix G Harvey, Mike Yurick, Derek Nowrouzezahrai, and Christopher Pal. Robust motion in-betweening.ACM Transactions on Graphics (TOG), 39(4):60–1, 2020

work page 2020

[7] [7]

Ul- tra: Unified multimodal control for autonomous hu- manoid whole-body loco-manipulation.arXiv preprint arXiv:2603.03279, 2026

Xialin He, Sirui Xu, Xinyao Li, Runpei Dong, Li- uyu Bian, Yu-Xiong Wang, and Liang-Yan Gui. Ul- tra: Unified multimodal control for autonomous hu- manoid whole-body loco-manipulation.arXiv preprint arXiv:2603.03279, 2026

arXiv 2026

[8] [8]

Nrdf: Neural riemannian distance fields for learning articulated pose priors

Yannan He, Garvita Tiwari, Tolga Birdal, Jan Eric Lenssen, and Gerard Pons-Moll. Nrdf: Neural riemannian distance fields for learning articulated pose priors. In Conference on Computer Vision and Pattern Recognition (CVPR), 2024

work page 2024