Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

Motion Generation Review: Exploring Deep Learning for Lifelike Animation with Manifold

T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This survey argues that manifold learning compresses human motion data into a low-dimensional subspace of valid movements, improving the naturalness and efficiency of generated animation.

desk verdict A useful taxonomy but not yet a trustworthy reference: the survey's technical errors and undocumented literature selection undermine its credibility. read the letter →

arxiv 2412.10458 v1 pith:43WLPNQA submitted 2024-12-12 cs.CV cs.GRcs.HC

Jiayi Zhao , Dongdong Weng , Qiuxin Du , Zeyu Tian This is my paper · ORCID
classification cs.CVcs.GRcs.HC
keywords manifoldlearninghumanmotiongenerationphasesynthesischaractercontrolin-betweeningdeep
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper is a review of how manifold learning is applied to human motion generation. Its central claim is that motion data, though high-dimensional, lives on a low-dimensional manifold of valid movements, and that learning this manifold makes synthesis, control, and interpolation more natural and cheaper to compute. The authors present this as one of the first surveys to organize the field around motion manifolds, covering classical methods like PCA and GPLVM alongside deep-learning approaches such as convolutional autoencoders and phase manifolds. If the survey's coverage is right, it provides a useful map of an emerging approach to lifelike animation.

What carries the argument

The central object is the motion manifold, defined as a low-dimensional subspace of valid motion inside the full space of joint-angle and position vectors. Because the manifold is learned from motion capture actors, it carries the constraints of bone lengths and joint rotations, making movements on the manifold natural. A related object is the phase manifold, which describes alterations of motion phase over time and is used for aligning and transitioning between different motions. The survey traces how these manifolds are learned—by PCA, GPLVM, convolutional autoencoders, and periodic autoencoders—and how they carry the tasks of synthesis, control, and in-betweening.

What would settle it

A systematic literature search that turns up earlier surveys or major unmentioned manifold-motion methods would undercut the 'one of the first' and comprehensiveness claims; a benchmark where non-manifold generative models match or beat manifold-based ones on synthesis, control, and in-betweening would refute the claimed advantages.

Watch

Extended reading notes

Core claim

The paper's central claim is that the motion manifold—the subspace of valid motion within the entire space of possible poses—is a powerful organizing concept for human motion generation. Learning this manifold from motion capture data reduces dimensionality and filters out unnatural poses, so that interpolation, synthesis, and real-time control can operate on smooth, realistic trajectories. The survey reviews methods that extract these manifolds, from PCA and GPLVM to convolutional autoencoders and periodic autoencoders for phase manifolds, and it argues that the main open challenge is encoding external factors such as text, scenes, and other characters into the manifold space.

Load-bearing premise

The survey's usefulness rests on the authors having correctly and comprehensively read and summarized the prior work on motion manifolds; missing or mischaracterized key papers would collapse its value as a review.

Editorial extensions

If this is right

  • Motion generation systems should operate in the learned manifold rather than the raw pose space, reducing unnatural frame-to-frame jumps.
  • Real-time character controllers can be built directly on the manifold, cutting computation while keeping motion fluidity.
  • Motion in-betweening can be done by interpolating on the manifold, avoiding the artifacts of linear keyframe interpolation.
  • Phase manifolds provide a natural way to align and transition between motion categories, enabling smooth walking-to-running style changes.
  • The next frontier is encoding text, scene, and interaction constraints into the manifold, which current methods handle poorly.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • One testable extension the survey leaves implicit: if the manifold hypothesis holds, a single manifold learned from a large diverse dataset should transfer to new character proportions or styles with minimal fine-tuning.
  • Phase manifolds could serve as a compact conditioning signal for diffusion-based motion generators, potentially reducing sampling cost while preserving temporal coherence; the survey does not explore this combination.
  • A quantitative benchmark comparing manifold-based and non-manifold generators on identical tasks and datasets would sharpen the qualitative claims the survey makes.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This manuscript is a survey of manifold learning applied to human motion generation. It defines motion manifolds, describes methods for learning them from motion capture data (PCA, GPLVM, autoencoders, phase manifolds), and reviews how manifolds are used in motion synthesis, motion control, and motion in-betweening. The paper claims to provide a comprehensive overview and to be one of the first surveys in this specific domain. It concludes that manifolds offer advantages in dimensionality reduction and naturalness but face limitations in encoding environmental interactions, and suggests future work on embedding external factors into manifolds.

Significance. If the survey were accurate and comprehensive, it would fill a useful niche by organizing a growing body of work that connects differential geometry and manifold learning with deep generative models for human motion. The paper collects a substantial reference list, draws attention to a relevant set of methods (including phase-functioned neural networks, periodic autoencoders, and manifold-aware GANs), and outlines a plausible research agenda around encoding external constraints into manifolds. However, the value of a survey depends entirely on the reliability of its technical descriptions and the defensibility of its coverage. Because the phase-manifold equations are garbled and the attribution of prior work is inconsistent, the survey as currently written cannot serve as a trustworthy reference. No code or machine-checked artifacts are involved; the contribution is purely organizational.

major comments (3)
  1. [Section 2.2, Eqs. (1)-(4)] The mathematical presentation of phase manifolds is unreliable. Equations (3) and (4) are verbatim duplicates, and the text states that 'A is amplitude, F is frequency, B is offset, S is phase shift' but neither F nor B appears in any of the equations; Eq. (3) introduces (sx, sy) and an undefined L_i without explaining how they relate to the phase features of Eqs. (1)-(2). A reader cannot reproduce or verify the phase manifold construction from this text. In addition, the surrounding text attributes the phase manifold to ref. [20] (Holden et al. 2016), which does not introduce phase manifolds; phase manifolds were introduced in later works such as refs. [19] and [59]. This misattribution is a substantive error for a survey.
  2. [Abstract and Sections 3-4] The claims that the paper is 'comprehensive' and 'one of the first in this domain' are not supported by any stated survey methodology. The paper does not describe a search protocol, inclusion/exclusion criteria, or a comparison with existing surveys (e.g., ref. [76], 'Human Motion Generation: A Survey'). Without such information, the reader cannot assess whether the selection of papers is representative or whether the 'first' claim is accurate; this directly affects the central value of the manuscript as a survey.
  3. [Section 2.2, definition of manifold] The phrase 'homomorphic to Euclidean space' is mathematically incorrect; the intended term is 'homeomorphic.' While this is a terminology issue, it appears in the core definition and should be corrected.
minor comments (5)
  1. [Section 2.2, second paragraph] The sentence 'If we consider the entire three-dimensional space as motion space. Motion manifold is the surface of the ball in the space' is a sentence fragment; it should read something like 'If we consider the entire three-dimensional space as motion space, the motion manifold is the surface of the ball in that space.'
  2. [Section 2.2, phase manifold paragraph] The text refers to 'like Figure 2(b)' when describing phase changes of hands and legs, but Figure 2(b) illustrates rotation-based pose representations, not a phase manifold; the cross-reference is likely incorrect.
  3. [Section 4.1] The author name 'Baptiste Chopin' should be followed by 'et al.' when citing the team (ref. [6]); similarly, several citations omit 'et al.' inconsistently.
  4. [Section 5] The sentence 'In future work, I believe the direction is...' uses first person singular in a multi-author survey; prefer 'we believe' or 'the authors believe.'
  5. [References] Reference [17] lists the author as 'Hodgins, C.M.U.'; the CMU motion capture database should be credited to Carnegie Mellon University (or the appropriate lab).

Circularity Check

0 steps flagged · score 1.0 of 10

No circular derivation: the survey synthesizes external prior work; §2.2 citation and formula errors are reliability defects, not circularity.

full rationale

This is a literature survey, not a derivation paper. Its central claim—that manifold learning can reduce dimensionality and capture subspaces of effective motion for human motion generation—is supported by citing prior methods, not by fitting parameters to data and then repredicting them. No fitted input is renamed as a prediction, no uniqueness theorem is imported from the authors, and the authors do not cite their own prior work as load-bearing evidence. The phase-manifold equations in Section 2.2 are copied from the external literature; while Eq. (3) and Eq. (4) are printed identically and the attribution to ref. [20] is incorrect, this is a technical/citation error and not a circular reduction, because the survey uses these equations only as background and does not rest a new conclusion on them. Section 5 also openly acknowledges the manifold limitation with environment interactions, which is a limitation statement rather than a circular move. The 'one of the first' and 'comprehensive' claims depend on an unstated literature-selection protocol, which is a correctness or verifiability concern, not a circularity concern. Overall, the survey's content is self-contained against external benchmarks and does not reduce to its own definitions or citations.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The survey itself does not introduce free parameters or invented entities. It relies on the domain assumption that motion data lie on a low-dimensional manifold and on the accuracy of its summaries of prior work.

assumptions (2)
  • domain assumption Human motion capture data lie on a low-dimensional manifold that captures valid poses and movements.
    Stated in Section 2.2 as the basis for the entire survey. If motion data do not admit a low-dimensional manifold structure, the reviewed methods lose their justification.
  • domain assumption The reviewed methods and equations are accurately reproduced from the cited sources.
    The survey relies on the correctness of its summaries. The presence of undefined variables in Eq. 1-4 suggests this assumption is not fully met.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Motion Generation Review: Exploring Deep Learning for Lifelike Animation with Manifold." pith.science (2026). https://pith.science/paper/43WLPNQA

@misc{pith2026241210458,
  author       = {Pith},
  title        = {Pith review of: Motion Generation Review: Exploring Deep Learning for Lifelike Animation with Manifold},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/43WLPNQA}},
  note         = {Machine review of arXiv:2412.10458}
}
read the original abstract

Human motion generation involves creating natural sequences of human body poses, widely used in gaming, virtual reality, and human-computer interaction. It aims to produce lifelike virtual characters with realistic movements, enhancing virtual agents and immersive experiences. While previous work has focused on motion generation based on signals like movement, music, text, or scene background, the complexity of human motion and its relationships with these signals often results in unsatisfactory outputs. Manifold learning offers a solution by reducing data dimensionality and capturing subspaces of effective motion. In this review, we present a comprehensive overview of manifold applications in human motion generation, one of the first in this domain. We explore methods for extracting manifolds from unstructured data, their application in motion generation, and discuss their advantages and future directions. This survey aims to provide a broad perspective on the field and stimulate new approaches to ongoing challenges.

Figures

Figures reproduced from arXiv: 2412.10458 by the authors.

Figure 1
Figure 1. The typical concept of learning manifold from motion and motion generating with manifold has been proposed in the recent twenty years. motions mimic the fluidity and naturalness of real-world movements. This not only enhances the immersion but also elevates user interaction in these vir￾tual worlds. Traditionally, Motion Capture (MOCAP) has been the dominant method for producing high-quality motion sequences.[77,41]… view at source ↗
Figure 2
Figure 2. Typical human pose and shape representations in (a) keypoint-based and (b) rotation-based (c) Find a valid motion in the entire motion space. A point and B point represent two statuses, there are many different motions between A and B like green lines, only the motion on the surface is valid like the red line. Diffusion Models[16]. Each of these techniques brings unique advantages. For example, GANs[11] enable the g… view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward

    cs.CV 2025-05 conditional novelty 3.0 of 10

    A survey paper reviews multimodal generative AI and autoregressive LLMs for text-driven human motion generation, with comparative tables of models, datasets, and metrics.

Reference graph

Works this paper leans on

76 extracted references · 34 canonical work pages · cited by 1 Pith paper

  1. [20]

    ACM Transactions on Graphics35(4), 1–11 (Jul 2016)

    Holden, D., Saito, J., Komura, T.: A deep learning framework for character motion synthesis and editing. ACM Transactions on Graphics35(4), 1–11 (Jul 2016). https://doi.org/10.1145/2897824.2925975, https://dl.acm.org/doi/ 10.1145/2897824.2925975

    arXiv 2016

  2. [59]

    Proceedings of the ACM on Computer Graphics and Inter- active Techniques 6(3), 1–17 (Aug 2023)

    Starke, P., Starke, S., Komura, T., Steinicke, F.: Motion In-Betweening with Phase Manifolds. Proceedings of the ACM on Computer Graphics and Inter- active Techniques 6(3), 1–17 (Aug 2023). https://doi.org/10.1145/3606921, https://dl.acm.org/doi/10.1145/3606921

    doi:10.1145/3606921 2023

  3. [76]

    Zhu, W., Ma, X., Liu, Z., Liu, L., Wu, W., Wang, Y.: MotionBERT: A Uni- fied Perspective on Learning Human Motion Representations (Aug 2023),http: //arxiv.org/abs/2210.06551, arXiv:2210.06551 [cs]

    arXiv 2023

  4. [19]

    ACM Transactions on Graphics 36(4), 1–13 (Aug 2017)

    Holden, D., Komura, T., Saito, J.: Phase-functioned neural networks for character control. ACM Transactions on Graphics 36(4), 1–13 (Aug 2017). https://doi.org/10.1145/3072959.3073663, https://dl.acm.org/doi/ 10.1145/3072959.3073663

    arXiv 2017

  5. [1]

    05298, arXiv:1710.05298 [cs]

    Ahn, H., Ha, T., Choi, Y., Yoo, H., Oh, S.: Text2Action: Generative Adversar- ial Synthesis from Language to Action (Oct 2017),http://arxiv.org/abs/1710. 05298, arXiv:1710.05298 [cs]

    arXiv 2017

  6. [2]

    Ahuja, C., Morency, L.P.: Language2Pose: Natural Language Grounded Pose Fore- casting (Nov 2019),http://arxiv.org/abs/1907.01108, arXiv:1907.01108 [cs]

    arXiv 2019

  7. [4]

    Academic press (2011)

    Bishop, R.L., Crittenden, R.J.: Geometry of Manifolds: Geometry of Manifolds. Academic press (2011)

    work page 2011

  8. [5]

    ACM Trans

    Chai, J., Hodgins, J.K.: Performance animation from low-dimensional control sig- nals. ACM Trans. Graph.24(3), 686–696 (Jul 2005).https://doi.org/10.1145/ 1073204.1073248, https://doi.org/10.1145/1073204.1073248

    arXiv 2005

Show all 76 references
  1. [6]

    08715, arXiv:2105.08715 [cs]

    Chopin, B., Otberdout, N., Daoudi, M., Bartolo, A.: Human Motion Prediction Us- ing Manifold-Aware Wasserstein GAN (Jul 2021),http://arxiv.org/abs/2105. 08715, arXiv:2105.08715 [cs]

    2021 arXiv

  2. [7]

    In: Proceed- ings of the IEEE/CVF Winter Conference on Applications of Computer Vision

    Degardin, B., Neves, J., Lopes, V., Brito, J., Yaghoubi, E., Proença, H.: Generative adversarial graph convolutional networks for human action synthesis. In: Proceed- ings of the IEEE/CVF Winter Conference on Applications of Computer Vision. pp. 1150–1159 (2022) Exploring Deep...

    2022

  3. [8]

    In: 2015 IEEE International Conference on Computer Vision (ICCV)

    Fragkiadaki, K., Levine, S., Felsen, P., Malik, J.: Recurrent Network Models for Human Dynamics. In: 2015 IEEE International Conference on Computer Vision (ICCV). pp. 4346–4354. IEEE, Santiago, Chile (Dec 2015).https://doi.org/10. 1109/ICCV.2015.494, http://ieeexplore.ieee.org...

    2015

  4. [9]

    In: 2009 IEEE Con- ference on Computer Vision and Pattern Recognition

    Gall, J., Stoll, C., De Aguiar, E., Theobalt, C., Rosenhahn, B., Seidel, H.P.: Motion capture using joint skeleton tracking and surface estimation. In: 2009 IEEE Con- ference on Computer Vision and Pattern Recognition. pp. 1746–1753. Ieee (2009)

    2009

  5. [10]

    In: Proceedings of the IEEE/CVF international conference on computer vision

    Ghosh, A., Cheema, N., Oguz, C., Theobalt, C., Slusallek, P.: Synthesis of compo- sitional animations from textual descriptions. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 1396–1406 (2021)

    2021

  6. [11]

    Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial networks. Commun. ACM 63(11), 139–144 (Oct 2020). https://doi.org/10.1145/3422622, https://doi. org/10.1145/3422622

    2020 doi

  7. [12]

    In: ACM SIGGRAPH 2004 Papers

    Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. In: ACM SIGGRAPH 2004 Papers. pp. 522–531. ACM, Los Ange- les California (Aug 2004). https://doi.org/10.1145/1186562.1015755, https: //dl.acm.org/doi/10.1145/1186562.1015755

    2004

  8. [13]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Guo, C., Zou, S., Zuo, X., Wang, S., Ji, W., Li, X., Cheng, L.: Generating di- verse and natural 3d human motions from text. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 5152–5161 (2022)

    2022

  9. [14]

    In: Procedings of the British Ma- chine Vision Conference 2017

    Habibie, I., Holden, D., Schwarz, J., Yearsley, J., Komura, T.: A Recurrent Varia- tional Autoencoder for Human Motion Synthesis. In: Procedings of the British Ma- chine Vision Conference 2017. p. 119. British Machine Vision Association, London, UK (2017). https://doi.org/10.5...

    2017 doi

  10. [15]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Hassan, M., Ghosh, P., Tesch, J., Tzionas, D., Black, M.J.: Populating 3D scenes by learning human-scene interaction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 14708–14718 (2021)

    2021

  11. [16]

    Ho, J., Jain, A., Abbeel, P.: Denoising Diffusion Probabilistic Models (Dec 2020), http://arxiv.org/abs/2006.11239, arXiv:2006.11239 [cs, stat]

    2020 arXiv

  12. [17]

    cmu.edu/ (2015)

    Hodgins, C.M.U.: Cmu graphics lab motion capture database.http://mocap.cs. cmu.edu/ (2015)

    2015

  13. [18]

    Holden, D.: Reducing animator keyframes. Ph.D. thesis, The University of Edin- burgh (2017)

    2017

  14. [21]

    In: SIGGRAPH Asia 2015 Technical Briefs

    Holden, D., Saito, J., Komura, T., Joyce, T.: Learning motion manifolds with convolutional autoencoders. In: SIGGRAPH Asia 2015 Technical Briefs. pp. 1–

    2015

  15. [22]

    ACM, Kobe Japan (Nov 2015).https://doi.org/10.1145/2820903.2820918, https://dl.acm.org/doi/10.1145/2820903.2820918

    2015

  16. [23]

    Huang, S., Wang, Z., Li, P., Jia, B., Liu, T., Zhu, Y., Liang, W., Zhu, S.C.: Diffusion-based Generation, Optimization, and Planning in 3D Scenes (Jan 2023), http://arxiv.org/abs/2301.06015, arXiv:2301.06015 [cs] 14 Zhao. et al

    2023 arXiv

  17. [24]

    6m: Large scale datasets and predictive methods for 3d human sensing in natural environments

    Ionescu, C., Papava, D., Olaru, V., Sminchisescu, C.: Human3. 6m: Large scale datasets and predictive methods for 3d human sensing in natural environments. IEEE transactions on pattern analysis and machine intelligence36(7), 1325–1339 (2013)

    2013

  18. [25]

    Computer Graphics Forum39(6), 314–324 (Sep 2020).https://doi.org/ 10.1111/cgf.14028, http://arxiv.org/abs/2005.14370, arXiv:2005.14370 [cs]

    Jang, D.K., Lee, S.H.: Constructing Human Motion Manifold with Sequential Net- works. Computer Graphics Forum39(6), 314–324 (Sep 2020).https://doi.org/ 10.1111/cgf.14028, http://arxiv.org/abs/2005.14370, arXiv:2005.14370 [cs]

    2020 arXiv

  19. [26]

    Jiang, B., Chen, X., Liu, W., Yu, J., Yu, G., Chen, T.: MotionGPT: Human Motion as a Foreign Language (Jul 2023), http://arxiv.org/abs/2306.14795, arXiv:2306.14795 [cs]

    2023 arXiv

  20. [27]

    Karras, T., Aila, T., Laine, S., Lehtinen, J.: Progressive Growing of GANs for Improved Quality, Stability, and Variation (Feb 2018),http://arxiv.org/abs/ 1710.10196, arXiv:1710.10196 [cs, stat]

    2018 arXiv

  21. [28]

    IEEE Trans

    Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adversarial networks. IEEE Trans. Pattern Anal. Mach. Intell.43(12), 4217–4228 (Dec 2021). https://doi.org/10.1109/TPAMI.2020.2970919, https://doi.org/ 10.1109/TPAMI.2020.2970919

    2021

  22. [29]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., Aila, T.: Analyzing and improving the image quality of stylegan. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 8110–8119 (2020)

    2020

  23. [30]

    arXiv preprint arXiv:1312.6114 (2013)

    Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)

    2013 arXiv

  24. [31]

    ACM Trans

    Kovar, L., Gleicher, M.: Automated extraction and parameterization of motions in large data sets. ACM Trans. Graph.23(3), 559–568 (Aug 2004).https://doi. org/10.1145/1015706.1015760, https://doi.org/10.1145/1015706.1015760

    2004

  25. [32]

    21(3),473– 482(Jul2002)

    Kovar,L.,Gleicher,M.,Pighin,F.:Motiongraphs.ACMTrans.Graph. 21(3),473– 482(Jul2002). https://doi.org/10.1145/566654.566605, https://doi.org/10. 1145/566654.566605, place: New York, NY, USA Publisher: Association for Com- puting Machinery

  26. [33]

    In: Advances in Neural Information Processing Systems

    Lawrence, N.: Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data. In: Advances in Neural Information Processing Systems. vol. 16. MIT Press (2003),https://proceedings.neurips.cc/paper_files/paper/2003/ hash/9657c1fffd38824e5ab0472e022e577e-Abstract.html

    2003

  27. [34]

    In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

    Le, N., Pham, T., Do, T., Tjiputra, E., Tran, Q.D., Nguyen, A.: Music-Driven Group Choreography. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp. 8673–8682. IEEE, Vancouver, BC, Canada (Jun 2023). https://doi.org/10.1109/CVPR52729.2023.00838,...

    2023

  28. [35]

    Lee, J.M.: Manifolds and differential geometry, vol. 107. American Mathematical Society (2022)

    2022

  29. [36]

    In: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

    Lee, J., Chai, J., Reitsma, P.S., Hodgins, J.K., Pollard, N.S.: Interactive control of avatars animated with human motion data. In: Proceedings of the 29th annual conference on Computer graphics and interactive techniques. pp. 491–500 (2002). https://doi.org/10.1145/566570.566607

    2002

  30. [37]

    ACM Trans

    Lee, Y., Wampler, K., Bernstein, G., Popović, J., Popović, Z.: Motion fields for interactive character locomotion. ACM Trans. Graph. 29(6) (Dec 2010). https://doi.org/10.1145/1882261.1866160, https://doi.org/10.1145/ 1882261.1866160

    2010

  31. [38]

    ACM Transactions on Graphics30(3), 1–11 (May Exploring Deep Learning for Lifelike Animation with Manifold 15 2011)

    Levine, S., Lee, Y., Koltun, V., Popović, Z.: Space-time planning with parame- terized locomotion controllers. ACM Transactions on Graphics30(3), 1–11 (May Exploring Deep Learning for Lifelike Animation with Manifold 15 2011). https://doi.org/10.1145/1966394.1966402, https://d...

    2011

  32. [39]

    ACM Transactions on Graphics31(4), 1–10 (Aug 2012).https://doi.org/10.1145/2185520.2185524, https://dl.acm

    Levine, S., Wang, J.M., Haraux, A., Popović, Z., Koltun, V.: Continuous character control with low-dimensional embeddings. ACM Transactions on Graphics31(4), 1–10 (Aug 2012).https://doi.org/10.1145/2185520.2185524, https://dl.acm. org/doi/10.1145/2185520.2185524

    2012

  33. [40]

    In: Proceedings of the IEEE/CVF International Conference on Computer Vision

    Li, R., Yang, S., Ross, D.A., Kanazawa, A.: Ai choreographer: Music conditioned 3d dance generation with aist++. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 13401–13412 (2021)

    2021

  34. [41]

    IEEE trans- actions on pattern analysis and machine intelligence42(10), 2684–2701 (2019)

    Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.Y., Kot, A.C.: Ntu rgb+ d 120: A large-scale benchmark for 3d human activity understanding. IEEE trans- actions on pattern analysis and machine intelligence42(10), 2684–2701 (2019)

    2019

  35. [42]

    In: CVPR 2011

    Liu, Y., Stoll, C., Gall, J., Seidel, H.P., Theobalt, C.: Markerless motion capture of interacting characters using multi-view image segmentation. In: CVPR 2011. pp. 1249–1256. Ieee (2011)

    2011

  36. [43]

    ACM Trans

    Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., Black, M.J.: Smpl: a skinned multi-person linear model. ACM Trans. Graph.34(6) (Oct 2015). https://doi. org/10.1145/2816795.2818013, https://doi.org/10.1145/2816795.2818013

    2015

  37. [44]

    Lucas, T., Baradel, F., Weinzaepfel, P., Rogez, G.: PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting (Oct 2022),http://arxiv.org/ abs/2210.10542, arXiv:2210.10542 [cs]

    2022 arXiv

  38. [45]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Ma, X., Su, J., Wang, C., Zhu, W., Wang, Y.: 3d human mesh estimation from virtual markers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 534–543 (2023)

    2023

  39. [46]

    ACM Transactions on Graphics 31(6), 1–12 (Nov 2012)

    Min, J., Chai, J.: Motion graphs++: a compact generative model for seman- tic motion analysis and synthesis. ACM Transactions on Graphics 31(6), 1–12 (Nov 2012). https://doi.org/10.1145/2366145.2366172, https://dl.acm.org/ doi/10.1145/2366145.2366172

    2012

  40. [47]

    Computer vision and image understanding 104(2-3), 90–126 (2006)

    Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Computer vision and image understanding 104(2-3), 90–126 (2006)

    2006

  41. [48]

    https://doi.org/10.1007/ 978-3-030-58539-6_36, http://arxiv.org/abs/2008.08535, arXiv:2008.08535 [cs]

    Osman, A.A.A., Bolkart, T., Black, M.J.: STAR: Sparse Trained Ar- ticulated Human Body Regressor (Aug 2020). https://doi.org/10.1007/ 978-3-030-58539-6_36, http://arxiv.org/abs/2008.08535, arXiv:2008.08535 [cs]

    2020 arXiv

  42. [49]

    In: 2019 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR)

    Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A.A., Tzionas, D., Black, M.J.: Expressive Body Capture: 3D Hands, Face, and Body From a Single Image. In: 2019 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR). pp. 10967–10977. IEEE, Long Bea...

    2019

  43. [51]

    ACM Transactions on Graphics 40(4), 1–20 (Aug 2021).https://doi.org/10.1145/3450626.3459670, https:// dl.acm.org/doi/10.1145/3450626.3459670 16 Zhao

    Peng, X.B., Ma, Z., Abbeel, P., Levine, S., Kanazawa, A.: AMP: adversarial motion priors for stylized physics-based character control. ACM Transactions on Graphics 40(4), 1–20 (Aug 2021).https://doi.org/10.1145/3450626.3459670, https:// dl.acm.org/doi/10.1145/3450626.3459670 1...

    2021

  44. [52]

    Petrovich, M., Black, M.J., Varol, G.: Action-Conditioned 3D Human Motion Synthesis with Transformer VAE (Sep 2021),http://arxiv.org/abs/2104.05670, arXiv:2104.05670 [cs]

    2021 arXiv

  45. [53]

    Petrovich, M., Black, M.J., Varol, G.: TEMOS: Generating diverse human mo- tions from textual descriptions (Jul 2022), http://arxiv.org/abs/2204.14109, arXiv:2204.14109 [cs] version: 2

    2022 arXiv

  46. [54]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Raab, S., Leibovitch, I., Li, P., Aberman, K., Sorkine-Hornung, O., Cohen-Or, D.: Modi: Unconditional motion synthesis from diverse data. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 13873– 13883 (2023)

    2023

  47. [55]

    IEEE Computer Graphics and Applications 18(5), 32– 40 (Oct 1998).https://doi.org/10.1109/38.708559, http://ieeexplore.ieee

    Rose, C., Cohen, M., Bodenheimer, B.: Verbs and adverbs: multidimensional motion interpolation. IEEE Computer Graphics and Applications 18(5), 32– 40 (Oct 1998).https://doi.org/10.1109/38.708559, http://ieeexplore.ieee. org/document/708559/

    1998 doi

  48. [56]

    arXiv preprint arXiv:2303.01418 (2023)

    Shafir, Y., Tevet, G., Kapon, R., Bermano, A.H.: Human motion diffusion as a generative prior. arXiv preprint arXiv:2303.01418 (2023)

    2023 arXiv

  49. [57]

    In: Proceedings of the 30th International Conference on Neu- ral Information Processing Systems

    Sønderby, C.K., Raiko, T., Maaløe, L., Sønderby, S.K., Winther, O.: Ladder varia- tional autoencoders. In: Proceedings of the 30th International Conference on Neu- ral Information Processing Systems. p. 3745–3753. NIPS’16, Curran Associates Inc., Red Hook, NY, USA (2016)

    2016

  50. [58]

    arXiv preprint arXiv:2011.13456 (2020)

    Song, Y., Sohl-Dickstein, J., Kingma, D.P., Kumar, A., Ermon, S., Poole, B.: Score- based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 (2020)

    2020 arXiv

  51. [60]

    ACM Transactions on Graphics 41(4), 1–13 (Jul 2022)

    Starke, S., Mason, I., Komura, T.: DeepPhase: periodic autoencoders for learn- ing motion phase manifolds. ACM Transactions on Graphics 41(4), 1–13 (Jul 2022). https://doi.org/10.1145/3528223.3530178, https://dl.acm.org/doi/ 10.1145/3528223.3530178

    2022

  52. [61]

    ACM Transactions on Graphics 40(4), 1–16 (Aug 2021)

    Starke, S., Zhao, Y., Zinno, F., Komura, T.: Neural animation layering for syn- thesizing martial arts movements. ACM Transactions on Graphics 40(4), 1–16 (Aug 2021). https://doi.org/10.1145/3450626.3459881, https://dl.acm.org/ doi/10.1145/3450626.3459881

    2021

  53. [62]

    Reinforcement learning: An introduction pp

    Sutton, R.S., Barto, A.G.: The reinforcement learning problem. Reinforcement learning: An introduction pp. 51–85 (1998)

    1998

  54. [63]

    In: Proceedings of the 26th ACM interna- tional conference on Multimedia

    Tang, T., Jia, J., Mao, H.: Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis. In: Proceedings of the 26th ACM interna- tional conference on Multimedia. pp. 1598–1606. ACM, Seoul Republic of Korea (Oct 2018). https://doi.org/10.1145/3240508.3240...

    2018

  55. [64]

    In: Special Interest Group on Computer Graphics and Interactive Techniques Con- ference Conference Proceedings

    Tessler, C., Kasten, Y., Guo, Y., Mannor, S., Chechik, G., Peng, X.B.: CALM: Conditional Adversarial Latent Models for Directable Virtual Characters. In: Special Interest Group on Computer Graphics and Interactive Techniques Con- ference Conference Proceedings. pp. 1–9. ACM, L...

    2023

  56. [65]

    Tevet, G., Raab, S., Gordon, B., Shafir, Y., Cohen-Or, D., Bermano, A.H.: Hu- man Motion Diffusion Model (Oct 2022), http://arxiv.org/abs/2209.14916, arXiv:2209.14916 [cs] Exploring Deep Learning for Lifelike Animation with Manifold 17

    2022 arXiv

  57. [66]

    In: An Introduction to Manifolds, pp

    Tu, L.W.: Manifolds. In: An Introduction to Manifolds, pp. 47–83. Springer (2011)

    2011

  58. [67]

    Advances in neural information processing systems30 (2017)

    Van Den Oord, A., Vinyals, O., et al.: Neural Discrete Representation Learning. Advances in neural information processing systems30 (2017)

    2017

  59. [68]

    Wang, H., Ho, E.S.L., Shum, H.P.H., Zhu, Z.: Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling (Aug 2019),http://arxiv.org/ abs/1908.07214, arXiv:1908.07214 [cs]

    2019 arXiv

  60. [69]

    In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

    Xu, H., Bazavan, E.G., Zanfir, A., Freeman, W.T., Sukthankar, R., Smin- chisescu, C.: GHUM & GHUML: Generative 3D Human Shape and Articu- lated Pose Models. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp. 6183–6192. IEEE, Seattle, WA, USA (J...

    2020

  61. [70]

    Yu, P., Zhao, Y., Li, C., Yuan, J., Chen, C.: Structure-Aware Human-Action Gener- ation (Aug 2020),http://arxiv.org/abs/2007.01971, arXiv:2007.01971 [cs, stat]

    2020 arXiv

  62. [71]

    In: PG (Short Papers, Posters, and Work-in- Progress Papers)

    Zeng, R., Dai, J., Bai, J., Pan, J., Qin, H.: Human motion synthesis and control via contextual manifold embedding. In: PG (Short Papers, Posters, and Work-in- Progress Papers). pp. 25–30 (2021)

    2021

  63. [72]

    IEEE Trans

    Zhang, M., Cai, Z., Pan, L., Hong, F., Guo, X., Yang, L., Liu, Z.: Motiondiffuse: Text-driven human motion generation with diffusion model. IEEE Trans. Pat- tern Anal. Mach. Intell.46(6), 4115–4128 (Jan 2024).https://doi.org/10.1109/ TPAMI.2024.3355414, https://doi.org/10.1109...

    2024

  64. [73]

    Zhang, M., Guo, X., Pan, L., Cai, Z., Hong, F., Li, H., Yang, L., Liu, Z.: ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model (Apr 2023), http: //arxiv.org/abs/2304.01116, arXiv:2304.01116 [cs]

    2023 arXiv

  65. [74]

    Zhang, S., Zhang, Y., Ma, Q., Black, M.J., Tang, S.: PLACE: Proximity Learning of Articulation and Contact in 3D Environments (Nov 2020),http://arxiv.org/ abs/2008.05570, arXiv:2008.05570 [cs]

    2020 arXiv

  66. [75]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Zhang, Y., Black, M.J., Tang, S.: We are more than our joints: Predicting how 3d bodies move. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 3372–3382 (2021)

    2021

  67. [77]

    10894, arXiv:2307.10894 [cs]

    Zhu, W., Ma, X., Ro, D., Ci, H., Zhang, J., Shi, J., Gao, F., Tian, Q., Wang, Y.: Human Motion Generation: A Survey (Nov 2023),http://arxiv.org/abs/2307. 10894, arXiv:2307.10894 [cs]

    2023 arXiv

  68. [78]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Zuo, C., Wang, Y., Zhan, L., Guo, S., Yi, X., Xu, F., Qin, Y.: Loose inertial poser: Motion capture with imu-attached loose-wear jacket. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 2209– 2219 (2024)

    2024

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.