pith. sign in

arxiv: 2312.04036 · v1 · pith:GW5FYSKQnew · submitted 2023-12-07 · 💻 cs.CV · cs.LG

DiffusionPhase: Motion Diffusion in Frequency Domain

classification 💻 cs.CV cs.LG
keywords motionsequencesdescriptionsgeneratingmotionsspacetexttransitions
0
0 comments X
read the original abstract

In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in generating arbitrary-length motion sequences, due to limited text-to-motion datasets and the pose representations used that often lack expressiveness or compactness. To address these issues, we propose the first method for text-conditioned human motion generation in the frequency domain of motions. We develop a network encoder that converts the motion space into a compact yet expressive parameterized phase space with high-frequency details encoded, capturing the local periodicity of motions in time and space with high accuracy. We also introduce a conditional diffusion model for predicting periodic motion parameters based on text descriptions and a start pose, efficiently achieving smooth transitions between motion sequences associated with different text descriptions. Experiments demonstrate that our approach outperforms current methods in generating a broader variety of high-quality motions, and synthesizing long sequences with natural transitions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning

    cs.CV 2026-05 unverdicted novelty 5.0

    OmniME integrates retrospective feature supervision, motion preservation, and triplet semantic alignment to achieve state-of-the-art text-motion editing alignment on MotionFix and STANCE datasets.