Pith. sign in

AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

Conditional human motion generation remains a fundamental challenge in computer vision and robotics. Despite significant progress, current methods are often constrained by fixed modality configurations and task-specific architectures, leaving cross-modal interactions and the scaling laws of multimodal-conditioned synthesis largely underexplored. A key bottleneck is the scarcity of large-scale modality-aligned motion data, limiting generalization across diverse control signals. In this work, we introduce OmniHuMo, a large-scale, high-quality dataset comprising over 5,000 hours of motion and 3.2 million sequences with precisely aligned multimodal annotations (e.g., text, speech, music, and trajectory). Leveraging OmniHuMo, we propose AnyMo, a unified multimodal framework combining a Residual FSQ-based motion tokenizer with a scalable masked modeling transformer, enabling high-quality motion synthesis under arbitrary modality combinations. Extensive experiments show that AnyMo achieves high-fidelity synthesis while offering flexible control over both spatial and stylistic attributes.

fields

cs.RO 1

years

2026 1

verdicts

CONDITIONAL 1

representative citing papers

citing papers explorer

Showing 1 of 1 citing paper.

  • DigitCode: Symbolic Tokenization of Hand Motion by Anatomical Units cs.RO · 2026-08-04 · conditional · none · ref 17 · internal anchor

    DigitCode tokenizes hand motion by anatomical units, showing the token span (bone/finger/hand) matters more than the quantizer family, and reduces symbolic reconstruction error by about three quarters.