Pith. sign in

REVIEW 4 major objections 5 minor 36 references

Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation

T0 review · 4 major / 5 minor · reviewed 2026-08-02 · deepseek-v4-flash

Pith's one-line read A hierarchical global-to-local pipeline lets a diffusion model generate coherent dance videos of over a minute from music alone.

desk verdict Plausible hierarchical framework for minute-scale dance video, but the inference protocol as written cannot produce the claimed durations and the optical-flow loss is mis-specified; evaluation is thin. read the letter →

arxiv 2607.09581 v3 pith:PIEIHLAX submitted 2026-07-10 cs.CV cs.SD

classification cs.CVcs.SD
keywords music-to-dancegenerationvideodiffusionhierarchicalkeyframeplanningopticalflowlossdynamicframerateRoPEembeddingslong-formsynthesis
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper aims to break the 20-second ceiling on music-to-dance video generation by splitting the task into a global keyframe planner and a local frame refiner. It claims this hierarchical decoupling, together with time-aware position embeddings, an optical-flow loss, and motion-speed control, yields stable 720p/30fps dance videos over a minute long across five genres. A sympathetic reader would care because long-form coherent dance video from audio has been out of reach; if the claim holds, the approach removes the main temporal bottleneck for end-to-end dance synthesis.

What carries the argument

The load-bearing mechanism is the keyframe mask plus dynamic frame-rate injection: a mask that is all-zero except for sparse anchor frames tells the shared diffusion transformer whether to plan the global structure or refine local motion. Time-mapped RoPE embeddings convey absolute time, letting the same network operate at 3–15 fps and align keyframes to any music duration. The optical-flow loss and motion-speed stratification are supporting controls for detail during fast motion.

What would settle it

Compute w_optical_flow for typical training frames: if it contains values other than 0 and 1, the loss in Eq. (3) does not weight the velocity error as claimed, and the reported optical-flow ablation could be re-run with a true mask to see if the gains vanish.

Watch

Extended reading notes

Core claim

The central claim is that minute-scale coherent music-to-dance video is achievable by a global-to-local decomposition: a sparse global stage plans 38 keyframes across the whole track, and a local stage fills in dense frames around each keyframe, with absolute time injected through time-mapped RoPE embeddings so the model knows the true temporal spacing. The paper reports that this produces temporally stable, identity-consistent videos lasting 60–160 seconds, with rhythmic alignment and genre control.

Load-bearing premise

The optical-flow term in the training loss is assumed to act as a binary mask that focusses the velocity error where motion is large; if it is a continuous multiplier, the loss's optimum would rescale the target velocity and corrupt the very motion it is meant to protect.

Editorial extensions

If this is right

  • If the claim is right, music-to-dance generation no longer needs 3D skeletons or short clips; end-to-end video synthesis can cover full songs.
  • The global keyframes can serve as a parseable choreography sketch, enabling editing and customization (LoRA) without retraining.
  • The dynamic frame-rate trick may extend to other long video generation tasks, not just dance.
  • The measured gains over prior end-to-end methods suggest beat-aligned, prompt-controlled dance video could become a practical creative tool.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The global keyframe stage might be reusable as a standalone choreography planner, decoupling motion semantics from rendering.
  • The optical-flow loss formulation, as written, has an ambiguity that could make the reported gains partly an artifact; a corrected weighting may be needed.
  • The hierarchical scheme suggests a general recipe for taming diffusion drift: plan sparsely, refine locally in parallel; could apply to other long-form conditional generation such as narrated action sequences.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes Wan-Dancer, a hierarchical diffusion framework for music-to-dance video generation. A global stage generates 38 sparse keyframes from full-track music context, and a local stage generates 149-frame clips centered on each keyframe, which are then concatenated. Additional components include dynamic frame-rate RoPE time embeddings, an optical-flow-weighted loss, motion-speed stratification, and LoRA-based choreography customization. The paper claims stable 720p/30fps videos exceeding one minute across five dance genres, with subjective evaluations against X-Dancer and MusicInfuser.

Significance. The hierarchical global-to-local idea is timely and plausible, and the dynamic frame-rate RoPE mechanism is an interesting design choice. If the pipeline actually produced minute-scale coherent videos, this would be a meaningful advance over typical short-window video diffusion. However, as written, the inference assembly is internally inconsistent and cannot reproduce the claimed durations, the optical-flow loss in Eq. (3) is not a valid weighted loss, and the quantitative evaluation relies on mean subjective scores without variance or significance tests. These are load-bearing issues, not presentation concerns. The paper also reports honest limitations (identity consistency, semantic alignment, multi-dancer), which is commendable, but the central claim is currently not reproducible from the method description.

major comments (4)
  1. [§4.1, Model Inference Details and Fig. 2]
  2. [§3.2, Eq. (3)]
  3. [§4.3, Tables 1–3]
  4. [§4.3, Ablation Studies and Figs. 6–7]
minor comments (5)
  1. [Table 1]
  2. [Fig. 2]
  3. [§4.1, Dataset]
  4. [§4.1 and Fig. 7(a)]
  5. [§3.2]

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the derivation chain is not reduced to its inputs; self-citations serve as engineering baselines, not load-bearing assumptions.

full rationale

The paper's derivation chain is a modular pipeline: global keyframe planning from music/text/reference, followed by local interpolation conditioned on those keyframes. Neither stage defines its output in terms of the target video duration or in terms of a fitted parameter that is later relabeled as a prediction. Eq. (3) is an MSE velocity loss; although the optical-flow term is implemented as an elementwise multiplier on the predicted velocity rather than as a true weight (creating a training/inference inconsistency), it is not a circular definition. The self-citations to Wan-I2V [29] and Wan-S2V [7] are used as backbone and music-conditioning components, but the central claim—minute-scale coherence via global-to-local decoupling—is independently engineered and empirically evaluated, not derived from those references. The most serious manuscript flaw is in §4.1 inference assembly: 'comprising 38 frames' and 'clips of 149 frames centered around each keyframe' with 'all generated local video clips are concatenated in order' imply a fixed output length of 38×149/30 ≈ 188.7 s and unspecified heavy overlap for shorter inputs. This is an arithmetic/reproducibility gap, not a circular reduction, so it does not raise the circularity score.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The minute-scale claim rests on hand-chosen hyperparameters (38 keyframes, 149-frame windows, 10/80/10 speed split) and on pretrained Wan-I2V/VAE backbones that are not independently audited here. No new physical entities are introduced; the architectural modules (time-mapped RoPE, music block, keyframe mask) are engineering components, not entities with independent evidence.

free parameters (4)
  • Global keyframe count = 38
    Global stage always outputs 38 keyframes across the full music duration; no formula and no ablation over this count.
  • Local segment length = 149 frames (~5 s at 30 fps)
    Each keyframe is interpolated in a 149-frame window; overlap and concatenation behavior is not specified.
  • Motion-speed tier fractions = 10% slow, 80% medium, 10% high
    Training data are stratified by ViTPose kinematic velocity; this hand-set balance drives the motion-speed-control contribution.
  • LoRA rank = 32
    Used for the choreography customization mode with 16 reference videos; a design choice not justified by comparison.
assumptions (6)
  • standard math Rectified Flow (RF) with linear interpolation xt = t x1 + (1-t) x0 defines a valid generative objective.
    Adopted from [5]; standard background for diffusion training.
  • domain assumption Wan-I2V's pretrained DiT and VAE provide the base video-generation capability and identity-relevant visual features.
    Used throughout §3.1; the paper depends on this backbone's ability to render anthropomorphic motion at 720p.
  • ad hoc to paper A single network trained with random keyframe masks is sufficient to learn both global choreography planning and local interpolation.
    Stated in §3.1 ('flexible masking mechanism ... learn both') without a separate training ablation for global vs. local mask regimes.
  • ad hoc to paper Multiplying the predicted velocity by VAE-encoded optical-flow latents in Eq. (3) constitutes a valid optical-flow-based motion loss.
    No derivation is given; as written it changes the regression target to v_t / w_optical_flow.
  • domain assumption Librosa features plus a lightweight music encoder capture the rhythmic/tempo information needed for synchronization.
    Invoked in §3.1 and §4.1; no ablation/analysis of which acoustic features drive beat alignment.
  • ad hoc to paper 149-frame local clips centered on keyframes can be concatenated in order without boundary artifacts.
    Inference 'Final Assembly' (§4.1) concatenates clips directly; no blending, overlap handling, or keyframe-consistency mechanism is described.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation." pith.science (2026). https://pith.science/paper/PIEIHLAX

@misc{pith2026260709581,
  author       = {Pith},
  title        = {Pith review of: Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PIEIHLAX}},
  note         = {Machine review of arXiv:2607.09581}
}
read the original abstract

Generating long-duration, high-definition, and rhythmically synchronized dance videos directly from music remains a significant challenge, primarily due to the temporal constraints of current diffusion models, which typically fail beyond 20 seconds. Existing approaches, whether they rely on intermediate 3D skeletons or on end-to-end video synthesis, suffer from temporal drift, identity inconsistency, and repetitive motion patterns when extended to longer horizons. To address these limitations, we propose a novel hierarchical framework for minute-scale coherent music-to-dance generation. Our method decouples the process into global keyframe planning and local temporal refinement, leveraging full-track musical context to ensure long-range coherence. Key innovations include dynamic frame rate adaptation via time-mapped RoPE embeddings for precise alignment, an optical-flow-based loss function to enhance motion continuity, and motion-speed control to preserve high-fidelity details during rapid movements. Extensive experiments demonstrate that our framework surpasses the conventional duration barrier, generating stable, 720p/30fps videos exceeding one minute with superior temporal stability. Furthermore, the model exhibits robust versatility across five distinct dance genres, conditioned on both audio and textual prompts, establishing a new state-of-the-art in coherent, long-form dance video synthesis.

Figures

Figures reproduced from arXiv: 2607.09581 by the authors.

Figure 1
Figure 1. Training Pipeline. Our training strategy focuses on optimizing the Diffusion Transformer (DiT) blocks and the Music Encoder. Both the global keyframe generation and local temporal refinement stages adhere to a unified training pipeline. The primary distinction lies in the input video, keyframe mask, prompt, and the target frame rates (fps) specific to each stage’s temporal granularity. To enhance temporal adaptabili… view at source ↗
Figure 2
Figure 2. Inference Pipeline. Initially, the global stage synthesizes a sparse keyframe global video that captures the overall motion structure and rhythmic alignment. Sub￾sequently, this global output serves as a structural guidance condition for the local stage, which interpolates and refines the sequence to generate the final high-frame￾rate, dense video with enhanced temporal coherence and visual detail. Local Frame Gener… view at source ↗
Figure 3
Figure 3. Minute-scale Video Generation. Our framework enables the synthesis of dance videos exceeding one minute in duration across diverse genres. The first row features Chinese Classical dance with fluid movements, the second showcases the energetic rhythms of Latin dance, and the third reflects the unique elements of K-Pop dance. 4.3 Evaluations and Comparisons Quantitative Evaluation. In the music-to-dance generation fie… view at source ↗
Figures from the paper (9 more)
Figure 4
Figure 4. Figure 4: Customized Choreography. Leveraging Low-Rank Adaptation (LoRA), our framework enables the efficient fine-tuning of generative models to mimic specific hu￾man choreographies [PITH_FULL_IMAGE:figures/full_fig_p010_4.png]
Figure 5
Figure 5. Figure 5: Comparison with X-Dancer [3] and MusicInfuser [9]. whereas our framework effectively synthesizes five dance genres based on spe￾cific prompts. Additionally, X-Dancer relies on short, disjointed clips, causing noticeable temporal discontinuities, while our model utilize…
Figure 5
Figure 5. Figure 5: Comparison with X-Dancer [3] and MusicInfuser [9]. Dynamic Frame Rate Injection. This module adjusts the frame rate according to the music sequence’s total duration, integrating this into the Rotary Positional Embedding (RoPE) mechanism [8]. As illustrated in Fig. 7a, …
Figure 6
Figure 6. Figure 6: Comparisons for long-duration comparison and optical flow loss weight. tion. Relying solely on local processing fails to maintain choreographic continu￾ity over longer durations, leading to disjointed segments and significant semantic drift due to error accumulation. A…
Figure 6
Figure 6. Figure 6: Comparisons for long-duration comparison and optical flow loss weight. Collectively, these results validate that each component plays a distinct and synergistic role in achieving high-fidelity, temporally consistent, and stylistically accurate dance video generation. D…
Figure 7
Figure 7. Figure 7: Comparisons for dynamic frame rate adaptation and motion speed. ference through textual prompts. Fig. 7b shows that medium-speed generation strikes the best balance between choreographic rhythm and visual fidelity, while slow or fast sequences are prone to artifacts an…
Figure 7
Figure 7. Figure 7: Comparisons for dynamic frame rate adaptation and motion speed. range coherence and detail preservation during rapid movements. Our experi￾ments demonstrate a breakthrough beyond the 20-second limit, producing stable 720p/30fps videos exceeding one minute while showcas…
Figure 8
Figure 8. Figure 8: We assess the generative diversity of our method through controlled experi￾ments by varying the reference image, music input, and random seed.. 5 Conclusion In conclusion, we have tackled the challenge of generating long-duration, high￾definition, rhythmically synchron…
Figure 8
Figure 8. Figure 8: We assess the generative diversity of our method through controlled experi￾ments by varying the reference image, music input, and random seed.. References 1. Bai, S., Chen, K., Liu, X., Wang, J., Ge, W., Song, S., Dang, K., Wang, P., Wang, S., Tang, J., Zhong, H., Zhu,…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

36 extracted references · 12 linked inside Pith

  1. [1]

    Bai, S., Chen, K., Liu, X., Wang, J., Ge, W., Song, S., Dang, K., Wang, P., Wang, S., Tang, J., Zhong, H., Zhu, Y., Yang, M., Li, Z., Wan, J., Wang, P., Ding, W., Fu, Z., Xu, Y., Ye, J., Zhang, X., Xie, T., Cheng, Z., Zhang, H., Yang, Z., Xu, H., Lin, J.: Qwen2.5-vl technical report (2025),https://arxiv.org/abs/2502.13923

  2. [2]

    arXiv preprint arXiv:2502.02492 (2025)

    Chefer, H., Singer, U., Zohar, A., Kirstain, Y., Polyak, A., Taigman, Y., Wolf, L., Sheynin, S.: Videojam: Joint appearance-motion representations for enhanced motion generation in video models. arXiv preprint arXiv:2502.02492 (2025)

  3. [3]

    In: Proceedings of the IEEE/CVF International Conference on Computer Vision

    Chen,Z.,Xu,H.,Song,G.,Xie,Y.,Zhang,C.,Chen,X.,Wang,C.,Chang,D.,Luo, L.: X-dancer: Expressive music to human dance video generation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 10602–10611 (2025)

  4. [4]

    arXiv preprint arXiv:2304.09151 (2023)

    Chung, H.W., Constant, N., Garcia, X., Roberts, A., Tay, Y., Narang, S., Firat, O.: Unimax: Fairer and more effective language sampling for large-scale multilingual pretraining. arXiv preprint arXiv:2304.09151 (2023)

  5. [5]

    In: Forty-first international conference on machine learning (2024)

    Esser, P., Kulal, S., Blattmann, A., Entezari, R., Müller, J., Saini, H., Levi, Y., Lorenz, D., Sauer, A., Boesel, F., et al.: Scaling rectified flow transformers for high-resolution image synthesis. In: Forty-first international conference on machine learning (2024)

  6. [6]

    arXiv preprint arXiv:2405.07719 (2024)

    Fang, J., Zhao, S.: Usp: A unified sequence parallelism approach for long context generative ai. arXiv preprint arXiv:2405.07719 (2024)

  7. [7]

    arXiv preprint arXiv:2508.18621 (2025)

    Gao, X., Hu, L., Hu, S., Huang, M., Ji, C., Meng, D., Qi, J., Qiao, P., Shen, Z., Song, Y., et al.: Wan-s2v: Audio-driven cinematic video generation. arXiv preprint arXiv:2508.18621 (2025)

  8. [8]

    Heo, B., Park, S., Han, D., Yun, S.: Rotary position embedding for vision trans- former.In:EuropeanConferenceonComputerVision.pp.289–305.Springer(2024)

Show all 36 references
  1. [9]

    arXiv preprint arXiv:2503.14505 (2025)

    Hong, S., Kemelmacher-Shlizerman, I., Curless, B., Seitz, S.M.: Musicinfuser: Mak- ing video diffusion listen and dance. arXiv preprint arXiv:2503.14505 (2025)

  2. [10]

    Iclr1(2), 3 (2022)

    Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W., et al.: Lora: Low-rank adaptation of large language models. Iclr1(2), 3 (2022)

  3. [11]

    In: European conference on computer vision

    Huang, Z., Xu, X., Xu, C., Zhang, H., Zheng, C., Qin, J., He, S.: Beat-it: Beat- synchronized multi-condition 3d dance generation. In: European conference on computer vision. pp. 273–290. Springer (2024) 16 Mingyang, H., Peng, Z., Li, H., Guangyuan, W., Bang, Z

  4. [12]

    In: Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition

    Hyung, J., Kim, K., Hong, S., Kim, M.J., Choo, J.: Spatiotemporal skip guidance for enhanced video diffusion sampling. In: Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition. pp. 11006–11015 (2025)

  5. [13]

    arXiv preprint arXiv:2508.19209 (2025)

    Jiang, J., Zeng, W., Zheng, Z., Yang, J., Liang, C., Liao, W., Liang, H., Zhang, Y., Gao, M.: Omnihuman-1.5: Instilling an active mind in avatars via cognitive simulation. arXiv preprint arXiv:2508.19209 (2025)

  6. [14]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Le, N., Pham, T., Do, T., Tjiputra, E., Tran, Q.D., Nguyen, A.: Music-driven group choreography. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 8673–8682 (2023)

  7. [15]

    arXiv preprint arXiv:2410.20389 (2024)

    Li, R., Zhang, H., Zhang, Y., Zhang, Y., Zhang, Y., Guo, J., Zhang, Y., Li, X., Liu,Y.:Lodge++:High-qualityandlongdancegenerationwithvividchoreography patterns. arXiv preprint arXiv:2410.20389 (2024)

  8. [16]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Li, R., Zhang, Y., Zhang, Y., Zhang, H., Guo, J., Zhang, Y., Liu, Y., Li, X.: Lodge: A coarse to fine diffusion network for long dance generation guided by the characteristic dance primitives. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognitio...

  9. [17]

    In: Proceed- ings of the IEEE/CVF International Conference on Computer Vision

    Li, R., Zhao, J., Zhang, Y., Su, M., Ren, Z., Zhang, H., Tang, Y., Li, X.: Finedance: A fine-grained choreography dataset for 3d full body dance generation. In: Proceed- ings of the IEEE/CVF International Conference on Computer Vision. pp. 10234– 10243 (2023)

  10. [18]

    In: Proceedings of the IEEE/CVF International Conference on Computer Vision

    Liu, H., Xu, Z., Hong, F.T., Huang, H.P., Zhou, Y., Zhou, Y.: Video motion graphs. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 13730–13740 (2025)

  11. [19]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Luo, Z., Ren, M., Hu, X., Huang, Y., Yao, L.: Popdg: Popular 3d dance generation with popdanceset. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 26984–26993 (2024)

  12. [20]

    arXiv preprint arXiv:2511.12578 (2025)

    Ma, Y., Liu, C., Wang, J., Liu, J., Huang, H., Wu, Z., Zhang, C., Li, X.: Tempomas- ter: Efficient long video generation via next-frame-rate prediction. arXiv preprint arXiv:2511.12578 (2025)

  13. [21]

    SciPy2015(18-24), 7 (2015)

    McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., Nieto, O., et al.: librosa: Audio and music signal analysis in python. SciPy2015(18-24), 7 (2015)

  14. [22]

    In: International conference on machine learning

    Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International conference on machine learning. pp. 8748–8763. PmLR (2021)

  15. [23]

    arXiv preprint arXiv:2512.13507 (2025)

    Seedance, T., Chen, H., Chen, S., Chen, X., Chen, Y., Chen, Y., Chen, Z., Cheng, F., Cheng, T., Cheng, X., et al.: Seedance 1.5 pro: A native audio-visual joint generation foundation model. arXiv preprint arXiv:2512.13507 (2025)

  16. [24]

    arXiv preprint arXiv:2403.18811 (2024)

    Siyao, L., Gu, T., Yang, Z., Lin, Z., Liu, Z., Ding, H., Yang, L., Loy, C.C.: Duolando: Follower gpt with off-policy reinforcement learning for dance accom- paniment. arXiv preprint arXiv:2403.18811 (2024)

  17. [25]

    In: Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Siyao, L., Yu, W., Gu, T., Lin, C., Wang, Q., Qian, C., Loy, C.C., Liu, Z.: Bailando: 3d dance generation by actor-critic gpt with choreographic memory. In: Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11050–11059 (2022)

  18. [26]

    arXiv preprint arXiv:2512.13313 (2025) Wan-Dancer 17

    Team, K., Chen, J., Ding, Y., Fang, Z., Gai, K., Gao, Y., He, K., Hua, J., Jiang, B., Lao, M., et al.: Klingavatar 2.0 technical report. arXiv preprint arXiv:2512.13313 (2025) Wan-Dancer 17

  19. [27]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition

    Tseng, J., Castellon, R., Liu, K.: Edge: Editable dance generation from music. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition. pp. 448–458 (2023)

  20. [28]

    In: ISMIR

    Tsuchida, S., Fukayama, S., Hamasaki, M., Goto, M.: Aist dance video database: Multi-genre, multi-dancer, and multi-camera database for dance information pro- cessing. In: ISMIR. vol. 1, p. 6 (2019)

  21. [29]

    arXiv preprint arXiv:2503.20314 (2025)

    Wan, T., Wang, A., Ai, B., Wen, B., Mao, C., Xie, C.W., Chen, D., Yu, F., Zhao, H., Yang, J., et al.: Wan: Open and advanced large-scale video generative models. arXiv preprint arXiv:2503.20314 (2025)

  22. [30]

    In: Proceedings of the 33rd ACM International Conference on Multimedia

    Wang, X., Wang, H., Cai, W.: Choreomuse: Robust music-to-dance video gener- ation with style transfer and beat-adherent motion. In: Proceedings of the 33rd ACM International Conference on Multimedia. pp. 7912–7921 (2025)

  23. [31]

    In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

    Wang, X., Wang, H., Liu, D., Cai, W.: Dance any beat: Blending beats with visuals in dance video generation. In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). pp. 5136–5146. IEEE (2025)

  24. [32]

    In: European Conference on Computer Vision

    Wang, Y., Lipson, L., Deng, J.: Sea-raft: Simple, efficient, accurate raft for optical flow. In: European Conference on Computer Vision. pp. 36–54. Springer (2024)

  25. [33]

    arXiv preprint arXiv:2511.18870 (2025)

    Wu, B., Zou, C., Li, C., Huang, D., Yang, F., Tan, H., Peng, J., Wu, J., Xiong, J., Jiang, J., et al.: Hunyuanvideo 1.5 technical report. arXiv preprint arXiv:2511.18870 (2025)

  26. [34]

    Advances in neural information processing systems35, 38571–38584 (2022)

    Xu, Y., Zhang, J., Zhang, Q., Tao, D.: Vitpose: Simple vision transformer baselines for human pose estimation. Advances in neural information processing systems35, 38571–38584 (2022)

  27. [35]

    Zhang, L., Cai, S., Li, M., Wetzstein, G., Agrawala, M.: Frame context packing anddriftpreventioninnext-frame-predictionvideodiffusionmodels.arXivpreprint arXiv:2504.12626 (2025)

  28. [36]

    In: Proceedings of the 33rd ACM International Conference on Multimedia

    Zhang, X., Gong, D., Duan, Z., van den Hengel, A., Liu, L.: Let your video listen to your music!–beat-aligned, content-preserving video editing with arbitrary music. In: Proceedings of the 33rd ACM International Conference on Multimedia. pp. 12140–12149 (2025)

Pith tools

Reviewed August 2, 2026 · model on record in the stance chip above.