Pith. sign in

REVIEW 3 major objections 3 cited by

A single Transformer jointly learns perception, reasoning, generation, timing and synchronization for streaming audio-visual interaction.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-06-30 09:39 UTC pith:XELZR3XN

load-bearing objection Wan-Streamer describes a unified Transformer for real-time multimodal streaming but the abstract supplies no measurements, baselines, or training details to support the latency numbers or the claim that timing and turn management emerge from standard next-token prediction. the 3 major comments →

arxiv 2606.25041 v3 pith:XELZR3XN submitted 2026-06-23 cs.CV cs.AIcs.GRcs.SD

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

Lianghua Huang , Zhi-Fan Wu , Wei Wang , Yupeng Shi , Mengyang Feng , Junjie He , Chen-Wei Xie , Yu Liu
show 17 more authors
Jingren Zhou Ang Wang Bang Zhang Baole Ai Chen Liang Cheng Yu Chongyang Zhong Jinwei Qi Kai Zhu Pandeng Li Peng Zhang Wenyuan Zhang Xinhua Cheng Yitong Huang Yun Zheng Yuzheng Wang Zoubin Bi
This is my paper
classification cs.CV cs.AIcs.GRcs.SD
keywords end-to-end interactive modelreal-time streamingmultimodal transformerfull-duplex interactionlow-latency audio-visualblock-causal attentionunified foundation modelnative streaming
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper introduces Wan-Streamer as an end-to-end foundation model built as one Transformer that accepts and produces interleaved visual, audio and text tokens. Block-causal attention lets the model process these tokens incrementally so that perception, response planning and output generation happen inside the same network rather than through separate specialized systems. The design targets model-side response times near 200 ms, which with typical network delays yields roughly 550 ms total round-trip latency for natural full-duplex conversation. A sympathetic reader would care because removing cascaded modules could cut both latency and accumulated errors in interactive AI. If the approach holds, interactive systems could move from pipeline architectures to unified streaming models.

Core claim

Wan-Streamer shows that a single Transformer, trained on sequences of interleaved multimodal input and output tokens and coordinated by block-causal attention, can acquire perception, reasoning, generation, response timing, turn management and cross-modal synchronization without external VAD, ASR, TTS or generation modules, thereby enabling native streaming units as short as 160 ms and sub-second full-duplex audio-visual interaction.

What carries the argument

Block-causal attention over interleaved visual, audio and text input and output tokens, which permits incremental streaming while keeping the entire perception-to-generation loop inside one network.

Load-bearing premise

A single Transformer can learn all required interactive skills together from interleaved token sequences without needing any external specialized modules.

What would settle it

A live conversation test in which the model either exceeds 200 ms model-side latency, produces unsynchronized audio and video, or fails to manage natural turn-taking when run with realistic network conditions.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • Pipeline latency drops because separate VAD, ASR, language, TTS and animation modules are removed.
  • Error accumulation across cascaded components is eliminated.
  • Streaming units of 160 ms become feasible at 25 fps while preserving causal generation.
  • Full-duplex audio-visual communication reaches sub-second total latency when network delay is around 350 ms.
  • Response timing and cross-modal synchronization are learned jointly rather than hand-engineered.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The same interleaved-token design might extend to other real-time multimodal tasks such as collaborative editing or live translation.
  • Joint training could improve robustness when input modalities arrive at different rates or with partial dropouts.
  • Deployment in variable network conditions would test whether the learned timing generalizes beyond the training distribution.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 0 minor

Summary. The manuscript presents Wan-Streamer v0.1, a single Transformer foundation model for real-time full-duplex audio-visual interaction. It represents sequences as interleaved visual/audio/text input and output tokens processed with block-causal attention, claiming that this unified architecture jointly acquires perception, reasoning, generation, response timing, turn management, and cross-modal synchronization without external modules such as VAD, ASR, TTS, or separate generation pipelines. The work redesigns the stack with causal encoders/decoders and low-latency token scheduling to support 160 ms streaming units at 25 fps, reporting approximately 200 ms model-side response latency and 550 ms total interaction latency (including 350 ms bidirectional network delay).

Significance. A verified demonstration that interleaved multimodal tokens plus block-causal attention suffice for acquiring interactive behaviors (including timing and turn management) would constitute a meaningful advance in unified multimodal models, potentially reducing pipeline latency and error accumulation compared to cascaded systems. The emphasis on native streamability and sub-second duplex communication aligns with practical needs in real-time applications. No machine-checked proofs or parameter-free derivations are present; the contribution rests entirely on empirical claims whose supporting measurements are not supplied.

major comments (3)
  1. [Abstract] Abstract: The central performance claims of ~200 ms model-side response latency and ~550 ms total interaction latency are stated without any experimental setup, measurement protocol, baselines, hardware details, or error analysis. This absence directly prevents verification of the reported numbers and their attribution to the unified architecture.
  2. [Abstract] Abstract: The claim that 'perception, reasoning, generation, response timing, turn management, and cross-modal synchronization are learned jointly within one unified model' without external modules is unsupported by any description of training objectives, loss terms, data curation for interactive behaviors, or ablations that isolate the contribution of block-causal attention versus auxiliary timing modules. The latency results therefore rest on an unverified assumption that standard next-token prediction on the interleaved stream produces the required dynamics.
  3. [Abstract] Abstract: No architectural equations, tokenization details, or comparisons to prior streaming or multimodal models are provided to substantiate the redesign of causal encoders, decoders, and multimodal token scheduling, making it impossible to assess whether the claimed 160 ms streaming units are achieved through the described mechanisms.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive comments. We respond point by point below and will revise the manuscript to supply the requested details and supporting evidence.

read point-by-point responses

  1. Referee: [Abstract] Abstract: The central performance claims of ~200 ms model-side response latency and ~550 ms total interaction latency are stated without any experimental setup, measurement protocol, baselines, hardware details, or error analysis. This absence directly prevents verification of the reported numbers and their attribution to the unified architecture.

    Authors: We agree that the abstract alone does not provide sufficient experimental context. The reported figures come from internal benchmarks of the streaming architecture. In revision we will add a dedicated evaluation section that specifies the measurement protocol (timestamping from input token receipt to first output token), hardware platform, any comparative baselines, and error statistics so that readers can verify the numbers and their link to the unified design. revision: yes

  2. Referee: [Abstract] Abstract: The claim that 'perception, reasoning, generation, response timing, turn management, and cross-modal synchronization are learned jointly within one unified model' without external modules is unsupported by any description of training objectives, loss terms, data curation for interactive behaviors, or ablations that isolate the contribution of block-causal attention versus auxiliary timing modules. The latency results therefore rest on an unverified assumption that standard next-token prediction on the interleaved stream produces the required dynamics.

    Authors: The current manuscript presents the architectural premise at a high level. We accept that explicit training details are required to support the joint-learning claim. The revision will describe the training objectives, any auxiliary losses used for timing and turn-taking, the curation of interactive multimodal data, and ablations that isolate block-causal attention from alternative timing mechanisms, thereby clarifying how next-token prediction on the interleaved stream yields the observed interactive behaviors. revision: yes

  3. Referee: [Abstract] Abstract: No architectural equations, tokenization details, or comparisons to prior streaming or multimodal models are provided to substantiate the redesign of causal encoders, decoders, and multimodal token scheduling, making it impossible to assess whether the claimed 160 ms streaming units are achieved through the described mechanisms.

    Authors: We will incorporate the missing technical content. The revised manuscript will include the mathematical formulation of block-causal attention, the precise tokenization and scheduling scheme for 160 ms multimodal units, and direct comparisons to prior causal streaming models in audio, video, and multimodal settings. These additions will allow assessment of how the redesign enables the stated streaming granularity. revision: yes

Circularity Check

0 steps flagged

No derivation chain or equations present; claims are empirical system descriptions.

full rationale

The manuscript is a systems/engineering paper presenting an end-to-end model architecture and reported latencies. No mathematical derivations, equations, fitted parameters, or uniqueness theorems are visible in the abstract or described claims. The central assertion that a single Transformer with interleaved tokens and block-causal attention jointly acquires timing/turn management is stated as a design outcome rather than derived from prior steps or self-citations. No load-bearing reductions to inputs or self-citation chains exist, so the paper is self-contained against external benchmarks with no circularity.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Abstract contains no mathematical formulations, fitted parameters, or new postulated entities; all content is high-level system description.

pith-pipeline@v0.9.1-grok · 5885 in / 1099 out tokens · 37438 ms · 2026-06-30T09:39:25.126335+00:00 · methodology

0 comments
read the original abstract

We present Wan-Streamer, a native-streaming, end-to-end interactive foundation model designed from the ground up for real-time, low-latency, full-duplex audio-visual interaction. Wan-Streamer seamlessly models language, audio, and video as both input and output within a single Transformer, where the sequence is represented as interleaved visual, audio, and text input tokens together with visual, audio, and text output tokens, coordinated by block-causal attention for incremental streaming. Unlike cascaded interactive systems that rely on separate VAD, ASR, language, TTS, audio-driven animation, or video-generation modules, Wan-Streamer does not rely on external language, speech, avatar, or video-generation modules: perception, reasoning, generation, response timing, turn management, and cross-modal synchronization are learned jointly within one unified model, reducing pipeline latency and error accumulation. To support natural audio-visual responsiveness, we redesign the entire stack around streamability, including causal encoders, causal decoders, block-causal attention, and low-latency multimodal token scheduling, enabling streaming units as short as 160 ms at 25 fps. Wan-Streamer achieves approximately 200 ms model-side response latency and approximately 550 ms total interaction latency when combined with 350 ms bidirectional network latency, supporting sub-second duplex audio-visual communication. These results position Wan-Streamer as a unified, end-to-end, multimodal interactive foundation model for low-latency streaming interaction.

Review history (3 revisions) →

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars

    cs.CV 2026-07 conditional novelty 6.0

    OmniMate generates real-time streaming video, speech, and sound effects for interactive avatars while preserving the same face and voice across long multi-turn conversations.

  2. Wan-Streamer v0.2: Higher Resolution, Same Latency

    cs.CV 2026-07 conditional novelty 4.0

    Wan-Streamer v0.2 upgrades native-streaming audio-visual interaction to 640×368 at 25 FPS with unchanged ~200 ms model-side latency via a single-GPU thinker and multi-GPU Ulysses-style performer.

  3. Video = World + Event Stream

    cs.CV 2026-07 reject novelty 3.0

    Wan-Streamer v0.3 reformulates streaming video as a persistent world plus a changing event stream and extends an agent's output with open-vocabulary behavior, without reporting any quantitative results.

Reference graph

Works this paper leans on

49 extracted references · 49 canonical work pages · cited by 3 Pith papers · 20 internal anchors

  1. [1]

    Body of her: A preliminary study on end-to-end humanoid agent.arXiv preprint arXiv:2408.02879, 2024

    Tenglong Ao. Body of her: A preliminary study on end-to-end humanoid agent.arXiv preprint arXiv:2408.02879, 2024

    work page arXiv 2024

  2. [2]

    Recammaster: Camera-controlled generative rendering from a single video

    Jianhong Bai, Menghan Xia, Xiao Fu, Xintao Wang, Lianrui Mu, Jinwen Cao, Zuozhu Liu, Haoji Hu, Xiang Bai, Pengfei Wan, et al. Recammaster: Camera-controlled generative rendering from a single video. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 14834–14844, 2025

    work page 2025

  3. [3]

    Qwen2.5-VL Technical Report

    Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, et al. Qwen2.5-vl technical report.arXiv preprint arXiv:2502.13923, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  4. [4]

    Doubao realtime voice model.https://seed.bytedance.com/en/realtime_voice, 2025

    ByteDance Seed Team. Doubao realtime voice model.https://seed.bytedance.com/en/realtime_voice, 2025. Model page, January 20, 2025

    work page 2025

  5. [5]

    Introducing seed full-duplex speech llm: Attentive listening, robust interference suppression, enabling more natural interaction

    ByteDance Seed Team. Introducing seed full-duplex speech llm: Attentive listening, robust interference suppression, enabling more natural interaction. ByteDance Seed Blog, 2026. Blog post, April 9, 2026

    work page 2026

  6. [6]

    Towards interactive intelligence for digital humans.arXiv preprint arXiv:2512.13674, 2025

    Yiyi Cai, Xuangeng Chu, Xiwei Gao, Sitong Gong, Yifei Huang, Caixin Kang, Kunhang Li, et al. Towards interactive intelligence for digital humans.arXiv preprint arXiv:2512.13674, 2025

    work page arXiv 2025

  7. [7]

    Diffusion forcing: Next-token prediction meets full-sequence diffusion

    Boyuan Chen, Diego Marti Monsó, Yilun Du, Max Simchowitz, Russ Tedrake, and Vincent Sitzmann. Diffusion forcing: Next-token prediction meets full-sequence diffusion. InAdvances in Neural Information Processing Systems, 2024

    work page 2024

  8. [8]

    Midas: Multimodal interactive digital-human synthesis via real-time autoregressive video generation.arXiv preprint arXiv:2508.19320, 2025

    Ming Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang, Yan Zhou, Xiaohan Li, Songlin Tang, Jiwen Liu, Borui Liao, Hejia Chen, et al. Midas: Multimodal interactive digital-human synthesis via real-time autoregressive video generation.arXiv preprint arXiv:2508.19320, 2025

    work page arXiv 2025

  9. [9]

    From turn-taking to synchronous dialogue: A survey of full-duplex spoken language models.arXiv preprint arXiv:2509.14515, 2025

    Yuxuan Chen and Haoyuan Yu. From turn-taking to synchronous dialogue: A survey of full-duplex spoken language models.arXiv preprint arXiv:2509.14515, 2025

    work page arXiv 2025

  10. [10]

    Livetalk: Real-time multimodal interactive video diffusion via improved on-policy distillation.arXiv preprint arXiv:2512.23576, 2025

    Ethan Chern, Zhulin Hu, Bohao Tang, Jiadi Su, Steffi Chern, Zhijie Deng, and Pengfei Liu. Livetalk: Real-time multimodal interactive video diffusion via improved on-policy distillation.arXiv preprint arXiv:2512.23576, 2025

    work page arXiv 2025

  11. [11]

    Avatarforcing: One-step streaming talking avatars via local-future sliding-window denoising.arXiv preprint arXiv:2603.14331, 2026

    Liyuan Cui, Wentao Hu, Wenyuan Zhang, Zesong Yang, Fan Shi, and Xiaoqiang Liu. Avatarforcing: One-step streaming talking avatars via local-future sliding-window denoising.arXiv preprint arXiv:2603.14331, 2026

    work page arXiv 2026

  12. [12]

    Moshi: a speech-text foundation model for real-time dialogue

    Alexandre Défossez, Laurent Mazaré, Manu Orsini, Amélie Royer, Patrick Pérez, Hervé Jégou, Edouard Grave, and Neil Zeghidour. Moshi: a speech-text foundation model for real-time dialogue.arXiv preprint arXiv:2410.00037, 2024

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  13. [13]

    U-mind: A unified framework for real-time multimodal interaction with audiovisual generation

    Xiang Deng, Feng Gao, Yong Zhang, Youxin Pang, Xu Xiaoming, Zhuoliang Kang, Xiaoming Wei, and Yebin Liu. U-mind: A unified framework for real-time multimodal interaction with audiovisual generation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10874–10886, 2026

    work page 2026

  14. [14]

    arXiv preprint arXiv:2509.09595 (2025)

    Yikang Ding, Jiwen Liu, Wenyuan Zhang, Zekun Wang, Wentao Hu, Liyuan Cui, Mingming Lao, Yingchao Shao, Hui Liu, Xiaohan Li, Ming Chen, Xiaoqiang Liu, Yu-shen Liu, and Pengfei Wan. Kling-avatar: Grounding multimodal instructions for cascaded long-duration avatar animation synthesis.arXiv preprint arXiv:2509.09595, 2025

    work page arXiv 2025

  15. [15]

    GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning

    Wenyi Hong, Wenmeng Yu, Xiaotao Gu, Guo Wang, Guobing Gan, Haomiao Tang, Jiale Cheng, Ji Qi, Junhui Ji, Lihang Pan, et al. Glm-4.5 v and glm-4.1 v-thinking: Towards versatile multimodal reasoning with scalable reinforcement learning.arXiv preprint arXiv:2507.01006, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  16. [16]

    SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Model

    Ke Hu, Ehsan Hosseini-Asl, Chen Chen, Edresson Casanova, Subhankar Ghosh, Piotr Želasko, Zhehuai Chen, Jason Li, Jagadeesh Balam, and Boris Ginsburg. Salm-duplex: Efficient and direct duplex modeling for speech-to-speech language model.arXiv preprint arXiv:2505.15670, 2025

    work page Pith review arXiv 2025

  17. [17]

    Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion

    Xun Huang, Zhengqi Li, Guande He, Mingyuan Zhou, and Eli Shechtman. Self forcing: Bridging the train-test gap in autoregressive video diffusion.arXiv preprint arXiv:2506.08009, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  18. [18]

    Introducing evi 3: The world’s most realistic and instructible speech-language model.https://www

    Hume AI. Introducing evi 3: The world’s most realistic and instructible speech-language model.https://www. hume.ai/blog/introducing-evi-3, 2025. Blog post, 2025

    work page 2025

  19. [19]

    Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation

    Taekyung Ki, Sangwon Jang, Jaehyeong Jo, Jaehong Yoon, and Sung Ju Hwang. Avatar forcing: Real-time interactive head avatar generation for natural conversation.arXiv preprint arXiv:2601.00664, 2026. 9

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  20. [20]

    Openai realtime api: The missing manual

    Latent.Space. Openai realtime api: The missing manual. https://www.latent.space/p/realtime-api, 2024. Technical blog, December 2024

    work page 2024

  21. [21]

    Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation

    Chunyu Li, Jiaye Li, Ruiqiao Mei, Haoyuan Xia, Hao Zhu, Jingdong Wang, and Siyu Zhu. Hallo-live: Real-time streaming joint audio-video avatar generation with asynchronous dual-stream and human-centric preference distillation.arXiv preprint arXiv:2604.23632, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  22. [22]

    Causal World Modeling for Robot Control

    Lin Li, Qihang Zhang, Yiming Luo, Shuai Yang, Ruilin Wang, Fei Han, Mingrui Yu, Zelin Gao, Nan Xue, Xing Zhu, Yujun Shen, and Yinghao Xu. Causal world modeling for robot control.arXiv preprint arXiv:2601.21998, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  23. [23]

    Omnihuman-1: Rethinking the scaling-up of one-stage conditioned human animation models.arXiv preprint arXiv:2502.01061, 2025

    Gaojie Lin, Jianwen Jiang, Jiaqi Yang, Zerong Zheng, and Chao Liang. Omnihuman-1: Rethinking the scaling-up of one-stage conditioned human animation models.arXiv preprint arXiv:2502.01061, 2025

    work page arXiv 2025

  24. [24]

    Rolling Forcing: Autoregressive Long Video Diffusion in Real Time

    Kunhao Liu, Wenbo Hu, Jiale Xu, Ying Shan, and Shijian Lu. Rolling forcing: Autoregressive long video diffusion in real time.arXiv preprint arXiv:2509.25161, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  25. [25]

    Talkingmachines: Real-time audio-driven facetime-style video via autoregressive diffusion models.arXiv preprint arXiv:2506.03099, 2025

    Chetwin Low and Weimin Wang. Talkingmachines: Real-time audio-driven facetime-style video via autoregressive diffusion models.arXiv preprint arXiv:2506.03099, 2025

    work page arXiv 2025

  26. [26]

    Hello gpt-4o.https://openai.com/index/hello-gpt-4o/, 2024

    OpenAI. Hello gpt-4o.https://openai.com/index/hello-gpt-4o/, 2024. Blog post, May 13, 2024

    work page 2024

  27. [27]

    MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction

    OpenBMB Team. Minicpm-o 4.5: Towards real-time full-duplex omni-modal interaction.arXiv preprint arXiv:2604.27393, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  28. [28]

    Mavid: A multimodal framework for audio-visual dialogue understanding and generation.arXiv preprint arXiv:2512.03034, 2025

    Youxin Pang, Jiajun Liu, Lingfeng Tan, Yong Zhang, Feng Gao, Xiang Deng, Zhuoliang Kang, Xiaoming Wei, and Yebin Liu. Mavid: A multimodal framework for audio-visual dialogue understanding and generation.arXiv preprint arXiv:2512.03034, 2025

    work page arXiv 2025

  29. [29]

    Qwen3-Omni Technical Report

    Qwen Team. Qwen3-omni technical report.arXiv preprint arXiv:2509.17765, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  30. [30]

    Qwen3.5-Omni Technical Report

    Qwen Team. Qwen3.5-omni technical report.arXiv preprint arXiv:2604.15804, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  31. [31]

    Seedance 2.0: Advancing Video Generation for World Complexity

    Team Seedance, De Chen, Liyang Chen, Xin Chen, Ying Chen, Zhuo Chen, Zhuowei Chen, Feng Cheng, Tianheng Cheng, Yufeng Cheng, et al. Seedance 2.0: Advancing video generation for world complexity.arXiv preprint arXiv:2604.14148, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  32. [32]

    Omniforcing: Unleashing real-time joint audio-visual generation.arXiv preprint arXiv:2603.11647, 2026

    Yaofeng Su, Yuming Li, Zeyue Xue, Jie Huang, Siming Fu, Haoran Li, Ying Li, et al. Omniforcing: Unleashing real-time joint audio-visual generation.arXiv preprint arXiv:2603.11647, 2026

    work page arXiv 2026

  33. [33]

    WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling

    Wenqiang Sun, Haiyu Zhang, Haoyuan Wang, Junta Wu, Zehan Wang, Zhenwei Wang, Yunhong Wang, Jun Zhang, Tengfei Wang, and Chunchao Guo. Worldplay: Towards long-term geometric consistency for real-time interactive world modeling.arXiv preprint arXiv:2512.14614, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  34. [34]

    Streamavatar: Streaming diffusion models for real-time interactive human avatars.arXiv preprint arXiv:2512.22065, 2025

    Zhiyao Sun, Ziqiao Peng, Yifeng Ma, Yi Chen, Zhengguang Zhou, Zixiang Zhou, Guozhen Zhang, Youliang Zhang, Yuan Zhou, Qinglin Lu, and Yong-Jin Liu. Streamavatar: Streaming diffusion models for real-time interactive human avatars.arXiv preprint arXiv:2512.22065, 2025

    work page arXiv 2025

  35. [35]

    Kimi-VL Technical Report

    Kimi Team, Angang Du, Bohong Yin, Bowei Xing, Bowen Qu, Bowen Wang, Cheng Chen, Chenlin Zhang, Chenzhuang Du, Chu Wei, et al. Kimi-vl technical report.arXiv preprint arXiv:2504.07491, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  36. [36]

    Doubao end-to-end realtime voice model

    Volcengine. Doubao end-to-end realtime voice model. Volcengine product page, 2025. Product page, 2025

    work page 2025

  37. [37]

    Wan: Open and Advanced Large-Scale Video Generative Models

    Team Wan, Ang Wang, Baole Ai, Bin Wen, Chaojie Mao, Chen-Wei Xie, Di Chen, Feiwu Yu, Haiming Zhao, Jianx- iao Yang, et al. Wan: Open and advanced large-scale video generative models.arXiv preprint arXiv:2503.20314, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  38. [38]

    Flowact-r1: Towards interactive humanoid video generation.arXiv preprint arXiv:2601.10103,

    Lizhen Wang, Yongming Zhu, Zhipeng Ge, Youwei Zheng, Longhao Zhang, Tianshu Hu, Shiyang Qin, et al. Flowact-r1: Towards interactive humanoid video generation.arXiv preprint arXiv:2601.10103, 2026

    work page arXiv 2026

  39. [39]

    Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory

    Zile Wang, Zexiang Liu, Jiaxing Li, Kaichen Huang, Baixin Xu, Fei Kang, Mengyin An, et al. Matrix-game 3.0: Real-time and streaming interactive world model with long-horizon memory.arXiv preprint arXiv:2604.08995, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  40. [40]

    X-streamer: Unified human world modeling with audiovisual interaction.arXiv preprint arXiv:2509.21574, 2025

    You Xie, Tianpei Gu, Zenan Li, Chenxu Zhang, Guoxian Song, Xiaochen Zhao, Chao Liang, Jianwen Jiang, Hongyi Xu, and Linjie Luo. X-streamer: Unified human world modeling with audiovisual interaction.arXiv preprint arXiv:2509.21574, 2025. 10

    work page arXiv 2025

  41. [41]

    Vasa-1: Lifelike audio-driven talking faces generated in real time.arXiv preprint arXiv:2404.10667, 2024

    Sicheng Xu, Guojun Chen, Yu-Xiao Guo, Jiaolong Yang, Chong Li, Zhenyu Zang, Yizhong Zhang, Xin Tong, and Baining Guo. Vasa-1: Lifelike audio-driven talking faces generated in real time.arXiv preprint arXiv:2404.10667, 2024

    work page arXiv 2024

  42. [42]

    Qwen3 Technical Report

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, et al. Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  43. [43]

    Qwen2.5 Technical Report

    An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, et al. Qwen2.5 technical report.arXiv preprint arXiv:2412.15115, 2025

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  44. [44]

    Cogvideox: Text-to-video diffusion models with an expert transformer

    Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, et al. Cogvideox: Text-to-video diffusion models with an expert transformer. In ICLR, 2025

    work page 2025

  45. [45]

    Tianwei Yin, Michaël Gharbi, Taesung Park, Richard Zhang, Eli Shechtman, Fredo Durand, and William T. Freeman. Improved distribution matching distillation for fast image synthesis.arXiv preprint arXiv:2405.14867, 2024

    work page Pith review arXiv 2024

  46. [46]

    One-step Diffusion with Distribution Matching Distillation

    Tianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman, Fredo Durand, William T. Freeman, and Taesung Park. One-step diffusion with distribution matching distillation.arXiv preprint arXiv:2311.18828, 2024

    work page Pith review arXiv 2024

  47. [47]

    LPM 1.0: Video-based Character Performance Model

    Ailing Zeng, Casper Yang, Chauncey Ge, Eddie Zhang, Garvey Xu, Gavin Lin, Gilbert Gu, et al. Lpm 1.0: Video-based character performance model.arXiv preprint arXiv:2604.07823, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  48. [48]

    DuplexSLA: A Full-Duplex Spoken Language Model with Synchronized Speech, Language, and Action

    Haoyang Zhang, Jun Chen, Donghang Wu, Yuxin Li, Yuxin Zhang, Xiangyu Tony Zhang, Che Liu, Qingjian Lin, Yizhou Peng, Hexin Liu, Eng Siong Chng, Chao Yan, Boyong Wu, Yechang Huang, Xuerui Yang, and Fei Tian. Duplexsla: A full-duplex spoken language model with synchronized speech, language, and action.arXiv preprint arXiv:2605.20755, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  49. [49]

    Omniflatten: An end-to-end gpt model for seamless voice conversation

    Qinglin Zhang, Luyao Cheng, Chong Deng, Qian Chen, Wen Wang, Siqi Zheng, Jiaqing Liu, Hai Yu, Chaohong Tan, Zhihao Du, and Shiliang Zhang. Omniflatten: An end-to-end gpt model for seamless voice conversation. arXiv preprint arXiv:2410.17799, 2024. 11 Appendix A Contributions and Acknowledgements A.1 Core Contributors Lianghua Huang, Zhi-Fan Wu, Wei Wang, ...

    work page arXiv 2024