C$^3$ache: Accelerating World Action Models with Cross Inference Chunk Cache

Lam Nguyen; Weisen Zhao; Yuzhang Shang; Zhicong Lu

REVIEW 2 major objections 1 minor 1 cited by

C³ache reuses residuals across chunks to speed World Action Model inference up to 2.5 times.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-06-27 17:43 UTC pith:I4YDESXR

load-bearing objection C³ache reuses residuals across chunks for a claimed 2.5× WAM speedup, but the reported experiments give no controls, variance, or error measurements. the 2 major comments →

arxiv 2606.08962 v1 pith:I4YDESXR submitted 2026-06-08 cs.LG cs.CVcs.RO

C³ache: Accelerating World Action Models with Cross Inference Chunk Cache

Weisen Zhao , Lam Nguyen , Zhicong Lu , Yuzhang Shang This is my paper

classification cs.LG cs.CVcs.RO

keywords world action modelsinference accelerationdenoising cacherobot policiesdiffusion modelscross-chunk reusevideo prediction

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

World Action Models generalize better than standard robot policies because they learn from unlabeled video, yet they run a costly denoising process over multiple inference chunks. The paper shows that during smooth robot motions the residuals at any fixed denoising step remain strongly correlated from one chunk to the next. C³ache stores those residuals once and reuses them for later chunks at the same denoising step. The result is a training-free acceleration that cuts total wall-clock time by up to 2.5 times while task success stays nearly unchanged. Existing single-chunk accelerators can still be applied on top of this cross-chunk reuse.

Core claim

C³ache caches and reuses the residuals computed at each denoising step across successive inference chunks, exploiting the correlation that appears when a robot performs smooth behavior.

What carries the argument

The cross-inference-chunk residual cache that stores denoising residuals at each step and re-applies them to later chunks instead of recomputing them.

Load-bearing premise

When a robot executes a smooth behavior, the residuals computed at a given denoising step are strongly correlated from one chunk to the next.

What would settle it

Measure the actual correlation between residuals of consecutive chunks at each denoising step on a smooth motion sequence; then replace later residuals with the cached values and check whether task success rate remains within a few percent of the uncached baseline.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

Total wall-clock inference time for a full task drops by up to 2.5 times.
Task success rate shows negligible degradation on standard benchmarks.
World Action Models can run faster without losing their generalization benefit from video pretraining.
Single-chunk acceleration methods remain compatible and can be stacked with the cross-chunk cache.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

The same chunk-to-chunk residual correlation may appear in other diffusion-based video planners outside robotics.
A tunable similarity threshold on cached residuals could let users trade extra speed for higher accuracy when needed.
Monitoring correlation strength in real time could allow dynamic switching between cached and fresh computation for variable-length behaviors.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

C³ache reuses residuals across chunks for a claimed 2.5× WAM speedup, but the reported experiments give no controls, variance, or error measurements.

read the letter

The main thing to know is that C³ache reuses denoising residuals across inference chunks at the same step to accelerate world action models, claiming up to 2.5 times faster inference with little loss in task success.

What is new is the cross-chunk mechanism. Prior acceleration work cached computation inside one chunk's denoising trajectory. This paper observes that residuals correlate between chunks for smooth behaviors and reuses them directly. The method stays training-free and rests on that correlation rather than any learned parameters.

The paper does well by identifying a redundancy that within-chunk methods miss and by giving concrete speedup numbers on benchmarks with a Fast-WAM backbone.

The soft spots are around the strength of the evidence. The description provides no details on experimental controls, variance across multiple runs, or how baselines were set up exactly. The stress-test note points out that there's no quantification of residual differences as chunks progress or for different task horizons. If the correlation weakens on non-smooth trajectories, the error could accumulate and affect the action predictions more than claimed. That makes the "negligible degradation" part hard to assess without more data.

This paper is for researchers focused on making video-based robot policies run faster in practice. Someone implementing WAMs would get a useful idea from it, though they would want to verify the correlation assumption in their own setting.

I would send it to peer review. The core claim is specific and the method is easy to test, so referees can evaluate whether the speedup holds under closer scrutiny.

Referee Report

2 major / 1 minor

Summary. The paper proposes C³ache, a training-free method for accelerating inference in World Action Models (WAMs) by caching and reusing residuals across consecutive inference chunks at the same denoising step. This exploits an observed correlation in residuals for smooth robot behaviors. On benchmarks using a Fast-WAM backbone, it reports up to 2.5× wall-clock speedup with negligible degradation in task success rate.

Significance. If the speedup holds with the claimed negligible impact on success rate, the result would be significant for practical deployment of WAMs, which currently suffer from expensive multi-chunk denoising. The training-free nature and reliance on an empirical correlation (rather than fitted parameters) are strengths that could enable immediate adoption without retraining costs.

major comments (2)

[Method and Experiments sections] The central claim of 2.5× speedup with negligible success-rate drop depends on the assumption that residual reuse introduces no accumulating error. However, no section quantifies the per-step residual difference (e.g., via cosine similarity or L2 norm) as a function of chunk index, behavior smoothness, or task horizon, nor bounds the downstream effect on final actions or predictions.
[Experiments section] The empirical results report concrete speedup numbers but provide no details on experimental controls, variance across runs, or exact baseline implementations. This leaves the 'negligible degradation' claim only moderately supported, as factors like task horizon or non-smooth trajectories could affect outcomes.

minor comments (1)

[Method section] Notation for residuals and denoising steps could be clarified with an explicit equation or diagram showing the cross-chunk reuse operation.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive comments. We address each major comment below.

read point-by-point responses

Referee: [Method and Experiments sections] The central claim of 2.5× speedup with negligible success-rate drop depends on the assumption that residual reuse introduces no accumulating error. However, no section quantifies the per-step residual difference (e.g., via cosine similarity or L2 norm) as a function of chunk index, behavior smoothness, or task horizon, nor bounds the downstream effect on final actions or predictions.

Authors: We agree that explicit quantification of residual differences would strengthen the support for the central claim. While the manuscript presents empirical evidence via observed speedups and success rates under the correlation for smooth behaviors, we will add a new analysis subsection (in Methods) reporting cosine similarity and L2 norms of residuals across chunk indices and denoising steps, plus discussion of downstream effects for varying horizons and smoothness levels. revision: yes
Referee: [Experiments section] The empirical results report concrete speedup numbers but provide no details on experimental controls, variance across runs, or exact baseline implementations. This leaves the 'negligible degradation' claim only moderately supported, as factors like task horizon or non-smooth trajectories could affect outcomes.

Authors: We acknowledge the need for fuller experimental reporting. In the revised Experiments section we will add: exact baseline implementation details, number of runs with standard deviations for all metrics, explicit controls for task horizon, and new results on non-smooth trajectories to better substantiate robustness of the negligible-degradation claim. revision: yes

Circularity Check

0 steps flagged

No significant circularity detected

full rationale

The paper presents C³ache as a training-free method that reuses residuals across chunks based on an empirical observation of correlation under smooth behavior. This observation is not derived from any equation or fit within the paper; the speedup is reported as an experimental outcome on benchmarks. No self-definitional relations, fitted parameters renamed as predictions, load-bearing self-citations, uniqueness theorems, smuggled ansatzes, or renamings of known results appear in the derivation. The chain from observation to reuse to measured wall-clock improvement is self-contained and externally falsifiable via the reported task success rates.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Review performed on abstract only; no free parameters, axioms, or invented entities are identifiable from the provided text.

pith-pipeline@v0.9.1-grok · 5724 in / 975 out tokens · 19438 ms · 2026-06-27T17:43:35.080062+00:00 · methodology

0 comments

read the original abstract

World Action Models (WAMs) generalize better than standard Vision-Language-Action (VLA) policies to novel motions and environments, because a video-modeling objective lets them learn from abundant unlabeled video rather than scarce labeled robot demonstrations. This generalization is computationally expensive. To complete a task, a WAM runs over multiple inference chunks, and each chunk requires a costly denoising process. Existing acceleration methods reduce this cost by caching and reusing computation within a single chunk's denoising trajectory. Our empirical analysis reveals a substantial source of redundancy they overlook: redundancy across chunks. When a robot executes a smooth behavior, the residuals computed at a given denoising step are strongly correlated from one chunk to the next. We introduce C$^3$ache, a training-free method that caches and reuses these residuals across inference chunks at the same denoising step. Experiments on benchmarks with a Fast-WAM backbone show that C$^3$ache achieves up to a $2.5\times$ speedup in total wall-clock inference time, with negligible degradation in task success rate.

Figures

Figures reproduced from arXiv: 2606.08962 by Lam Nguyen, Weisen Zhao, Yuzhang Shang, Zhicong Lu.

**Figure 1.** Figure 1: (a) Overview of C3ache. In full-computation chunks, our method runs the full DiT blocks and computes the residual. In cached chunks, it reuses the pre-computed residual to skip all DiT blocks. The residual is refreshed according to the inference schedule. (b) Inference speed comparison between C 3ache and Fast-WAM (no cache) on two benchmarks: LIBERO and RoboTwin. repeated. They differ mainly in the granu… view at source ↗

**Figure 2.** Figure 2: Cosine similarity across inference chunks for the three tensors: output of Final Block [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗

**Figure 3.** Figure 3: C 3ache framework design. (Top) Per-chunk computation at one denoising step k. A full chunk runs all L DiT blocks and writes the residual ∆R = hL − h0 into the cache as R˜; a cached chunk skips every DiT block and reconstructs hL = h0 + R˜ from the current observation h0 and the cached residual. (Bottom) Schedule across inference chunks. Chunks are grouped into refresh intervals of length τ : every τ -th c… view at source ↗

**Figure 4.** Figure 4: Effect of cache-step range on success rate. On both benchmarks, longer caching steps causes a sharp drop in success rate 4.3 Ablation We keep the same τ values with longer cache-step ranges, [0, 8] and [0, 9]. As shown in [PITH_FULL_IMAGE:figures/full_fig_p008_4.png] view at source ↗

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Test-Time Scaling for World Action Models via Zero-Shot Geometric Evaluation
cs.RO 2026-07 conditional novelty 6.0

Cross-view depth consistency of predicted robot futures selects better rollouts and a cheap action-future gate decides when to sample, improving success on RoboCasa, LIBERO Long, and RoboTwin 2.0.

Reference graph

Works this paper leans on

34 extracted references · 1 canonical work pages · cited by 1 Pith paper · 1 internal anchor

[1]

Zitkovich, T

B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, J. Wu, P. Wohlhart, S. Welker, A. Wahid, Q. Vuong, V . Vanhoucke, H. Tran, R. Soricut, A. Singh, J. Singh, P. Sermanet, P. R. San- keti, G. Salazar, M. S. Ryoo, K. Reymann, K. Rao, K. Pertsch, I. Mordatch, H. Michalewski, Y . Lu, S. Levine, L. Lee, T.-W. E. Lee, I. Leal, Y . Kuang, D. Kalashnikov, R. Jul...

2023
[2]

M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. P. Foster, P. R. Sanketi, Q. Vuong, T. Kollar, B. Burchfiel, R. Tedrake, D. Sadigh, S. Levine, P. Liang, and C. Finn. OpenVLA: An open-source vision-language-action model. InProceedings of The 8th Conference on Robot Learning, volume 270 ofProceedings of Machine Learni...

2024
[3]

Black, N

K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Haus- man, B. Ichter, S. Jakubczak, T. Jones, L. Ke, S. Levine, A. Li-Bell, M. Mothukuri, S. Nair, K. Pertsch, L. X. Shi, L. Smith, J. Tanner, Q. Vuong, A. Walling, H. Wang, and U. Zhilin- sky.π 0: A vision-language-action flow model for general robot control. InProceedings...

2025
[4]

S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu. RDT-1B: A dif- fusion foundation model for bimanual manipulation. InInternational Conference on Learning Representations (ICLR), 2025

2025
[5]

S. Ye, Y . Ge, K. Zheng, S. Gao, S. Yu, G. Kurian, S. Indupuru, Y . L. Tan, C. Zhu, J. Xi- ang, A. Malik, K. Lee, W. Liang, N. Ranawaka, J. Gu, Y . Xu, G. Wang, F. Hu, A. Narayan, J. Bjorck, J. Wang, G. Kim, D. Niu, R. Zheng, Y . Xie, J. Wu, Q. Wang, R. Julian, D. Xu, Y . Du, Y . Chebotar, S. Reed, J. Kautz, Y . Zhu, L. Fan, and J. Jang. World action mode...

2026
[6]

Y . Du, M. Yang, B. Dai, H. Dai, O. Nachum, J. B. Tenenbaum, D. Schuurmans, and P. Abbeel. Learning universal policies via text-guided video generation. InAdvances in Neural Informa- tion Processing Systems (NeurIPS), 2023

2023
[7]

H. Wu, Y . Jing, C. Cheang, G. Chen, J. Xu, X. Li, M. Liu, H. Li, and T. Kong. Unleashing large- scale video generative pre-training for visual robot manipulation. InInternational Conference on Learning Representations (ICLR), 2024

2024
[8]

Y . Hu, Y . Guo, P. Wang, X. Chen, Y .-J. Wang, J. Zhang, K. Sreenath, C. Lu, and J. Chen. Video prediction policy: A generalist robot policy with predictive visual representations. In International Conference on Machine Learning (ICML), 2025

2025
[9]

Peebles and S

W. Peebles and S. Xie. Scalable diffusion models with transformers. InIEEE/CVF Interna- tional Conference on Computer Vision (ICCV), 2023

2023
[10]

T. Yin, Q. Zhang, R. Zhang, W. T. Freeman, F. Durand, E. Shechtman, and X. Huang. From slow bidirectional to fast autoregressive video diffusion models. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025
[11]

Y . Feng, C. Xiang, X. Mao, H. Tan, Z. Zhang, S. Huang, K. Zheng, H. Liu, H. Su, and J. Zhu. Vidarc: Embodied video diffusion model for closed-loop control, 2025

2025
[12]

Lipman, R

Y . Lipman, R. T. Q. Chen, H. Ben-Hamu, M. Nickel, and M. Le. Flow matching for generative modeling. InInternational Conference on Learning Representations (ICLR), 2023. 9

2023
[13]

X. Ma, G. Fang, and X. Wang. DeepCache: Accelerating diffusion models for free. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2024
[14]

Wimbauer, B

F. Wimbauer, B. Wu, E. Schoenfeld, X. Dai, J. Hou, Z. He, P. Zhang, S. Tsai, J. Kohler, A. Sanakoyeu, D. Cremers, C. Rupprecht, P. Vajda, and J. Wang. Cache me if you can: Accel- erating diffusion models through block caching. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2024
[15]

X. Ma, G. Fang, M. B. Mi, and X. Wang. Learning-to-cache: Accelerating diffusion trans- former via layer caching. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024
[16]

C. Zou, X. Liu, T. Liu, S. Huang, and L. Zhang. Accelerating diffusion transformers with token-wise feature caching. InInternational Conference on Learning Representations (ICLR), 2025

2025
[17]

X. Zhao, X. Jin, K. Wang, and Y . You. Real-time video generation with pyramid attention broadcast. InInternational Conference on Learning Representations (ICLR), 2025

2025
[18]

B. Liu, Y . Zhu, C. Gao, Y . Feng, Q. Liu, Y . Zhu, and P. Stone. LIBERO: Benchmarking knowledge transfer for lifelong robot learning. InAdvances in Neural Information Processing Systems (NeurIPS), 2023

2023
[19]

Y . Mu, T. Chen, Z. Chen, S. Peng, Z. Lan, Z. Gao, Z. Liang, Q. Yu, Y . Zou, M. Xu, L. Lin, Z. Xie, M. Ding, and P. Luo. RoboTwin: Dual-arm robot benchmark with generative digital twins. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025
[20]

T. Yuan, Z. Dong, Y . Liu, and H. Zhao. Fast-wam: Do world action models need test-time future imagination?, 2026

2026
[21]

F. Liu, S. Zhang, X. Wang, Y . Wei, H. Qiu, Y . Zhao, Y . Zhang, Q. Ye, and F. Wan. Timestep embedding tells: It’s time to cache for video diffusion model. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025
[22]

Kahatapitiya, H

K. Kahatapitiya, H. Liu, S. He, D. Liu, M. Jia, C. Zhang, M. S. Ryoo, and T. Xie. Adaptive caching for faster video generation with diffusion transformers. InIEEE/CVF International Conference on Computer Vision (ICCV), 2025

2025
[23]

Sun, R.-C

W. Sun, R.-C. Tu, Y . Ding, Z. Jin, J. Liao, S. Liu, and D. Tao. VORTA: Efficient video diffusion via routing sparse attention. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025
[24]

Zhang, J

Y . Zhang, J. Xing, B. Xia, S. Liu, B. Peng, X. Tao, P. Wan, E. Lo, and J. Jia. Training- free efficient video generation via dynamic token carving. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025
[25]

Z. Yuan, H. Zhang, P. Lu, X. Ning, L. Zhang, T. Zhao, S. Yan, G. Dai, and Y . Wang. DiT- FastAttn: Attention compression for diffusion transformer models. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024
[26]

W. Luan, J. Li, W. Zhao, W. Zhang, T. Wu, and R. Ma. Snapflow: One-step action generation for flow-matching vlas via progressive self-distillation, 2026

2026
[27]

B. Chen, D. Mart´ı Mons´o, Y . Du, M. Simchowitz, R. Tedrake, and V . Sitzmann. Diffusion forc- ing: Next-token prediction meets full-sequence diffusion. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024
[28]

K. Song, B. Chen, M. Simchowitz, Y . Du, R. Tedrake, and V . Sitzmann. History-guided video diffusion. InInternational Conference on Machine Learning (ICML), 2025. 10

2025
[29]

Huang, Z

X. Huang, Z. Li, G. He, M. Zhou, and E. Shechtman. Self forcing: Bridging the train-test gap in autoregressive video diffusion. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025
[30]

K. Gao, J. Shi, H. Zhang, C. Wang, J. Xiao, and L. Chen. Ca2-VDM: Efficient autoregressive video diffusion model with causal generation and cache sharing. InInternational Conference on Machine Learning (ICML), 2025

2025
[31]

Y . Zeng, J. Zheng, C. Zheng, S. Chen, M. Liu, T. Liu, T. Luo, Y . Zhang, B. Wang, L. Xu, S. Lu, B. Tian, and X. Liu. X-cache: Cross-chunk block caching for few-step autoregressive world models inference, 2026

2026
[32]

X. Liu, C. Gong, and Q. Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow. InInternational Conference on Learning Representations (ICLR), 2023

2023
[33]

Liang, L

W. Liang, L. Yu, L. Luo, S. Iyer, N. Dong, C. Zhou, G. Ghosh, M. Lewis, W. tau Yih, L. Zettle- moyer, and X. V . Lin. Mixture-of-transformers: A sparse and scalable architecture for multi- modal foundation models.Transactions on Machine Learning Research, 2025. ISSN 2835- 8856

2025
[34]

T. Wan, A. Wang, B. Ai, B. Wen, C. Mao, C.-W. Xie, D. Chen, F. Yu, H. Zhao, J. Yang, J. Zeng, J. Wang, J. Zhang, J. Zhou, J. Wang, J. Chen, K. Zhu, K. Zhao, K. Yan, L. Huang, M. Feng, N. Zhang, P. Li, P. Wu, R. Chu, R. Feng, S. Zhang, S. Sun, T. Fang, T. Wang, T. Gui, T. Weng, T. Shen, W. Lin, W. Wang, W. Wang, W. Zhou, W. Wang, W. Shen, W. Yu, X. Shi, X....

work page internal anchor Pith review Pith/arXiv arXiv 2025

[1] [1]

Zitkovich, T

B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, J. Wu, P. Wohlhart, S. Welker, A. Wahid, Q. Vuong, V . Vanhoucke, H. Tran, R. Soricut, A. Singh, J. Singh, P. Sermanet, P. R. San- keti, G. Salazar, M. S. Ryoo, K. Reymann, K. Rao, K. Pertsch, I. Mordatch, H. Michalewski, Y . Lu, S. Levine, L. Lee, T.-W. E. Lee, I. Leal, Y . Kuang, D. Kalashnikov, R. Jul...

2023

[2] [2]

M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. P. Foster, P. R. Sanketi, Q. Vuong, T. Kollar, B. Burchfiel, R. Tedrake, D. Sadigh, S. Levine, P. Liang, and C. Finn. OpenVLA: An open-source vision-language-action model. InProceedings of The 8th Conference on Robot Learning, volume 270 ofProceedings of Machine Learni...

2024

[3] [3]

Black, N

K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Haus- man, B. Ichter, S. Jakubczak, T. Jones, L. Ke, S. Levine, A. Li-Bell, M. Mothukuri, S. Nair, K. Pertsch, L. X. Shi, L. Smith, J. Tanner, Q. Vuong, A. Walling, H. Wang, and U. Zhilin- sky.π 0: A vision-language-action flow model for general robot control. InProceedings...

2025

[4] [4]

S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu. RDT-1B: A dif- fusion foundation model for bimanual manipulation. InInternational Conference on Learning Representations (ICLR), 2025

2025

[5] [5]

S. Ye, Y . Ge, K. Zheng, S. Gao, S. Yu, G. Kurian, S. Indupuru, Y . L. Tan, C. Zhu, J. Xi- ang, A. Malik, K. Lee, W. Liang, N. Ranawaka, J. Gu, Y . Xu, G. Wang, F. Hu, A. Narayan, J. Bjorck, J. Wang, G. Kim, D. Niu, R. Zheng, Y . Xie, J. Wu, Q. Wang, R. Julian, D. Xu, Y . Du, Y . Chebotar, S. Reed, J. Kautz, Y . Zhu, L. Fan, and J. Jang. World action mode...

2026

[6] [6]

Y . Du, M. Yang, B. Dai, H. Dai, O. Nachum, J. B. Tenenbaum, D. Schuurmans, and P. Abbeel. Learning universal policies via text-guided video generation. InAdvances in Neural Informa- tion Processing Systems (NeurIPS), 2023

2023

[7] [7]

H. Wu, Y . Jing, C. Cheang, G. Chen, J. Xu, X. Li, M. Liu, H. Li, and T. Kong. Unleashing large- scale video generative pre-training for visual robot manipulation. InInternational Conference on Learning Representations (ICLR), 2024

2024

[8] [8]

Y . Hu, Y . Guo, P. Wang, X. Chen, Y .-J. Wang, J. Zhang, K. Sreenath, C. Lu, and J. Chen. Video prediction policy: A generalist robot policy with predictive visual representations. In International Conference on Machine Learning (ICML), 2025

2025

[9] [9]

Peebles and S

W. Peebles and S. Xie. Scalable diffusion models with transformers. InIEEE/CVF Interna- tional Conference on Computer Vision (ICCV), 2023

2023

[10] [10]

T. Yin, Q. Zhang, R. Zhang, W. T. Freeman, F. Durand, E. Shechtman, and X. Huang. From slow bidirectional to fast autoregressive video diffusion models. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025

[11] [11]

Y . Feng, C. Xiang, X. Mao, H. Tan, Z. Zhang, S. Huang, K. Zheng, H. Liu, H. Su, and J. Zhu. Vidarc: Embodied video diffusion model for closed-loop control, 2025

2025

[12] [12]

Lipman, R

Y . Lipman, R. T. Q. Chen, H. Ben-Hamu, M. Nickel, and M. Le. Flow matching for generative modeling. InInternational Conference on Learning Representations (ICLR), 2023. 9

2023

[13] [13]

X. Ma, G. Fang, and X. Wang. DeepCache: Accelerating diffusion models for free. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2024

[14] [14]

Wimbauer, B

F. Wimbauer, B. Wu, E. Schoenfeld, X. Dai, J. Hou, Z. He, P. Zhang, S. Tsai, J. Kohler, A. Sanakoyeu, D. Cremers, C. Rupprecht, P. Vajda, and J. Wang. Cache me if you can: Accel- erating diffusion models through block caching. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2024

[15] [15]

X. Ma, G. Fang, M. B. Mi, and X. Wang. Learning-to-cache: Accelerating diffusion trans- former via layer caching. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024

[16] [16]

C. Zou, X. Liu, T. Liu, S. Huang, and L. Zhang. Accelerating diffusion transformers with token-wise feature caching. InInternational Conference on Learning Representations (ICLR), 2025

2025

[17] [17]

X. Zhao, X. Jin, K. Wang, and Y . You. Real-time video generation with pyramid attention broadcast. InInternational Conference on Learning Representations (ICLR), 2025

2025

[18] [18]

B. Liu, Y . Zhu, C. Gao, Y . Feng, Q. Liu, Y . Zhu, and P. Stone. LIBERO: Benchmarking knowledge transfer for lifelong robot learning. InAdvances in Neural Information Processing Systems (NeurIPS), 2023

2023

[19] [19]

Y . Mu, T. Chen, Z. Chen, S. Peng, Z. Lan, Z. Gao, Z. Liang, Q. Yu, Y . Zou, M. Xu, L. Lin, Z. Xie, M. Ding, and P. Luo. RoboTwin: Dual-arm robot benchmark with generative digital twins. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025

[20] [20]

T. Yuan, Z. Dong, Y . Liu, and H. Zhao. Fast-wam: Do world action models need test-time future imagination?, 2026

2026

[21] [21]

F. Liu, S. Zhang, X. Wang, Y . Wei, H. Qiu, Y . Zhao, Y . Zhang, Q. Ye, and F. Wan. Timestep embedding tells: It’s time to cache for video diffusion model. InIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

2025

[22] [22]

Kahatapitiya, H

K. Kahatapitiya, H. Liu, S. He, D. Liu, M. Jia, C. Zhang, M. S. Ryoo, and T. Xie. Adaptive caching for faster video generation with diffusion transformers. InIEEE/CVF International Conference on Computer Vision (ICCV), 2025

2025

[23] [23]

Sun, R.-C

W. Sun, R.-C. Tu, Y . Ding, Z. Jin, J. Liao, S. Liu, and D. Tao. VORTA: Efficient video diffusion via routing sparse attention. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025

[24] [24]

Zhang, J

Y . Zhang, J. Xing, B. Xia, S. Liu, B. Peng, X. Tao, P. Wan, E. Lo, and J. Jia. Training- free efficient video generation via dynamic token carving. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025

[25] [25]

Z. Yuan, H. Zhang, P. Lu, X. Ning, L. Zhang, T. Zhao, S. Yan, G. Dai, and Y . Wang. DiT- FastAttn: Attention compression for diffusion transformer models. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024

[26] [26]

W. Luan, J. Li, W. Zhao, W. Zhang, T. Wu, and R. Ma. Snapflow: One-step action generation for flow-matching vlas via progressive self-distillation, 2026

2026

[27] [27]

B. Chen, D. Mart´ı Mons´o, Y . Du, M. Simchowitz, R. Tedrake, and V . Sitzmann. Diffusion forc- ing: Next-token prediction meets full-sequence diffusion. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

2024

[28] [28]

K. Song, B. Chen, M. Simchowitz, Y . Du, R. Tedrake, and V . Sitzmann. History-guided video diffusion. InInternational Conference on Machine Learning (ICML), 2025. 10

2025

[29] [29]

Huang, Z

X. Huang, Z. Li, G. He, M. Zhou, and E. Shechtman. Self forcing: Bridging the train-test gap in autoregressive video diffusion. InAdvances in Neural Information Processing Systems (NeurIPS), 2025

2025

[30] [30]

K. Gao, J. Shi, H. Zhang, C. Wang, J. Xiao, and L. Chen. Ca2-VDM: Efficient autoregressive video diffusion model with causal generation and cache sharing. InInternational Conference on Machine Learning (ICML), 2025

2025

[31] [31]

Y . Zeng, J. Zheng, C. Zheng, S. Chen, M. Liu, T. Liu, T. Luo, Y . Zhang, B. Wang, L. Xu, S. Lu, B. Tian, and X. Liu. X-cache: Cross-chunk block caching for few-step autoregressive world models inference, 2026

2026

[32] [32]

X. Liu, C. Gong, and Q. Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow. InInternational Conference on Learning Representations (ICLR), 2023

2023

[33] [33]

Liang, L

W. Liang, L. Yu, L. Luo, S. Iyer, N. Dong, C. Zhou, G. Ghosh, M. Lewis, W. tau Yih, L. Zettle- moyer, and X. V . Lin. Mixture-of-transformers: A sparse and scalable architecture for multi- modal foundation models.Transactions on Machine Learning Research, 2025. ISSN 2835- 8856

2025

[34] [34]

T. Wan, A. Wang, B. Ai, B. Wen, C. Mao, C.-W. Xie, D. Chen, F. Yu, H. Zhao, J. Yang, J. Zeng, J. Wang, J. Zhang, J. Zhou, J. Wang, J. Chen, K. Zhu, K. Zhao, K. Yan, L. Huang, M. Feng, N. Zhang, P. Li, P. Wu, R. Chu, R. Feng, S. Zhang, S. Sun, T. Fang, T. Wang, T. Gui, T. Weng, T. Shen, W. Lin, W. Wang, W. Wang, W. Zhou, W. Wang, W. Shen, W. Yu, X. Shi, X....

work page internal anchor Pith review Pith/arXiv arXiv 2025