Pith. sign in

REVIEW 3 major objections 5 minor 74 references

OSVE claims text-guided video editing can run in one step without losing quality—about 155–171 times faster than multi-step methods.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

T0 review · deepseek-v4-flash

2026-08-01 11:22 UTC pith:7XVHERLI

load-bearing objection A clever one-step video editing pipeline that delivers the speed it promises, but the quality claims rest on a narrow self-curated evaluation and a training signal that may not cover real edit prompts. the 3 major comments →

arxiv 2607.19895 v1 pith:7XVHERLI submitted 2026-07-22 cs.CV cs.AI

OSVE: One Step Video Editing with One Step Diffusion Models

classification cs.CV cs.AI
keywords one-step diffusionvideo editinglearnable inversionstructure-aware losstemporal consistencyunified-frame editingtext-guided editingreal-time video editing
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper tries to establish that the speed bottleneck of text-guided video editing—multi-step diffusion inversion and sampling—can be removed by building an editing pipeline where both inversion and generation are single forward passes. To do this it trains a learnable encoder that maps each video frame directly to an initial noise latent, using a novel Structure-Aware Editing (SAE) loss on synthetic, generator-aligned image pairs so that the latent preserves geometry under a changed prompt. Temporal consistency is then obtained not by controlling attention during sampling but by concatenating frame latents and letting the one-step model's self-attention operate across all frames at once. If the claims hold, practical real-time video editing becomes possible without sacrificing visual quality.

Core claim

The central claim is that one-step text-to-image models can be adapted for high-quality video editing if structure is encoded into the initial noise latent before generation, rather than imposed through multi-step control. The paper demonstrates this with a two-part mechanism: a learned inversion encoder trained with a Structure-Aware Editing loss on image pairs generated from the same noise under slightly perturbed prompts, and Unified-Frame Editing, which concatenates inverted frame latents so the generator's self-attention aligns them in a single pass. The authors report reconstruction and editing quality on par with or better than strong multi-step baselines, while being roughly 155–171

What carries the argument

The load-bearing object is the learnable inversion encoder, initialized from the one-step generator's U-Net, that predicts a per-frame initial noise latent. It is trained with the Structure-Aware Editing (SAE) loss, which jointly enforces reconstruction and matching a pre-generated 'edited' target from the same noise; because the targets come from the same generator under small prompt-embedding perturbations, the training pairs share structure by construction. Temporal consistency is carried by Unified-Frame Editing (UFE), which spatially concatenates frame latents along the width axis so the one-step U-Net's self-attention sees all frames at once; a sliding window with a medoid anchor exten

Load-bearing premise

That an encoder trained on synthetic image pairs produced by the target generator will transfer to real video frames well enough that the predicted initial noise preserves geometry; if real frames lie outside the generator's output manifold, the single-pass inversion can silently destroy structure despite the SAE loss.

What would settle it

Take a set of real videos that are far from the one-step generator's natural-image distribution (e.g., hand-drawn animation or heavy fisheye footage), edit them with OSVE, and measure DINO-based structural distance between source frames and edited frames. If structure distance spikes relative to natural videos, or if the SAE-trained encoder's reconstruction PSNR drops sharply, the generator-aligned synthetic-pair assumption is violated.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • Video editing latency drops from tens of seconds or minutes per clip to sub-second per window, enabling real-time or streaming-style use.
  • Structure preservation in one-step editing can come from the latent itself, removing the need for external guidance modules that fail in a single pass.
  • The SAE training recipe—generator-aligned pairs from prompt perturbation—could be reused to train inversion encoders for other one-step generators.
  • The UFE concatenation scheme gives one-step T2I models cross-frame awareness without temporal modules, a result that transfers to any U-Net-based one-step generator.
  • The anchor-based sliding window keeps peak GPU memory independent of video length, so long videos are affordable.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • If the transfer-from-synthetic-pairs assumption holds broadly, the same encoder-plus-SAE design could be applied to other one-step generators with minimal changes, potentially leapfrogging multi-step editing in scenarios where speed matters.
  • The paper leaves open whether UFE's cross-frame attention truly corresponds to matched semantic features; a natural extension is to visualize attention maps between frames to confirm the alignment mechanism, and to test whether UFE also improves zero-shot one-step video generation (not just editing).
  • The approach's reliance on a frozen one-step T2I backbone suggests that the same principles can be lifted to one-step T2V models once their generation quality matures; the paper's own appendix notes current one-step T2V is not yet usable.
  • A key untested boundary is out-of-distribution input: real frames that deviate from the generator's natural-image manifold (animation, heavy compression, unusual camera optics) may break the inversion encoder's structural guarantee, offering a concrete stress test.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes OSVE, a framework for text-guided video editing using one-step diffusion models. The core components are: (i) a learnable inversion encoder I_phi that maps each VAE-encoded source frame z0 and source prompt embedding c to an initial noise latent zT in a single forward pass, trained with a reconstruction loss and a Structure-Aware Editing (SAE) loss on synthetic image pairs generated by the frozen one-step generator G_theta itself; and (ii) Unified-Frame Editing (UFE), which concatenates per-frame inverted latents along the width axis so that the one-step U-Net's self-attention can operate across frames, extended with a sliding-window and anchor-frame mechanism for long videos. The authors claim that OSVE achieves editing quality comparable or superior to state-of-the-art multi-step video-editing methods while being roughly 155–171 times faster, and they position it as the first successful adaptation of one-step T2I models to high-quality video editing.

Significance. If the claims are substantiated, the contribution is significant: it opens a practical route to near-real-time video editing on a one-step T2I backbone, and the generator-aligned synthetic-pair training idea is a sensible way to avoid off-manifold supervision. The paper also ships useful ablations for each component, a thoughtful analysis of the inverted latents (element-wise Gaussianity with low-frequency spatial structure), and public code. However, the central 'comparable or superior quality' claim currently rests on a small self-curated evaluation with no error bars and a custom metric, and the training distribution used for the SAE loss is narrow relative to the natural-language edits used in evaluation. These issues are fixable but require additional evidence before the headline claim is established.

major comments (3)
  1. [§3.1, Eq. (1), Table A] The SAE loss is trained only on c_edit = c + λ_noise·η with λ_noise = 0.1 and η ~ N(0,I). This is an isotropic random perturbation of the prompt embedding, not a natural-language edit. The evaluation prompts (object replacement, deletion, style transfer, background modification) are structured semantic changes whose embedding displacements likely differ substantially in direction and magnitude from the training perturbations. The paper gives no measurement of the evaluation-prompt displacement relative to the training scale, and no experiment showing that the encoder generalizes outside the narrow λ_noise=0.1 regime. Since L_sae is the only mechanism that explicitly injects editability into the inversion latent, this distribution gap is load-bearing for the claimed editing quality. Please add (i) a quantitative comparison of training vs. evaluation prompt-embedding displacements, and (ii
  2. [§4.2, Tables 2–3] The headline 'comparable or superior to state-of-the-art multi-step methods' rests on a self-curated 60-video benchmark (51 short, 9 long) with no error bars and no significance tests, plus a custom multiplicative BQS metric. On short videos OSVE scores BQS 0.679 versus TokenFlow 0.663 and COVE 0.639; on long videos 0.677 versus 0.633/0.633. These are modest differences, and OSVE does not win every component (e.g., TF on short videos is 0.978 vs TokenFlow 0.985). The user study is also small (26 participants, 3 videos each). Please report variance over videos/prompts, per-prompt breakdowns, and standard metrics (e.g., TGVE/LOVEU structure and CLIP scores), and provide confidence intervals or statistical tests for the user study. Without this, the quality-equivalence claim is not established at the paper's current evidence level.
  3. [§4.2, Tables 2–3] The comparison to Multi-to-Multi baselines confounds method with backbone: all Multi-to-Multi baselines use SD1.5, while OSVE uses DMD2, a substantially stronger one-step generator. The Multi-to-One rows are the appropriate same-backbone comparison and OSVE clearly leads there, but the abstract and conclusion phrase the result as beating state-of-the-art multi-step methods. Please either soften the claim to 'competitive with multi-step methods' or add a same-backbone reference that isolates the contribution of the proposed encoder, and discuss how much of the BQS gap is attributable to the DMD2 backbone rather than the OSVE framework.
minor comments (5)
  1. [§3.1] The term 'curated dataset' overstates the construction: the pairs are generated automatically by prompt-embedding perturbation, not human-curated. Consider calling it a 'synthetic generator-aligned dataset' to avoid misleading readers.
  2. [Table F, Fig. 3] The definition of 'CLIP distance' is ambiguous and appears inconsistent: at λ_noise=0 the source and edited images are identical, so a distance of 1.00 (with 'lower is better') is puzzling. Please clarify the metric direction and normalization.
  3. [Supplementary H, Eq. (7)] The use of c for grid columns in Eq. (7) conflicts with the prompt embedding c used throughout the paper. Rename the grid dimension, e.g., n_c or w_col.
  4. [Abstract and §1] The phrase 'sub-second latency' is ambiguous. Table 2 reports 15.6 FPS for OSVE, which for a 20-frame clip is about 1.28 seconds total. Clarify whether the claim is per-frame latency or total clip latency.
  5. [§3.2] The claim that width-concatenation makes self-attention 'align corresponding features' is cited from prior work but not verified for the DMD2 one-step U-Net. The ablation shows UFE helps, but a direct check (e.g., attention maps or an order-permutation baseline) would make the mechanism claim more convincing.

Circularity Check

0 steps flagged

No significant circularity: OSVE's inversion encoder is trained on generator-produced pairs by design, but editing quality is independently benchmarked on real videos and PIE-Bench; self-citations are not load-bearing.

full rationale

The central derivation chain is not circular. The encoder I_phi is trained to invert the frozen one-step generator G_theta: targets z0=G_theta(z_T,c) and z0_edit=G_theta(z_T,c_edit) are supervised labels for learning the map I_phi(z0,c)->z_T. Using the generator's own outputs as inversion targets is the correct (and only well-posed) training signal for an inverse mapping, not a disguised prediction. The claimed editing quality is then tested on real videos with standard VBench metrics (Tables 2-3), on PIE-Bench for the ablation (Table 5), and by a 26-participant user study (Table 4); these are external to the training distribution. The UFE temporal-consistency mechanism is justified by an independent prior-work citation (Tang et al., 'Emergent Correspondence from Image Diffusion'), not by a self-citation chain; the paper's self-citations (ConceptSplit, WINE, InST) appear only in Related Work and are not load-bearing. The choice lambda_noise=0.1 and the fact that training 'edits' are small random prompt perturbations is a generalization/calibration risk - real edit prompts may lie outside the training regime - but that is a correctness concern, not a reduction of the result to its inputs. One minor caveat: Table 1's reconstruction comparison does not state whether the evaluation images are held out from the encoder's training set; if it is in-distribution synthetic data, that table is weaker evidence, but the central real-video benchmarks do not depend on it. No step in the derivation equates a fitted parameter to a claimed prediction by construction.

Axiom & Free-Parameter Ledger

5 free parameters · 5 axioms · 0 invented entities

No new physical entities are postulated. The main free parameters are hyperparameters fitted on the authors' own ablation sets (λ_noise, window/stride, anchor strategy). The most consequential unproven premises are the synthetic-to-real transfer of the inversion encoder and the emergent cross-frame attention of a one-step generator on concatenated latents.

free parameters (5)
  • λ_noise (prompt perturbation strength) = 0.1
    Controls the noise added to the prompt embedding in Eq. (1). Chosen via ablation on 100 synthetic dog-image pairs (Fig. 3, Table A) to trade structure preservation against semantic change.
  • λ_sae (SAE loss weight) = 1.0
    Weight of the Structure-Aware Editing loss in Eq. (3). Set to 1.0 without a reported sensitivity study.
  • Window size w = 7
    UFE sliding-window size, chosen via ablation on 90-frame videos (Table E) as a trade-off between temporal consistency and throughput.
  • Stride s = 5
    Sliding-window stride, chosen via ablation (Table E); controls compute overlap between windows.
  • Anchor-frame selection strategy = DINO-medoid
    Selected among seven anchor strategies (Table C) based on BQS; absolute differences are tiny (0.676 vs 0.673 for random).
axioms (5)
  • domain assumption DMD2 one-step T2I generator produces high-quality images and its U-Net self-attention exhibits emergent cross-frame correspondence when latents are spatially concatenated.
    The whole framework is instantiated on DMD2; UFE (Section 3.2) assumes that concatenating frame latents makes self-attention align 'the tiger's nose' across frames, citing emergent-correspondence work [57] without re-verifying on DMD2.
  • domain assumption Prompt perturbation with λ_noise=0.1 produces structurally similar image pairs across the diversity of LAION and JourneyDB prompts.
    Justified empirically on 100 pairs from a single base prompt ('a photo of a dog', Fig. 3); the dataset-generation section assumes this holds for all sampled prompts (§3.1).
  • ad hoc to paper An encoder trained on G_θ-generated synthetic pairs transfers to real video frames.
    Central premise: the inversion encoder sees only generator-aligned synthetic images during training, yet is applied to real videos at inference; no domain adaptation is used (§3.1).
  • domain assumption The U-Net accepts arbitrarily wide concatenated latents (non-square aspect ratios) without meaningful quality degradation.
    UFE builds maps of width W·K (Eq. 5); the paper relies on 'the U-Net operates on spatial features and naturally accepts inputs of arbitrary size' (§3.2).
  • domain assumption Sliding-window stitching around a single anchor frame prevents long-range temporal drift.
    Used for long videos; supported only by the method's own ablations (Tables D–E) and a multi-anchor extension in the supplement.

pith-pipeline@v1.3.0-alltime-deepseek · 32033 in / 14126 out tokens · 153679 ms · 2026-08-01T11:22:48.613822+00:00 · methodology

0 comments
read the original abstract

Text-guided video editing with diffusion models is impractically slow, hindered by costly multi-step sampling and inversion. We present OSVE, the first framework to successfully adapt one-step Text-to-Image (T2I) models for high-quality video editing, addressing the core challenges of inversion, editability, and temporal consistency. To bypass slow iterative inversion, we train a learnable encoder that predicts the initial noise for each frame in a single forward pass. This encoder is trained with a novel Structure-Aware Editing (SAE) loss on a curated dataset of structurally-aligned image pairs, teaching it to preserve the source video's geometry during edits. For temporal coherence, we introduce Unified-Frame Editing (UFE), a technique that concatenates frame latents to facilitate cross-frame attention in a single generation step. Furthermore, for long videos, a sliding-window strategy with an anchor frame maintains global consistency. Our extensive experiments demonstrate that OSVE achieves editing quality comparable or superior to state-of-the-art multi-step methods, while operating approximately 155--171 times faster. This breakthrough paves the way for practical, real-time video editing applications. Code is available at https://github.com/KU-VGI/OSVE.

Figures

Figures reproduced from arXiv: 2607.19895 by Gyeong-Moon Park, Habin Lim.

Figure 1
Figure 1. Figure 1: Three frameworks for text-guided video editing. [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Overview of our OSVE framework for one-step video editing. [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Structural (DINO) and semantic (CLIP) distances as λnoise varies. on off-the-shelf2 editing pairs yields notably lower reconstruction quality than ours across all metrics, indicating that the mismatched supervision corrupts the encoder’s overall latent representation. We also report DDIM 50-step inver￾sion [53] as a baseline, which performs worst due to the fundamental inversion– generation mismatch discus… view at source ↗
Figure 4
Figure 4. Figure 4: Comparison of structure-preserving methods for one-step editing. [PITH_FULL_IMAGE:figures/full_fig_p008_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Mechanism of Unified-Frame Editing for Temporal Consistency. [PITH_FULL_IMAGE:figures/full_fig_p009_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Qualitative comparison with baseline methods. 4.2 Quantitative Comparison We adopt VBench [14] metrics for quantitative evaluation, organized into two categories. Temporal consistency metrics include: Subject Consistency (SC), measuring subject identity preservation via DINO [4] features; Background Con￾sistency (BC), assessing background stability via CLIP [43] features; Tempo￾ral Flickering (TF), where h… view at source ↗
Figure 7
Figure 7. Figure 7: Qualitative results with OSVE across various editing tasks. ity Score (BQS): BQS = SC+BC+TF+MS 4  ×  AQ+IQ 2  , which balances both dimensions multiplicatively, penalizing methods that excel in only one. Tables 2 and 3 present the results for short and long videos, respectively. Our method, OSVE, achieves the highest BQS in both settings, demonstrating strong temporal consistency and per-frame quality s… view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

74 extracted references · 23 linked inside Pith

  1. [1]

    arXiv preprint arXiv:2401.12945 (2024).https://doi.org/10.48550/arXiv

    Bar-Tal, O., Chefer, H., Tov, O., Herrmann, C., Paiss, R., Zada, S., Ephrat, A., Hur, J., Liu, G., Raj, A., Li, Y., Rubinstein, M., Michaeli, T., Wang, O., Sun, D., Dekel, T., Mosseri, I.: Lumiere: A space-time diffusion model for video genera- tion. arXiv preprint arXiv:2401.12945 (2024).https://doi.org/10.48550/arXiv. 2401.12945

  2. [2]

    arXiv preprint arXiv:2601.09881 (2026)

    Berner, J., et al.: Transition matching distillation for fast video generation. arXiv preprint arXiv:2601.09881 (2026)

  3. [3]

    arXiv preprint arXiv:2211.09800 (2022)

    Brooks, T., Holynski, A., Efros, A.A.: InstructPix2Pix: Learning to follow image editing instructions. arXiv preprint arXiv:2211.09800 (2022)

  4. [4]

    In: Proceedings of the IEEE/CVF international conference on computer vision

    Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., Joulin, A.: Emerging properties in self-supervised vision transformers. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 9650–9660 (2021)

  5. [5]

    arXiv preprint arXiv:2508.21019 (2025)

    Cheng, o.: POSE: Phased one-step adversarial equilibrium for video diffusion mod- els. arXiv preprint arXiv:2508.21019 (2025)

  6. [6]

    Cong, Y., Xu, M., Simon, C., Chen, S., Ren, J., Xie, Y., Perez-Rua, J.M., Rosen- hahn, B., Xiang, T., He, S.: Flatten: optical flow-guided attention for consistent text-to-video editing (2024),https://arxiv.org/abs/2310.05922

  7. [7]

    In: European Conference on Computer Vision

    Dao, T., Nguyen, T.H., Le, T., Vu, D., Nguyen, K., Pham, C., Tran, A.: Swift- brush v2: Make your one-step diffusion model better than its teacher. In: European Conference on Computer Vision. pp. 176–192. Springer (2024)

  8. [8]

    In: Proceedings of the IEEE/CVF International Conference on Computer Vision (2025)

    Ding, Z., Jin, C., Liu, D., Zheng, H., Singh, K.K., Zhang, Q., Kang, Y., Lin, Z., Liu, Y.: Dollar: Few-step video generation via distillation and latent reward optimiza- tion. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (2025)

  9. [9]

    arXiv preprint arXiv:2307.10373 (2023)

    Geyer, M., Bar-Tal, O., Bagon, S., Dekel, T.: Tokenflow: Consistent diffusion fea- tures for consistent video editing. arXiv preprint arXiv:2307.10373 (2023)

  10. [10]

    arXiv preprint arXiv:2602.01814 (2025)

    GPD Authors: GPD: Guided progressive distillation for fast and high-quality video generation. arXiv preprint arXiv:2602.01814 (2025)

  11. [11]

    HaCohen, Y., Chiprut, N., Brazowski, B., Shalem, D., Moshe, D., Richardson, E., Levin, E., Shiran, G., Zabari, N., Gordon, O., Panet, P., Weissbuch, S., Kulikov, V., Bitterman, Y., Melumian, Z., Bibi, O.: Ltx-video: Realtime video latent diffusion (2024),https://arxiv.org/abs/2501.00103

  12. [12]

    In: The Eleventh In- ternational Conference on Learning Representations (2023),https://openreview

    Hertz, A., Mokady, R., Tenenbaum, J., Aberman, K., Pritch, Y., Cohen-or, D.: Prompt-to-prompt image editing with cross-attention control. In: The Eleventh In- ternational Conference on Learning Representations (2023),https://openreview. net/forum?id=_CDixzkzeyb

  13. [13]

    NeurIPS pp

    Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. NeurIPS pp. 6840–6851 (2020)

  14. [14]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Huang, Z., He, Y., Yu, J., Zhang, F., Si, C., Jiang, Y., Zhang, Y., Wu, T., Jin, Q., Chanpaisit, N., et al.: Vbench: Comprehensive benchmark suite for video gener- ative models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 21807–21818 (2024)

  15. [15]

    arXiv preprint arXiv:2503.07598 (2025).https://doi.org/10.48550/arXiv.2503.07598

    Jiang, Z., et al.: Vace: All-in-one video creation and editing. arXiv preprint arXiv:2503.07598 (2025).https://doi.org/10.48550/arXiv.2503.07598

  16. [16]

    In: The Twelfth International Conference on Learning Representations (2024),https://openreview.net/forum?id=FoMZ4ljhVw 34 H

    Ju, X., Zeng, A., Bian, Y., Liu, S., Xu, Q.: Pnp inversion: Boosting diffusion-based editing with 3 lines of code. In: The Twelfth International Conference on Learning Representations (2024),https://openreview.net/forum?id=FoMZ4ljhVw 34 H. Lim and G.-M. Park

  17. [17]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Kara, O., Kurtkaya, B., Yesiltepe, H., Rehg, J.M., Yanardag, P.: Rave: Random- ized noise shuffling for fast and consistent video editing with diffusion models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 6507–6516 (2024)

  18. [18]

    In: Proceedings of the IEEE/CVF international conference on computer vision

    Ke, J., Wang, Q., Wang, Y., Milanfar, P., Yang, F.: Musiq: Multi-scale image quality transformer. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 5148–5157 (2021)

  19. [19]

    Kingma,D.P.,Welling,M.:Auto-encodingvariationalbayes.In:InternationalCon- ference on Learning Representations (ICLR) (2014)

  20. [20]

    arXiv preprintarXiv:2412.03603(2024).https://doi.org/10.48550/arXiv.2412.03603

    Kong, W., Tian, Q., Zhang, Z., Min, R., Dai, Z., Zhou, J., Xiong, J., Li, X., Wu, B., Zhang, J., Wu, K., Lin, Q., Yuan, J., Long, Y., Wang, A., Wang, A., Li, C., Huang, D., Yang, F., Tan, H., Wang, H., Song, J., Bai, J., Wu, J., Xue, J., Wang, J., Wang, K., Liu, M., Li, P., Li, S., Wang, W., Yu, W., Deng, X., Li, Y., Chen, Y., Cui, Y., Peng, Y., Yu, Z., H...

  21. [21]

    com / LAION - AI / aesthetic - predictor(2022), accessed: 2025-09-25

    LAION-AI: aesthetic-predictor.https : / / github . com / LAION - AI / aesthetic - predictor(2022), accessed: 2025-09-25

  22. [22]

    In: Advances in Neural Information Processing Systems (2024)

    Li, J., Feng, W., Fu, T.J., Wang, X., Basu, S., Chen, W., Wang, W.Y.: T2v-turbo: Breaking the quality bottleneck of video consistency model with mixed reward feedback. In: Advances in Neural Information Processing Systems (2024)

  23. [23]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Li, Z., Zhu, Z.L., Han, L.H., Hou, Q., Guo, C.L., Cheng, M.M.: Amt: All-pairs multi-field transforms for efficient frame interpolation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 9801– 9810 (2023)

  24. [24]

    In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (2025)

    Lim, H., Won, Y., Seo, J., Park, G.M.: Conceptsplit: Decoupled multi-concept per- sonalization of diffusion models via token-wise adaptation and attention disentan- glement. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (2025)

  25. [25]

    arXiv preprint arXiv:2402.13929 (2024)

    Lin, S., Wang, A., Yang, X.: Sdxl-lightning: Progressive adversarial diffusion dis- tillation. arXiv preprint arXiv:2402.13929 (2024)

  26. [27]

    arXiv preprint arXiv:2501.08316 (2025)

    Lin, S., Xia, X., Ren, Y., Yang, C., Xiao, X., Jiang, L.: Diffusion adversarial post- training for one-step video generation. arXiv preprint arXiv:2501.08316 (2025)

  27. [28]

    arXiv preprint arXiv:2403.12706 (2024)

    Lin, S., Yang, X.: Animatediff-lightning: Cross-model diffusion distillation. arXiv preprint arXiv:2403.12706 (2024)

  28. [29]

    In: Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition

    Liu, S., Zhang, Y., Li, W., Lin, Z., Jia, J.: Video-p2p: Video editing with cross- attention control. In: Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition. pp. 8599–8608 (2024)

  29. [30]

    In: The Eleventh International Conference on Learning Representations (ICLR) (2023)

    Liu, X., Gong, C., Liu, Q.: Flow straight and fast: Learning to generate and transfer data with rectified flow. In: The Eleventh International Conference on Learning Representations (ICLR) (2023)

  30. [31]

    In: The Twelfth Interna- tional Conference on Learning Representations (2023)

    Liu, X., Zhang, X., Ma, J., Peng, J., et al.: Instaflow: One step is enough for high-quality diffusion-based text-to-image generation. In: The Twelfth Interna- tional Conference on Learning Representations (2023)

  31. [32]

    In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 3431–3440 (2015) OSVE: One Step Video Editing with One Step Diffusion Models 35

  32. [33]

    In: International Conference on Learning Representations

    Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. In: International Conference on Learning Representations

  33. [34]

    arXiv preprint arXiv:2310.04378 (2023)

    Luo, S., Tan, Y., Huang, L., Li, J., Zhao, H.: Latent consistency mod- els: Synthesizing high-resolution images with few-step inference. arXiv preprint arXiv:2310.04378 (2023)

  34. [35]

    In: CVPR (2025)

    Mao,X.,etal.: OSV:Onestepisenoughforhigh-qualityimagetovideogeneration. In: CVPR (2025)

  35. [36]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Mokady, R., Hertz, A., Aberman, K., Pritch, Y., Cohen-Or, D.: Null-text inver- sion for editing real images using guided diffusion models. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 6038–6047 (2023)

  36. [37]

    In: Proceedings of the IEEE/CVF Winter Confer- ence on Applications of Computer Vision (WACV) (2025)

    Moon, S.J., Kim, C., Park, G.M.: WINE: Wavelet-guided GAN inversion and edit- ing for high-fidelity refinement. In: Proceedings of the IEEE/CVF Winter Confer- ence on Applications of Computer Vision (WACV) (2025)

  37. [38]

    In: European Conference on Computer Vision (ECCV)

    Moon, S.J., Park, G.M.: Interestyle: Encoding an interest region for robust stylegan inversion. In: European Conference on Computer Vision (ECCV). pp. 460–476. Springer (2022)

  38. [39]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

    Nguyen, T.H., Tran, A.: Swiftbrush: One-step text-to-image diffusion model with variational score distillation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 7807–7816 (2024)

  39. [40]

    OpenAI: Video generation models as world simulators. Tech. rep., OpenAI (Feb 2024)

  40. [41]

    ICCV (2023)

    Qi, C., Cun, X., Zhang, Y., Lei, C., Wang, X., Shan, Y., Chen, Q.: Fatezero: Fusing attentions for zero-shot text-based video editing. ICCV (2023)

  41. [42]

    Qu, L., Zhang, H., Liu, Y., Wang, X., Jiang, Y., Gao, Y., Ye, H., Du, D.K., Yuan, Z., Wu, X.: Tokenflow: Unified image tokenizer for multimodal understanding and generation (2024),https://arxiv.org/abs/2412.03069

  42. [43]

    In: International conference on machine learning

    Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International conference on machine learning. pp. 8748–8763. PMLR (2021)

  43. [44]

    ACM Transactions on graphics (TOG)42(1), 1–13 (2022)

    Roich, D., Mokady, R., Bermano, A.H., Cohen-Or, D.: Pivotal tuning for latent- based editing of real images. ACM Transactions on graphics (TOG)42(1), 1–13 (2022)

  44. [45]

    In: CVPR

    Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: CVPR. pp. 10684–10695 (2022)

  45. [46]

    In: International Conference on Medical image computing and computer-assisted intervention

    Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedi- cal image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. pp. 234–241. Springer (2015)

  46. [47]

    arXiv preprint arXiv:2202.00512 (2022)

    Salimans, T., Ho, J.: Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512 (2022)

  47. [48]

    In: European Conference on Computer Vision

    Sauer, A., Lorenz, D., Blattmann, A., Rombach, R.: Adversarial diffusion distilla- tion. In: European Conference on Computer Vision. pp. 87–103. Springer (2024)

  48. [49]

    In: ECCV (2025)

    Sauer, A., Lorenz, D., Blattmann, A., Rombach, R.: Adversarial diffusion distilla- tion. In: ECCV (2025)

  49. [50]

    arXiv preprint arXiv:2111.02114 (2021)

    Schuhmann, C., Vencu, R., Beaumont, R., Kaczmarczyk, R., Mullis, C., Katta, A., Coombes,T.,Jitsev,J.,Komatsuzaki,A.:Laion-400m:Opendatasetofclip-filtered 400 million image-text pairs. arXiv preprint arXiv:2111.02114 (2021)

  50. [51]

    arXiv preprint arXiv:2510.02283 (2025) 36 H

    Self-Forcing++ Authors: Self-forcing++: Towards minute-scale high-quality video generation. arXiv preprint arXiv:2510.02283 (2025) 36 H. Lim and G.-M. Park

  51. [52]

    In: Bach, F., Blei, D

    Sohl-Dickstein, J., Weiss, E., Maheswaranathan, N., Ganguli, S.: Deep unsuper- vised learning using nonequilibrium thermodynamics. In: Bach, F., Blei, D. (eds.) Proceedings of the 32nd International Conference on Machine Learning. Proceed- ings of Machine Learning Research, vol. 37, pp. 2256–2265. PMLR, Lille, France (07–09 Jul 2015),https://proceedings.m...

  52. [53]

    arXiv preprint arXiv:2010.02502 (2020)

    Song, J., Meng, C., Ermon, S.: Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 (2020)

  53. [54]

    Song, Y., Dhariwal, P., Chen, M., Sutskever, I.: Consistency models (2023)

  54. [55]

    arXiv preprint arXiv:2011.13456 (2020)

    Song, Y., Sohl-Dickstein, J., Kingma, D.P., Kumar, A., Ermon, S., Poole, B.: Score- based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 (2020)

  55. [56]

    Advances in neural information processing systems36, 49659–49678 (2023)

    Sun, K., Pan, J., Ge, Y., Li, H., Duan, H., Wu, X., Zhang, R., Zhou, A., Qin, Z., Wang, Y., et al.: Journeydb: A benchmark for generative image understanding. Advances in neural information processing systems36, 49659–49678 (2023)

  56. [57]

    Advances in Neural Information Processing Systems 36, 1363–1389 (2023)

    Tang, L., Jia, M., Wang, Q., Phoo, C.P., Hariharan, B.: Emergent correspon- dence from image diffusion. Advances in Neural Information Processing Systems 36, 1363–1389 (2023)

  57. [58]

    ACM Transactions on Graphics (TOG)40(4), 1–14 (2021)

    Tov, O., Alaluf, Y., Nitzan, Y., Patashnik, O., Cohen-Or, D.: Designing an encoder for stylegan image manipulation. ACM Transactions on Graphics (TOG)40(4), 1–14 (2021)

  58. [59]

    In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition

    Tumanyan, N., Geyer, M., Bagon, S., Dekel, T.: Plug-and-play diffusion features for text-driven image-to-image translation. In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition. pp. 1921–1930 (2023)

  59. [60]

    Wan, T., Wang, A., Ai, B., Wen, B., Mao, C., Xie, C.W., Chen, D., Yu, F., Zhao, H., Yang, J., Zeng, J., Wang, J., Zhang, J., Zhou, J., Wang, J., Chen, J., Zhu, K., Zhao, K., Yan, K., Huang, L., Feng, M., Zhang, N., Li, P., Wu, P., Chu, R., Feng, R., Zhang, S., Sun, S., Fang, T., Wang, T., Gui, T., Weng, T., Shen, T., Lin, W., Wang, W., Wang, W., Zhou, W.,...

  60. [61]

    Advances in Neural Information Processing Systems37, 96541–96565 (2024)

    Wang, J., Ma, Y., Guo, J., Xiao, Y., Huang, G., Li, X.: Cove: Unleashing the diffusion feature correspondence for consistent video editing. Advances in Neural Information Processing Systems37, 96541–96565 (2024)

  61. [62]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2025)

    Wang, Y., et al.: Videodirector: Precise video editing via text-to-video models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2025)

  62. [63]

    Wu, J.Z., Ge, Y., Wang, X., Lei, W., Gu, Y., Shi, Y., Hsu, W., Shan, Y., Qie, X., Shou, M.Z.: Tune-a-video: One-shot tuning of image diffusion models for text-to- video generation (2023),https://arxiv.org/abs/2212.11565

  63. [64]

    ACM Computing Surveys57(2), 1–42 (2024)

    Xing, Z., Feng, Q., Chen, H., Dai, Q., Hu, H., Xu, H., Wu, Z., Jiang, Y.G.: A survey on video diffusion models. ACM Computing Surveys57(2), 1–42 (2024)

  64. [65]

    Yang, S., Zhou, Y., Liu, Z., Loy, C.C.: Fresco: Spatial-temporal correspondence for zero-shot video translation (2024),https://arxiv.org/abs/2403.12962

  65. [66]

    arXiv preprint arXiv:2511.01419 (2025) OSVE: One Step Video Editing with One Step Diffusion Models 37

    Yang, Y., Li, X., Zhang, H., Li, Z., Shechtman, E., Li, Y.: Towards one-step causal video generation via adversarial self-distillation. arXiv preprint arXiv:2511.01419 (2025) OSVE: One Step Video Editing with One Step Diffusion Models 37

  66. [67]

    arXiv preprint arXiv:2408.06072 (2024)

    Yang, Z., Teng, J., Zheng, W., Ding, M., Huang, S., Xu, J., Yang, Y., Hong, W., Zhang, X., Feng, G., Yin, D., Zhang, Y., Wang, W., Cheng, Y., Xu, B., Gu, X., Dong, Y., Tang, J.: Cogvideox: Text-to-video diffusion models with an expert transformer. arXiv preprint arXiv:2408.06072 (2024)

  67. [68]

    Advances in neural information processing systems37, 47455–47487 (2024)

    Yin, T., Gharbi, M., Park, T., Zhang, R., Shechtman, E., Durand, F., Freeman, B.: Improved distribution matching distillation for fast image synthesis. Advances in neural information processing systems37, 47455–47487 (2024)

  68. [69]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Yin, T., Gharbi, M., Zhang, R., Shechtman, E., Durand, F., Freeman, W.T., Park, T.: One-step diffusion with distribution matching distillation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 6613– 6623 (2024)

  69. [70]

    In: CVPR (2024)

    Yin, T., Gharbi, M., Zhang, R., Shechtman, E., Durand, F., Freeman, W.T., Park, T.: One-step diffusion with distribution matching distillation. In: CVPR (2024)

  70. [71]

    In: CVPR (2025)

    Yin, T., Zhang, Q., Zhang, R., Freeman, W.T., Durand, F., Shechtman, E., Huang, X.: From slow bidirectional to fast autoregressive video diffusion models. In: CVPR (2025)

  71. [72]

    arXiv preprint arXiv:2512.16093 (2025)

    Zhang, J., Zheng, K., Jiang, K., Wang, H., Stoica, I., Gonzalez, J.E., Chen, J., Zhu, J.: Turbodiffusion: Accelerating video diffusion models by 100-200 times. arXiv preprint arXiv:2512.16093 (2025)

  72. [73]

    arXiv preprint arXiv:2302.05543 (2023)

    Zhang, L., Agrawala, M.: Adding conditional control to text-to-image diffusion models. arXiv preprint arXiv:2302.05543 (2023)

  73. [74]

    In: Advances in Neural Information Processing Systems (2024)

    Zhang, Z., Li, Y., Wu, Y., Xu, Y., Kag, A., Skorokhodov, I., Menapace, W., Siaro- hin, A., Cao, J., Metaxas, D., Tulyakov, S., Ren, J.: Sf-v: Single forward video generation model. In: Advances in Neural Information Processing Systems (2024)

  74. [76]

    arXiv preprint arXiv:2510.08431 (2025)

    Zheng, K., Wang, Y., Ma, Q., Chen, H., Zhang, J., Balaji, Y., Chen, J., Liu, M.Y., Zhu, J., Zhang, Q.: Large scale diffusion distillation via score-regularized continuous-time consistency. arXiv preprint arXiv:2510.08431 (2025)