Pith. sign in

REVIEW 2 major objections 2 minor 5 cited by

Bernini: Latent Semantic Planning for Video Diffusion

T0 review · 2 major / 2 minor · reviewed 2026-05-22 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Bernini lets an MLLM predict semantic plans in ViT space that a DiT renderer turns into high-quality videos and edits.

desk verdict Bernini splits MLLM planning in ViT space from DiT rendering with light co-training and adds SA-3D RoPE plus chain-of-thought, but the SOTA claims rest on unshown numbers. read the letter →

arxiv 2605.22344 v1 pith:AVXRGRV6 submitted 2026-05-21 cs.CV cs.AIcs.MM

Bernini Team: Chenchen Liu , Junyi Chen , Lei Li , Lu Chi , Mingzhen Sun , Zhuoying Li , Yi Fu , Ruoyu Guo
show 3 more authors
Yiheng Wu Ge Bai Zehuan Yuan
This is my paper · ORCID
classification cs.CVcs.AIcs.MM
keywords videogenerationeditingdiffusionmodelsmultimodallargelanguagesemanticplanningViTembeddingsDirendererlatentinterface
checked against Cost.FunctionalEquationFoundation.DimensionForcing
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that MLLMs and video diffusion models can be combined by letting the language model handle semantic planning while the diffusion model handles pixel synthesis. The planner outputs target representations directly in the ViT embedding space; the renderer then generates frames conditioned on that plan plus text features and, for edits, source visual details. Because the interface is semantic, the two modules can be pretrained independently and only lightly co-trained, which preserves each model's strengths and keeps training efficient. The method adds Segment-Aware 3D RoPE to manage multiple visual inputs and chain-of-thought reasoning inside the planner to improve transfer of understanding. Results show state-of-the-art performance on video generation and especially on challenging editing benchmarks, where the MLLM's pretrained knowledge produces strong generalization.

What carries the argument

Latent semantic planning in ViT embedding space, where the MLLM outputs high-level guidance that the DiT renderer conditions on to produce video pixels.

What would settle it

Train the planner and renderer completely independently with no co-training at all and measure whether generated video quality falls substantially below jointly trained baselines on standard benchmarks.

Watch

Extended reading notes

Core claim

Bernini shows that an MLLM-based planner can predict target semantic representations in ViT embedding space and pass them to a DiT-based renderer that synthesizes pixels from the plan together with text features and source VAE features, allowing the planner and renderer to be trained separately with only light co-training while achieving state-of-the-art video generation and editing.

Load-bearing premise

Semantic representations in ViT embedding space form a sufficient and stable interface that lets the planner and renderer be trained separately and still produce high-quality output after light co-training.

Editorial extensions

If this is right

  • The planner and renderer can be developed and scaled independently while still producing coherent video output.
  • The MLLM's pretrained reasoning improves generalization on video editing tasks that require understanding source content.
  • Segment-Aware 3D RoPE allows the model to handle multiple visual inputs without losing spatial-temporal coherence.
  • Chain-of-thought steps inside the planner help translate language-model understanding into better generation decisions.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same semantic interface could let researchers swap in newer MLLMs or diffusion backbones without retraining the entire system.
  • The division of labor might extend to other generative domains such as audio synthesis or 3D scene creation where high-level plans guide low-level rendering.
  • If the ViT space proves stable across models, it could become a standard latent protocol for connecting reasoning and synthesis modules in multimodal systems.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The paper proposes Bernini, a framework unifying MLLMs for semantic planning directly in ViT embedding space with a DiT-based diffusion renderer for video generation and editing. The planner predicts target semantics, while the renderer synthesizes pixels conditioned on the plan plus text features and (for editing) source VAE features. Components are trained separately with only light co-training; SA-3D RoPE is introduced for multi-input handling and chain-of-thought reasoning is added to the planner. The central claim is state-of-the-art performance on video generation and editing benchmarks with strong generalization from the MLLM's pretrained understanding.

Significance. If the empirical claims hold, the work offers a modular and training-efficient route to combine the reasoning strengths of MLLMs with the synthesis fidelity of diffusion models. The explicit separation of semantic planning from rendering, together with the use of pretrained components and minimal co-training, is a clear strength that could reduce compute while improving controllability and editing generalization. The SA-3D RoPE and chain-of-thought additions are concrete, reusable ideas.

major comments (2)
  1. [Abstract and §5] Abstract and §5 (Experiments): the manuscript asserts SOTA results across video generation and editing benchmarks yet the abstract supplies no quantitative metrics, baseline comparisons, or ablation tables. Without these data the central performance claim cannot be evaluated and remains load-bearing for acceptance.
  2. [§3.1 and §4] §3.1 (Planner) and §4 (Training): the claim that ViT semantic representations form a sufficient, stable interface permitting fully separate training plus only light co-training is central but unsupported by ablations that isolate the contribution of the semantic plan versus the VAE detail features or heavier joint optimization. The abstract notes VAE augmentation for detail preservation, which itself suggests the pure ViT plan may be insufficient for photorealistic temporal coherence.
minor comments (2)
  1. [Figure 2] Figure 2 or the method diagram would benefit from explicit arrows showing the exact conditioning path from planner output (ViT tokens) to the DiT renderer, including how SA-3D RoPE is injected.
  2. [§3.2] Notation for the Segment-Aware 3D RoPE should be formalized with an equation rather than prose description to allow reproduction.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive and detailed review. The comments help clarify how to better present the core contributions. We address each major comment below and outline the corresponding revisions.

read point-by-point responses

  1. Referee: [Abstract and §5] Abstract and §5 (Experiments): the manuscript asserts SOTA results across video generation and editing benchmarks yet the abstract supplies no quantitative metrics, baseline comparisons, or ablation tables. Without these data the central performance claim cannot be evaluated and remains load-bearing for acceptance.

    Authors: We agree that the abstract would be strengthened by including key quantitative results. In the revised manuscript we will add specific metrics (e.g., the reported gains on standard video generation and editing benchmarks relative to the strongest baselines) while remaining within length constraints. The full tables, baselines, and ablations already appear in §5; the abstract update will make the central claim immediately verifiable without duplicating the experimental section. revision: yes

  2. Referee: [§3.1 and §4] §3.1 (Planner) and §4 (Training): the claim that ViT semantic representations form a sufficient, stable interface permitting fully separate training plus only light co-training is central but unsupported by ablations that isolate the contribution of the semantic plan versus the VAE detail features or heavier joint optimization. The abstract notes VAE augmentation for detail preservation, which itself suggests the pure ViT plan may be insufficient for photorealistic temporal coherence.

    Authors: We appreciate the referee’s emphasis on isolating the interface contribution. The semantic plan supplies high-level structure, motion, and editing intent while VAE features are used only for source-detail preservation during editing; generation relies primarily on the plan plus text. To directly address the request, the revised manuscript will include new ablation experiments that (i) remove the semantic plan (text-only conditioning), (ii) compare separate training plus light co-training against heavier joint optimization, and (iii) quantify temporal coherence with and without the plan. These results will be added to §4 and §5. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity in derivation chain

full rationale

The paper presents an architectural argument for dividing labor between an MLLM planner operating in ViT embedding space and a DiT renderer, with separate training plus light co-training as an empirical design choice that preserves pretrained capabilities. This is supported by benchmark results rather than any self-referential derivation, fitted parameter renamed as prediction, or load-bearing self-citation. The interface assumption is stated explicitly as a premise enabling the framework, not derived from the outputs themselves, and no equations or uniqueness theorems reduce the central claims to tautologies or prior author work by construction.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

Abstract-only review; no explicit free parameters, axioms, or invented entities are stated. The framework implicitly assumes that ViT embeddings form a lossless enough semantic interface for video tasks.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Bernini: Latent Semantic Planning for Video Diffusion." pith.science (2026). https://pith.science/paper/AVXRGRV6

@misc{pith2026260522344,
  author       = {Pith},
  title        = {Pith review of: Bernini: Latent Semantic Planning for Video Diffusion},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/AVXRGRV6}},
  note         = {Machine review of arXiv:2605.22344}
}
read the original abstract

Multimodal large language models (MLLMs) and diffusion models have each reached remarkable maturity: MLLMs excel at reasoning over heterogeneous multimodal inputs with strong semantic grounding, while diffusion models synthesize images and videos with photorealistic fidelity. We argue that these two families can be unified through a simple division of labor: MLLMs perform semantic planning, while diffusion models render pixels from high-level semantic guidance and low-level visual features. Building on this idea, we propose Bernini, a unified framework for video generation and editing. An MLLM-based planner predicts the target semantic representation directly in the ViT embedding space, and a DiT-based renderer synthesizes pixels conditioned on this plan, augmented by text features and, for editing, source VAE features for detail preservation. Because semantics serve as the interface, the planner and renderer can be trained separately and only lightly co-trained, preserving the pretrained strengths of both components while keeping training efficient. To better handle multiple visual inputs, we introduce Segment-Aware 3D Rotary Positional Embedding (SA-3D RoPE), and further incorporate chain-of-thought reasoning in the planner to better transfer understanding into generation. Bernini achieves state-of-the-art performance across a wide range of video generation and editing benchmarks, with the MLLM's pretrained understanding translating into strong generalization on challenging editing tasks.

Discussion (0). Continue with ORCID to comment.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion

    cs.CV 2026-08 conditional novelty 6.0 of 10

    A 16B causal autoregressive diffusion system reports real-time 720p video editing at about 30 FPS on one B200 GPU, beating streaming editors and matching several offline systems in benchmark scores.

  2. MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    MoRoute dynamically routes each DiT block to the most relevant layer of a frozen VLM and reports benchmark-leading scores on multimodal video generation and editing.

  3. Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Sol-Attn fuses threshold-based block selection and approximate correction into a single online-softmax pass, reporting 1.9–3.0× end-to-end speedups for video generation and editing without retraining.

  4. SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A 5B/14B video diffusion transformer using 75% linear + 25% softmax attention with block attention residuals generates 480p/720p video on one GPU faster than full-softmax models at comparable VBench quality.

  5. ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationships

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Writing editing instructions that explicitly bind each attribute to a reference image via `<Image_N>` tokens substantially improves multi-reference video editing, and a specialized MLLM trained with GRPO generates the...

Reference graph

Works this paper leans on

99 extracted references · 99 canonical work pages · cited by 5 Pith papers

  1. [1]

    SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints

    Jianhong Bai, Menghan Xia, Xintao Wang, Ziyang Yuan, Xiao Fu, Zuozhu Liu, Haoji Hu, Pengfei Wan, and Di Zhang. Syncammaster: Synchronizing multi-camera video generation from diverse viewpoints.arXiv preprint arXiv:2412.07760, 2024

    work page Pith review arXiv 2024

  2. [2]

    Recammaster: Camera-controlled generative rendering from a single video

    Jianhong Bai, Menghan Xia, Xiao Fu, Xintao Wang, Lianrui Mu, Jinwen Cao, Zuozhu Liu, Haoji Hu, Xiang Bai, Pengfei Wan, and Di Zhang. Recammaster: Camera-controlled generative rendering from a single video. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025

    work page 2025

  3. [3]

    Scalinginstruction-basedvideoeditingwithahigh-qualitysyntheticdataset

    Qingyan Bai, Qiuyu Wang, Hao Ouyang, Yue Yu, Hanlin Wang, Wen Wang, Ka Leong Cheng, Shuailei Ma, Yanhong Zeng, Zichen Liu, et al. Scaling instruction-based video editing with a high-quality synthetic dataset. arXiv preprint arXiv:2510.15742, 2025

    work page arXiv 2025

  4. [4]

    Qwen3-VL Technical Report

    Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, et al. Qwen3-vl technical report.arXiv preprint arXiv:2511.21631, 2025

    work page Pith review arXiv 2025

  5. [5]

    Ralph Allan Bradley and Milton E. Terry. Rank analysis of incomplete block designs: I. the method of paired comparisons. Biometrika, 39(3/4):324–345, 1952

    work page 1952

  6. [6]

    Jimeng AI.https://jimeng.jianying.com, 2024

    ByteDance. Jimeng AI.https://jimeng.jianying.com, 2024

    work page 2024

  7. [7]

    HunyuanImage 3.0 Technical Report

    Siyu Cao, Hangting Chen, Peng Chen, Yiji Cheng, Yutao Cui, Xinchi Deng, Ying Dong, Kipper Gong, Tianpeng Gu, Xiusen Gu, et al. Hunyuanimage 3.0 technical report.arXiv preprint arXiv:2509.23951, 2025

    work page Pith review arXiv 2025

  8. [8]

    Maskgit: Masked generative image transformer

    Huiwen Chang, Han Zhang, Lu Jiang, Ce Liu, and William T Freeman. Maskgit: Masked generative image transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11315–11325, 2022

    work page 2022

Show all 99 references
  1. [9]

    Vino: A unified visual generator with interleaved omnimodal context.arXiv preprint arXiv:2601.02358, 2026

    Junyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, and Weicai Ye. Vino: A unified visual generator with interleaved omnimodal context.arXiv preprint arXiv:2601.02358, 2026

    2026

  2. [10]

    Sharegpt-4o-image: Aligning multimodal models with gpt-4o-level image generation

    Junying Chen, Zhenyang Cai, Pengcheng Chen, Shunian Chen, Ke Ji, Xidong Wang, Yunjin Yang, and Benyou Wang. Sharegpt-4o-image: Aligning multimodal models with gpt-4o-level image generation. arXiv preprint arXiv:2506.18095, 2025

    2025

  3. [11]

    Intern VL: scaling up vision foundation models and aligning for generic visual-linguistic tasks

    Zhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su, Guo Chen, Sen Xing, Muyan Zhong, Qinglong Zhang, Xizhou Zhu, Lewei Lu, Bin Li, Ping Luo, Tong Lu, Yu Qiao, and Jifeng Dai. Intern VL: scaling up vision foundation models and aligning for generic visual-linguistic tasks. InProceedin...

    2024

  4. [12]

    Consistent video-to-video transfer using synthetic dataset.arXiv preprint arXiv:2311.00213, 2023

    Jiaxin Cheng, Tianjun Xiao, and Tong He. Consistent video-to-video transfer using synthetic dataset.arXiv preprint arXiv:2311.00213, 2023

    2023

  5. [13]

    Yufeng Cui, Honghao Chen, Haoge Deng, Xu Huang, Xinghang Li, Jirong Liu, Yang Liu, Zhuoyan Luo, Jin- sheng Wang, Wenxuan Wang, et al. Emu3. 5: Native multimodal models are world learners.arXiv preprint arXiv:2510.26583, 2025

    2025 arXiv

  6. [14]

    Quack: A quirky assortment of cute kernels, 2025

    Dao-AILab. Quack: A quirky assortment of cute kernels, 2025. URLhttps://github.com/Dao-AILab/quack. GitHub repository

    2025

  7. [15]

    Emerging properties in unified multimodal pretraining.arXiv preprint arXiv:2505.14683, 2025

    Chaorui Deng, Deyao Zhu, Kunchang Li, Chenhui Gou, Feng Li, Zeyu Wang, Shu Zhong, Weihao Yu, Xiaonan Nie, Ziang Song, Guang Shi, and Haoqi Fan. Emerging properties in unified multimodal pretraining.arXiv preprint arXiv:2505.14683, 2025

    2025 arXiv

  8. [16]

    Magref: Masked guidance for any-reference video generation with subject disentanglement

    Yufan Deng, Xun Guo, Shenghai Yuan, Zhaoxi Chen, Peng Zhou, Tianyu Ma, Boyuan Chen, Bin Lin, Li Yuan, and Wanli Wang. Magref: Masked guidance for any-reference video generation with subject disentanglement. arXiv preprint arXiv:2505.23742, 2025

    2025

  9. [17]

    Flex attention: A programming model for generating optimized attention kernels.arXiv preprint arXiv:2412.05496, 2(3):4, 2024

    Juechu Dong, Boyuan Feng, Driss Guessous, Yanbo Liang, and Horace He. Flex attention: A programming model for generating optimized attention kernels.arXiv preprint arXiv:2412.05496, 2(3):4, 2024

    2024 arXiv

  10. [18]

    Dreamllm: Synergistic multimodal comprehension and creation

    Runpei Dong, Chunrui Han, Yuang Peng, Zekun Qi, Zheng Ge, Jinrong Yang, Liang Zhao, Jianjian Sun, Hongyu Zhou, Haoran Wei, Xiangwen Kong, Xiangyu Zhang, Kaisheng Ma, and Li Yi. Dreamllm: Synergistic multimodal comprehension and creation. 2024. 28

    2024

  11. [19]

    An image is worth 16x16 words: Transformers for image recognition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. An image is worth 16x16 words: Transformers for image recognition at...

    2021

  12. [20]

    Scaling rectified flow transformers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, and Robin Rombach. Scaling rectified flow transformers for high-resolution image synthesis. 2024

    2024

  13. [21]

    Skyreels-a2: Compose anything in video diffusion transformers.arXiv preprint arXiv:2504.02436, 2025

    Zhengcong Fei, Debang Li, Di Qiu, Jiahua Yu, and Mingyuan Fan. Skyreels-a2: Compose anything in video diffusion transformers.arXiv preprint arXiv:2504.02436, 2025

    2025

  14. [22]

    Seed-x: Multimodal models with unified multi-granularity comprehension and generation.arXiv preprintarXiv:2404.14396, 2024

    Yuying Ge, Sijie Zhao, Jinguo Zhu, Yixiao Ge, Kun Yi, Lin Song, Chen Li, Xiaohan Ding, and Ying Shan. Seed-x: Multimodal models with unified multi-granularity comprehension and generation.arXiv preprintarXiv:2404.14396, 2024

    2024 arXiv

  15. [23]

    Tokenflow: Consistent diffusion features for consistent video editing

    Michal Geyer, Omer Bar-Tal, Shai Bagon, and Tali Dekel. Tokenflow: Consistent diffusion features for consistent video editing. InInternational Conference on Learning Representations (ICLR), 2024

    2024

  16. [24]

    Veo 3.https://deepmind.google/models/veo/, 2025

    Google DeepMind. Veo 3.https://deepmind.google/models/veo/, 2025

    2025

  17. [25]

    Unireditbench: A unified reasoning-based image editing benchmark.arXiv preprint arXiv:2511.01295, 2025

    Feng Han, Yibin Wang, Chenglin Li, Zheming Liang, Dianyi Wang, Yang Jiao, Zhipeng Wei, Chao Gong, Cheng Jin, Jingjing Chen, et al. Unireditbench: A unified reasoning-based image editing benchmark.arXiv preprint arXiv:2511.01295, 2025

    2025

  18. [26]

    Openve-3m: A large-scale high-quality dataset for instruction-guided video editing.arXiv preprint arXiv:2512.07826, 2025

    Haoyang He, Jie Wang, Jiangning Zhang, Zhucun Xue, Xingyuan Bu, Qiangpeng Yang, Shilei Wen, and Lei Xie. Openve-3m: A large-scale high-quality dataset for instruction-guided video editing.arXiv preprint arXiv:2512.07826, 2025

    2025

  19. [27]

    Vidlada: Bidirectional diffusion large language models for efficient video understanding.arXiv preprint arXiv:2601.17868, 2026

    Zhihao He, Tieyuan Chen, Kangyu Wang, Ziran Qin, Yang Shao, Chaofan Gan, Shijie Li, Zuxuan Wu, and Weiyao Lin. Vidlada: Bidirectional diffusion large language models for efficient video understanding.arXiv preprint arXiv:2601.17868, 2026

    2026

  20. [28]

    Visual sketchpad: Sketching as a visual chain of thought for multimodal language models

    Yushi Hu, Weijia Shi, Xingyu Fu, Dan Roth, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, and Ranjay Krishna. Visual sketchpad: Sketching as a visual chain of thought for multimodal language models. InAdvances in Neural Information Processing Systems (NeurIPS), 2024

    2024

  21. [29]

    VBench: Comprehensive benchmark suite for video generative models

    Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin, Yu Qiao, and Ziwei Liu. VBench: Comprehensive benchmark suite for video generative models. I...

    2024

  22. [30]

    Deepspeed ulysses: System optimizations for enabling training of extreme long sequence transformer models, 2023

    Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Shuaiwen Leon Song, Samyam Rajbhandari, and Yuxiong He. Deepspeed ulysses: System optimizations for enabling training of extreme long sequence transformer models, 2023. URLhttps://arxiv.org/abs/2309.14509

    2023 arXiv

  23. [31]

    Vace: All-in-one video creation and editing

    Zeyinzi Jiang, Zhen Han, Chaojie Mao, Jingfeng Zhang, Yulin Pan, and Yu Liu. Vace: All-in-one video creation and editing. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 17191–17202, 2025

    2025

  24. [32]

    Editverse: Unifying image and video editing and generation with in-context learning.arXiv preprint arXiv:2509.20360, 2025

    Xuan Ju, Tianyu Wang, Yuqian Zhou, He Zhang, Qing Liu, Nanxuan Zhao, Zhifei Zhang, Yijun Li, Yuanhao Cai, Shaoteng Liu, et al. Editverse: Unifying image and video editing and generation with in-context learning.arXiv preprint arXiv:2509.20360, 2025

    2025 arXiv

  25. [33]

    HunyuanVideo: A systematic framework for large video generative models.arXiv preprint arXiv:2412.03603, 2024

    Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, et al. HunyuanVideo: A systematic framework for large video generative models.arXiv preprint arXiv:2412.03603, 2024

    2024 arXiv

  26. [34]

    Kling 1.6.https://klingai.com/, 2024

    Kuaishou Technology. Kling 1.6.https://klingai.com/, 2024. Accessed: 2026-04-22

    2024

  27. [35]

    Nohumansrequired: Autonomous high-quality image editing triplet mining

    Maksim Kuprashevich, Grigorii Alekseenko, Irina Tolstykh, Georgii Fedorov, Bulat Suleimanov, Vladimir Dokholyan, and Aleksandr Gordeev. Nohumansrequired: Autonomous high-quality image editing triplet mining. arXiv preprint arXiv:2507.14119, 2025

    2025

  28. [36]

    FLUX.1.https://blackforestlabs.ai/, 2024

    Black Forest Labs. FLUX.1.https://blackforestlabs.ai/, 2024. 29

    2024

  29. [37]

    Five: A fine-grained video editing benchmark for evaluating emerging diffusion and rectified flow models.arXiv preprint arXiv:2503.13684, 2025

    Minghan Li, Chenxi Xie, Yichen Wu, Lei Zhang, and Mengyu Wang. Five: A fine-grained video editing benchmark for evaluating emerging diffusion and rectified flow models.arXiv preprint arXiv:2503.13684, 2025

    2025

  30. [38]

    Omnicorpus: A unified multimodal corpus of 10 billion-level images interleaved with text

    Qingyun Li, Zhe Chen, Weiyun Wang, Wenhai Wang, Shenglong Ye, Zhenjiang Jin, Guanzhou Chen, Yinan He, Zhangwei Gao, Erfei Cui, et al. Omnicorpus: A unified multimodal corpus of 10 billion-level images interleaved with text. arXiv preprint arXiv:2406.08418, 2024

    2024

  31. [39]

    Autoregressive image generation without vector quantization.Advancesin Neural Information Processing Systems, 37:56424–56445, 2024

    Tianhong Li, Yonglong Tian, He Li, Mingyang Deng, and Kaiming He. Autoregressive image generation without vector quantization.Advancesin Neural Information Processing Systems, 37:56424–56445, 2024

    2024

  32. [40]

    Diffueraser: A diffusion model for video inpainting.arXiv preprint arXiv:2501.10018, 2025

    Xiaowen Li, Haolan Xue, Peiran Ren, and Liefeng Bo. Diffueraser: A diffusion model for video inpainting.arXiv preprint arXiv:2501.10018, 2025

    2025

  33. [41]

    In-context learning with unpaired clips for instruction-based video editing.arXiv preprint arXiv:2510.14648, 2025

    Xinyao Liao, Xianfang Zeng, Ziye Song, Zhoujie Fu, Gang Yu, and Guosheng Lin. In-context learning with unpaired clips for instruction-based video editing.arXiv preprint arXiv:2510.14648, 2025

    2025

  34. [42]

    Bifrost-1: Bridging multimodal llms and diffusion models with patch-level CLIP latents.arXiv preprint arXiv.2508.05954, 2025

    Han Lin, Jaemin Cho, Amir Zadeh, Chuan Li, and Mohit Bansal. Bifrost-1: Bridging multimodal llms and diffusion models with patch-level CLIP latents.arXiv preprint arXiv.2508.05954, 2025

    2025

  35. [43]

    Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling. arXiv preprint arXiv:2210.02747, 2022

    2022 arXiv

  36. [44]

    Visual instruction tuning

    Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning. arXiv preprint arXiv:2304.08485, 2023

    2023 arXiv

  37. [45]

    Phantom: Subject-consistent video generation via cross-modal alignment.arXiv preprint arXiv:2502.11079, 2025

    Lijie Liu, Tianxiang Liu, Zhichao Wang, Yubin Zhao, Jun Chen, Zhongyuan Zhang, Boyuan Gong, and Jiashi Deng. Phantom: Subject-consistent video generation via cross-modal alignment.arXiv preprint arXiv:2502.11079, 2025

    2025

  38. [46]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection.arXiv preprint arXiv:2303.05499, 2023

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection.arXiv preprint arXiv:2303.05499, 2023

    2023 arXiv

  39. [47]

    Flow straight and fast: Learning to generate and transfer data with rectified flow, 2022

    Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow, 2022. URLhttps://arxiv.org/abs/2209.03003

    2022 arXiv

  40. [48]

    Camclonemaster: Enabling reference-based camera control for video generation

    Yawen Luo, Xiaoyu Shi, Jianhong Bai, Menghan Xia, Tianfan Xue, Xintao Wang, Pengfei Wan, Di Zhang, and Kun Gai. Camclonemaster: Enabling reference-based camera control for video generation. InProceedings of the SIGGRAPH Asia 2025 Conference Papers, pages 1–10, 2025

    2025

  41. [49]

    Step-Video-T2V technical report: The practice, challenges, and future of video foundation model.arXiv preprint arXiv:2502.10248, 2025

    Guoqing Ma, Haoyang Huang, Kun Yan, Liangyu Chen, Nan Duan, Shengming Yin, Changyi Guo, Junshu Huang, Zhenyu Liu, Weihong Zhang, et al. Step-Video-T2V technical report: The practice, challenges, and future of video foundation model.arXiv preprint arXiv:2502.10248, 2025

    2025 arXiv

  42. [50]

    X-clip: End-to-end multi- grained contrastive learning for video-text retrieval

    Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan, Ji Zhang, and Rongrong Ji. X-clip: End-to-end multi- grained contrastive learning for video-text retrieval. InProceedings of the 30th ACM international conference on multimedia, pages 638–647, 2022

    2022

  43. [51]

    On distillation of guided diffusion models

    Chenlin Meng, Robin Rombach, Ruiqi Gao, Diederik P Kingma, Stefano Ermon, Jonathan Ho, and Tim Salimans. On distillation of guided diffusion models. InCVPR, 2023

    2023

  44. [52]

    Howto100m: Learning a text-video embedding by watching hundred million narrated video clips

    Antoine Miech, Dimitri Zhukov, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, and Josef Sivic. Howto100m: Learning a text-video embedding by watching hundred million narrated video clips. InProceedings of the IEEE/CVF international conference on computer vision, pages 2...

    2019

  45. [53]

    Sora: Creating video from text.https://openai.com/sora, 2024

    OpenAI. Sora: Creating video from text.https://openai.com/sora, 2024

    2024

  46. [54]

    Transfer between modalities with metaqueries

    Xichen Pan, Satya Narayan Shukla, Aashu Singh, Zhuokai Zhao, Shlok Kumar Mishra, Jialiang Wang, Zhiyang Xu, Jiuhai Chen, Kunpeng Li, Felix Juefei-Xu, Ji Hou, and Saining Xie. Transfer between modalities with metaqueries. arXiv preprint arXiv:2504.06256, 2025

    2025 arXiv

  47. [55]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. InProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023

    2023

  48. [56]

    Pika 2.1.https://pika.art/, 2024

    Pika Labs. Pika 2.1.https://pika.art/, 2024. Accessed: 2026-04-22. 30

    2024

  49. [57]

    Pico-banana-400k: A large-scale dataset for text-guided image editing.arXiv preprint arXiv:2510.19808, 2025

    Yusu Qian, Eli Bocek-Rivele, Liangchen Song, Jialing Tong, Yinfei Yang, Jiasen Lu, Wenze Hu, and Zhe Gan. Pico-banana-400k: A large-scale dataset for text-guided image editing.arXiv preprint arXiv:2510.19808, 2025

    2025

  50. [58]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pa...

    2021

  51. [59]

    Sam 2: Segment anything in images and videos, 2024

    Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman Rädle, Chloe Rolland, Laura Gustafson, Eric Mintun, Junting Pan, Kalyan Vasudev Alwala, Nicolas Carion, Chao-Yuan Wu, Ross Girshick, Piotr Dollár, and Christoph Feichtenh...

    2024 arXiv

  52. [60]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022

    2022

  53. [61]

    Introducing Gen-3 Alpha: A new frontier for video generation.https://runwayml.com/research/ introducing-gen-3-alpha, 2024

    Runway. Introducing Gen-3 Alpha: A new frontier for video generation.https://runwayml.com/research/ introducing-gen-3-alpha, 2024

    2024

  54. [62]

    Eliminating oversaturation and artifacts of high guidance scales in diffusion models

    Seyedmorteza Sadat, Otmar Hilliges, and Romann M Weber. Eliminating oversaturation and artifacts of high guidance scales in diffusion models. InThe Thirteenth International Conference on Learning Representations, 2024

    2024

  55. [63]

    Vidu 2.0.https://www.vidu.com/, 2024

    Shengshu Technology. Vidu 2.0.https://www.vidu.com/, 2024. Accessed: 2026-04-22

    2024

  56. [64]

    RoFormer: Enhanced transformer with rotary position embedding

    Jianlin Su, Yu Lu, Shengfeng Pan, Bo Wen, and Yunfeng Liu. RoFormer: Enhanced transformer with rotary position embedding. arXiv preprint arXiv:2104.09864, 2021

    2021 arXiv

  57. [65]

    Emu: Generative pretraining in multimodality.arXiv preprint arXiv:2307.05222, 2023

    Quan Sun, Qiying Yu, Yufeng Cui, Fan Zhang, Xiaosong Zhang, Yueze Wang, Hongcheng Gao, Jingjing Liu, Tiejun Huang, and Xinlong Wang. Emu: Generative pretraining in multimodality.arXiv preprint arXiv:2307.05222, 2023

    2023 arXiv

  58. [66]

    Omni-video: Democratizing unified video understanding and generation.arXiv preprint arXiv:2507.06119, 2025

    Zhiyu Tan, Hao Yang, Luozheng Qin, Jia Gong, Mengping Yang, and Hao Li. Omni-video: Democratizing unified video understanding and generation.arXiv preprint arXiv:2507.06119, 2025

    2025

  59. [67]

    Lucy edit: Open-weight text-guided video editing

    DecartAI Team. Lucy edit: Open-weight text-guided video editing. 2025. URL https://d2drjpuinn46lb. cloudfront.net/Lucy_Edit__High_Fidelity_Text_Guided_Video_Editing.pdf

    2025

  60. [68]

    Kling-omni technical report.arXiv preprint arXiv:2512.16776, 2025

    Kling Team, Jialu Chen, Yuanzheng Ci, Xiangyu Du, Zipeng Feng, Kun Gai, Sainan Guo, Feng Han, Jingbin He, Kang He, et al. Kling-omni technical report.arXiv preprint arXiv:2512.16776, 2025

    2025 arXiv

  61. [69]

    Qwen2.5-vl technical report.arXiv preprint arXiv:2502.13923, 2025

    Qwen Team. Qwen2.5-vl technical report.arXiv preprint arXiv:2502.13923, 2025

    2025 arXiv

  62. [70]

    Wan: Open and advanced large-scale video generative models.arXiv preprint arXiv:2503.20314, 2025

    Wan Team. Wan: Open and advanced large-scale video generative models.arXiv preprint arXiv:2503.20314, 2025

    2025 arXiv

  63. [71]

    SigLIP 2: Multilingual vision-language encoders with improved semantic understanding, localization, and dense features.arXiv preprint arXiv:2502.14786, 2025

    Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, Olivier Hénaff, Jeremiah Harmsen, Andreas Steiner, and Xiaohua Zhai. SigLIP 2: Multilingual vision-language enc...

    2025 arXiv

  64. [72]

    Refalign: Representation alignment for reference-to-video generation.arXiv preprint arXiv:2603.25743, 2026

    Lei Wang, Yuxin Song, Ge Wu, Haocheng Feng, Hang Zhou, Jingdong Wang, Yaxing Wang, and Jian Yang. Refalign: Representation alignment for reference-to-video generation.arXiv preprint arXiv:2603.25743, 2026

    2026

  65. [73]

    Emu3: Next-token prediction is all you need.arXiv preprint arXiv:2409.18869, 2024

    Xinlong Wang, Xiaosong Zhang, Zhengxiong Luo, Quan Sun, Yufeng Cui, Jinsheng Wang, Fan Zhang, Yueze Wang, Zhen Li, Qiying Yu, Yingli Zhao, Yulong Ao, Xuebin Min, Tao Li, Boya Wu, Bo Zhao, Bowen Zhang, Liangdong Wang, Guang Liu, Zheqi He, Xi Yang, Jingjing Liu, Yonghua Lin, Tie...

    2024 arXiv

  66. [74]

    Gpt-image-edit-1.5m: A million-scale, gpt-generated image dataset.arXiv preprint arXiv:2507.21033, 2025

    Yuhan Wang, Siwei Yang, Bingchen Wang, Letian Tu, Bingyu Li, Yuyin Hong, Yibing Wang, Yuyou Yan, Alan Yuille, and Cihang Xie. Gpt-image-edit-1.5m: A million-scale, gpt-generated image dataset.arXiv preprint arXiv:2507.21033, 2025

    2025

  67. [75]

    Omniedit: Building image editing generalist models through specialist supervision

    Cong Wei, Zheyang Xiong, Weiming Ren, Xeron Du, Ge Zhang, and Wenhu Chen. Omniedit: Building image editing generalist models through specialist supervision. InThe Thirteenth International Conference on Learning Representations, 2024. 31

    2024

  68. [76]

    Univideo: Unified video understanding, generation, and editing.arXiv preprint arXiv:2510.08377, 2026

    Cong Wei, Quande Liu, Zixuan Ye, Qiulin Wang, Xintao Wang, Pengfei Wan, Kun Gai, and Wenhu Chen. Univideo: Unified video understanding, generation, and editing.arXiv preprint arXiv:2510.08377, 2026

    2026

  69. [77]

    Chain-of-thought prompting elicits reasoning in large language models

    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. Chain-of-thought prompting elicits reasoning in large language models. 2022

    2022

  70. [78]

    Finevision: Open data is all you need.arXiv preprint arXiv:2510.17269, 2025

    Luis Wiedmann, Orr Zohar, Amir Mahla, Xiaohan Wang, Rui Li, Thibaud Frere, Leandro von Werra, Aritra Roy Gosthipaty, and Andrés Marafioti. Finevision: Open data is all you need.arXiv preprint arXiv:2510.17269, 2025

    2025 arXiv

  71. [79]

    Janus: Decoupling visual encoding for unified multimodal understanding and generation

    Chengyue Wu, Xiaokang Chen, Zhiyu Wu, Yiyang Ma, Xingchao Liu, Zizheng Pan, Wen Liu, Zhenda Xie, Xingkai Yu, Chong Ruan, and Ping Luo. Janus: Decoupling visual encoding for unified multimodal understanding and generation. InProceedings of the IEEE/CVF Conference on Computer Vi...

    2025

  72. [80]

    Omnigen2: Exploration to advanced multimodal generation

    Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin Liu, Junjie Zhou, Ze Liu, Ziyi Xia, Chaofan Li, Haoge Deng, Jiahao Wang, Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, and Zheng Liu. Omnigen2: Ex...

    2025

  73. [81]

    Insvie-1m: Effective instruction-based video editing with elaborate dataset construction

    Yuhui Wu, Liyi Chen, Ruibin Li, Shihao Wang, Chenxi Xie, and Lei Zhang. Insvie-1m: Effective instruction-based video editing with elaborate dataset construction. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 16692–16701, 2025

    2025

  74. [82]

    Show-o: One single transformer to unify multimodal understanding and generation

    Jinheng Xie, Weijia Mao, Zechen Bai, David Junhao Zhang, Weihao Wang, Kevin Qinghong Lin, Yuchao Gu, Zhijie Chen, Zhenheng Yang, and Mike Zheng Shou. Show-o: One single transformer to unify multimodal understanding and generation. arXiv preprint arXiv:2408.12528, 2024

    2024 arXiv

  75. [83]

    Lumina-dimoo: An omni diffusion large language model for multi-modal generation and understanding.arXiv preprint arXiv:2510.06308, 2025

    Yi Xin, Qi Qin, Siqi Luo, Kaiwen Zhu, Juncheng Yan, Yan Tai, Jiayi Lei, Yuewen Cao, Keqi Wang, Yibin Wang, Jinbin Bai, Qian Yu, Dengyang Jiang, Yuandong Pu, Haoxing Chen, Le Zhuo, Junjun He, Gen Luo, Tianbin Li, Ming Hu, Jin Ye, Shenglong Ye, Bo Zhang, Chang Xu, Wenhai Wang, H...

    2025

  76. [84]

    Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et al. Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025

    2025 arXiv

  77. [85]

    Effective whole-body pose estimation with two-stages distillation

    Zhendong Yang, Ailing Zeng, Chun Yuan, and Yu Li. Effective whole-body pose estimation with two-stages distillation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4210–4220, 2023

    2023

  78. [86]

    CogVideoX: Text-to-video diffusion models with an expert transformer

    Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, Da Yin, Xiaotao Gu, Yuxuan Zhang, Weihan Wang, Yean Cheng, Ting Liu, Bin Xu, Yuxiao Dong, and Jie Tang. CogVideoX: Text-to-video diffusion models ...

    2025

  79. [87]

    Space-time diffusion features for zero-shot text-driven motion transfer

    Danah Yatim, Rafail Fridman, Omer Bar-Tal, Yoni Kasten, and Tali Dekel. Space-time diffusion features for zero-shot text-driven motion transfer. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 8466–8476, 2024

    2024

  80. [88]

    Imgedit: A unified image editing dataset and benchmark.arXiv preprint arXiv:2505.20275, 2025

    Yang Ye, Xianyi He, Zongjian Li, Bin Lin, Shenghai Yuan, Zhiyuan Yan, Bohan Hou, and Li Yuan. Imgedit: A unified image editing dataset and benchmark.arXiv preprint arXiv:2505.20275, 2025

    2025 arXiv

  81. [89]

    Trajectorycrafter: Redirecting camera trajectory for monocular videos via diffusion models

    Mark Yu, Wenbo Hu, Jinbo Xing, and Ying Shan. Trajectorycrafter: Redirecting camera trajectory for monocular videos via diffusion models. InProceedings of the IEEE/CVF international conference on computer vision, pages 100–111, 2025

    2025

  82. [90]

    Anyedit: Mastering unified high-quality image editing for any idea

    Qifan Yu, Wei Chow, Zhongqi Yue, Kaihang Pan, Yang Wu, Xiaoyang Wan, Juncheng Li, Siliang Tang, Hanwang Zhang, and Yueting Zhuang. Anyedit: Mastering unified high-quality image editing for any idea. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogn...

    2025

  83. [91]

    Opens2v-nexus: A detailed benchmark and million-scale dataset for subject-to-video generation.arXiv preprint arXiv:2505.20292, 2025

    Shenghai Yuan, Xianyi He, Yufan Deng, Yang Ye, Jinfa Huang, Bin Lin, Jiebo Luo, and Li Yuan. Opens2v-nexus: A detailed benchmark and million-scale dataset for subject-to-video generation.arXiv preprint arXiv:2505.20292, 2025. 32

    2025

  84. [92]

    Flashattention-4: Algorithm and kernel pipelining co-design for asymmetric hardware scaling.arXiv preprint arXiv:2603.05451, 2026

    Ted Zadouri, Markus Hoehnerbach, Jay Shah, Timmy Liu, Vijay Thakkar, and Tri Dao. Flashattention-4: Algorithm and kernel pipelining co-design for asymmetric hardware scaling.arXiv preprint arXiv:2603.05451, 2026

    2026

  85. [93]

    Magicbrush: A manually annotated dataset for instruction-guided image editing

    Kai Zhang, Lingbo Mo, Wenhu Chen, Huan Sun, and Yu Su. Magicbrush: A manually annotated dataset for instruction-guided image editing. InAdvancesin Neural Information Processing Systems, 2023

    2023

  86. [94]

    Waver: Wave your way to lifelike video generation.arXiv preprint arXiv:2508.15761, 2025

    Yifu Zhang, Hao Yang, Yuqi Zhang, Yifei Hu, Fengda Zhu, Chuang Lin, Xiaofeng Mei, Yi Jiang, Bingyue Peng, and Zehuan Yuan. Waver: Wave your way to lifelike video generation.arXiv preprint arXiv:2508.15761, 2025

    2025

  87. [95]

    Llava-video: Video instruction tuning with synthetic data.arXiv preprint arXiv:2410.02713, 2024

    Yuanhan Zhang, Jinming Wu, Wei Li, Bo Li, Zejun Ma, Ziwei Liu, and Chunyuan Li. Llava-video: Video instruction tuning with synthetic data.arXiv preprint arXiv:2410.02713, 2024

    2024 arXiv

  88. [96]

    Ultraedit: Instruction-based fine-grained image editing at scale.Advancesin Neural Information Processing Systems, 2024

    Haozhe Zhao, Xiaojian Ma, Liang Chen, Shuzheng Si, Rujie Wu, Kaikai An, Peiyu Yu, Minjia Zhang, Qing Li, and Baobao Chang. Ultraedit: Instruction-based fine-grained image editing at scale.Advancesin Neural Information Processing Systems, 2024

    2024

  89. [97]

    Shihao Zhao, Shaozhe Hao, Bojia Zi, Huaizhe Xu, and Kwan-Yee K. Wong. Bridging different language models and generative vision models for text-to-image generation. 2024

    2024

  90. [98]

    Scaling zero-shot reference-to-video generation.arXiv preprint, 2025

    Zijian Zhou, Shikun Liu, Haozhe Liu, Haonan Qiu, Zhaochong An, Weiming Ren, Zhiheng Liu, Xiaoke Huang, Kam Woh Ng, Tian Xie, Xiao Han, Yuren Cong, Hang Li, Chuyan Zhu, Aditya Patel, Tao Xiang, and Sen He. Scaling zero-shot reference-to-video generation.arXiv preprint, 2025

    2025

  91. [99]

    Non-execution

    Bojia Zi et al. Señorita-2m: A high-quality instruction-based dataset for general video editing by video specialists. In Advancesin Neural Information Processing Systems (NeurIPS), 2025. 33 Appendix A MLLM Prompts for Bernini-Bench Evaluation You are a professional data rater ...

    2025

Pith tools

Reviewed May 22, 2026 · model on record in the stance chip above.