REVIEW 31 cited by
Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Leveraging large-scale image-text datasets and advancements in diffusion models, text-driven generative models have made remarkable strides in the field of image generation and editing. This study explores the potential of extending the text-driven ability to the generation and editing of multi-text conditioned long videos. Current methodologies for video generation and editing, while innovative, are often confined to extremely short videos (typically less than 24 frames) and are limited to a single text condition. These constraints significantly limit their applications given that real-world videos usually consist of multiple segments, each bearing different semantic information. To address this challenge, we introduce a novel paradigm dubbed as Gen-L-Video, capable of extending off-the-shelf short video diffusion models for generating and editing videos comprising hundreds of frames with diverse semantic segments without introducing additional training, all while preserving content consistency. We have implemented three mainstream text-driven video generation and editing methodologies and extended them to accommodate longer videos imbued with a variety of semantic segments with our proposed paradigm. Our experimental outcomes reveal that our approach significantly broadens the generative and editing capabilities of video diffusion models, offering new possibilities for future research and applications. The code is available at https://github.com/G-U-N/Gen-L-Video.
Forward citations
Cited by 31 Pith papers
-
Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation
Voyager is a video diffusion model that jointly generates RGB and depth from one image, enabling direct 3D scene reconstruction and long-range camera exploration.
-
Latent Swap Joint Diffusion for 2D Long-Form Latent Generation
A training-free latent swap method that replaces averaging with binary swapping in joint diffusion, improving long-form audio spectrum and panorama generation.
-
TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Models
TPD restores suppressed late-segment events in text-to-video diffusion by projecting classifier-free guidance onto a frame- and timestep-selective lower bound along a temporal-counterfactual direction.
-
Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation
TANGO avoids "terminal points" in autoregressive video generation by optimizing a LoRA adapter at test time until the model's one-step-ahead predicted noise looks like isotropic Gaussian noise.
-
Compositional Diffusion with Guided Search for Long-Horizon Planning
CDGS adds population-based search and likelihood-based pruning to compositional diffusion, enabling long-horizon planning from short-horizon models across robot manipulation, panoramas, and video.
-
AnchorSync: Global Consistency Optimization for Long Video Editing
By jointly editing sparse anchor frames and interpolating with flow and edge guidance, AnchorSync produces temporally consistent edits on videos longer than previous diffusion methods could handle.
-
TokensGen: Harnessing Condensed Tokens for Long Video Generation
TokensGen generates consistent long videos by representing each clip as condensed semantic tokens, generating all tokens jointly from text, and stitching clips with adaptive FIFO denoising.
-
LoViC: Efficient Long Video Generation with Context Compression
LoViC uses FlexFormer, a single-query-token Q-Former with interpolated rotary positional encoding, to compress long video-text context for efficient long-video generation.
-
FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusion
FreeLong++ extends short-video diffusion models to 4x to 8x longer clips, without retraining, by fusing multiple windowed attention branches through frequency-domain filters and a spectral noise initialization.
-
Epona: Autoregressive Diffusion World Model for Autonomous Driving
An autoregressive diffusion world model jointly generates the next camera frame and a multi-step trajectory, enabling long videos and real-time planning for autonomous driving.
-
LumosFlow: Motion-Guided Long Video Generation
LumosFlow generates long videos by combining large-motion key frame generation, latent optical flow diffusion, and a ControlNet-style refinement module.
-
FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation
FlowMo reduces temporal artifacts in video generation by guiding the denoising process to lower the maximum patch-wise variance of consecutive-frame differences in the latent space.
-
FreePCA: Integrating Consistency Information across Long-short Frames in Training-free Long Video Generation via Principal Component Analysis
FreePCA improves training-free long video generation by projecting global and local attention features into PCA space, selecting consistent appearance components from global and motion components from local, then prog...
-
Modular-Cam: Modular Dynamic Camera-view Video Generation with LLM
Modular-Cam combines LLM-based prompt decomposition, per-motion LoRA modules, and ControlNet-based scene conditioning to generate multi-scene videos with camera-view control.
-
Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion
Ouroboros-Diffusion improves long video consistency by combining low-frequency tail noise, subject-aware cross-frame attention, and self-recurrent gradient guidance in a tuning-free FIFO diffusion queue.
-
Tuning-Free Long Video Generation via Global-Local Collaborative Diffusion
GLC-Diffusion extends short-clip video diffusion models to long videos via global-local collaborative denoising, noise reinitialization, and motion-consistency refinement, improving coherence and fidelity at 3x and 6x...
-
Brick-Diffusion: Generating Long Videos with Brick-to-Wall Denoising
Long videos are generated by denoising short latent segments with a shifting offset between steps, and the approach reports higher VBench average scores than four training-free baselines.
-
Ingredients: Blending Custom Photos with Video Diffusion Transformers
Ingredients adds a mask-supervised identity router to a video diffusion transformer, enabling multi-person videos from a few reference photos without per-identity fine-tuning.
-
Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generation
A new story-completion benchmark, StoryEval, shows that 11 current text-to-video models complete fewer than half of the consecutive events in short story prompts.
-
Mind the Time: Temporally-Controlled Multi-Event Video Generation
MinT generates multi-event videos where each event's timing is controlled by the user, using a fine-tuned video diffusion transformer with a time-aware rotary position embedding.
-
Long Video Diffusion Generation with Segmented Cross-Attention and Content-Rich Video Data Curation
Presto lets each temporal segment of a video attend to a matching sub-caption, enabling long, content-rich videos that beat prior open-source and commercial models on VBench semantic and dynamic scores.
-
Towards Precise Scaling Laws for Video Diffusion Transformers
Video diffusion transformers follow scaling laws, and tuning learning rate and batch size per model and data size makes those laws precise enough to predict loss and optimal model size at larger scales.
-
Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharing
By making temporal attention causal and sharing cached key-value features across all denoising steps, Ca2-VDM cuts autoregressive video generation cost from quadratic to roughly linear in the number of generated chunks.
-
VIRES: Video Instance Repainting via Sketch and Text Guided Generation
A DiT-based video editing method uses sketch sequences and text to repaint, replace, generate, or remove instances while preserving temporal consistency.
-
Self Gradient Forcing: Native Long Video Extrapolation
Self Gradient Forcing lets later-video losses train how earlier generated video latents are encoded into the causal KV cache, improving measured long-video consistency over plain Self Forcing.
-
InfinityHuman: Towards Long-Term Audio-Driven Human
A coarse-to-fine audio-driven animation framework that uses pose-guided refinement and hand-specific reward learning to generate long, identity-stable talking videos.
-
StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
A diffusion-based avatar generator that uses a timestep-aware audio adapter, audio-adaptive guidance, and weighted sliding-window fusion to produce audio-synced talking-head videos several minutes long with reduced id...
-
ShoulderShot: Generating Over-the-Shoulder Dialogue Videos
ShoulderShot generates over-the-shoulder dialogue videos by pairing two linked camera shots and looping them, so characters stay consistent through long multi-turn conversations.
-
Frame-Level Captions for Long Video Generation with Complex Multi Scenes
Frame-level captions with per-frame cross-attention and parallel multi-window denoising reduce semantic confusion in long multi-scene video generation in the authors' internal evaluation.
-
Re-Attentional Controllable Video Diffusion Editing
ReAtCo improves text-guided video editing by using attention-map gradients to place edited objects in user-specified regions and by re-injecting the original background during diffusion sampling.
-
Video Diffusion Transformers are In-Context Learners
Concatenating multiple video clips into one input and fine-tuning a LoRA adapter lets a pretrained video diffusion transformer produce consistent multi-scene videos from a single prompt.
Discussion (0). Continue with ORCID to comment.