REVIEW 6 cited by
FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Video diffusion models have made substantial progress in various video generation applications. However, training models for long video generation tasks require significant computational and data resources, posing a challenge to developing long video diffusion models. This paper investigates a straightforward and training-free approach to extend an existing short video diffusion model (e.g. pre-trained on 16-frame videos) for consistent long video generation (e.g. 128 frames). Our preliminary observation has found that directly applying the short video diffusion model to generate long videos can lead to severe video quality degradation. Further investigation reveals that this degradation is primarily due to the distortion of high-frequency components in long videos, characterized by a decrease in spatial high-frequency components and an increase in temporal high-frequency components. Motivated by this, we propose a novel solution named FreeLong to balance the frequency distribution of long video features during the denoising process. FreeLong blends the low-frequency components of global video features, which encapsulate the entire video sequence, with the high-frequency components of local video features that focus on shorter subsequences of frames. This approach maintains global consistency while incorporating diverse and high-quality spatiotemporal details from local videos, enhancing both the consistency and fidelity of long video generation. We evaluated FreeLong on multiple base video diffusion models and observed significant improvements. Additionally, our method supports coherent multi-prompt generation, ensuring both visual coherence and seamless transitions between scenes.
Forward citations
Cited by 6 Pith papers
-
Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation
Voyager is a video diffusion model that jointly generates RGB and depth from one image, enabling direct 3D scene reconstruction and long-range camera exploration.
-
TokensGen: Harnessing Condensed Tokens for Long Video Generation
TokensGen generates consistent long videos by representing each clip as condensed semantic tokens, generating all tokens jointly from text, and stitching clips with adaptive FIFO denoising.
-
LongAnimation: Long Animation Generation with Dynamic Global-Local Memory
LongAnimation uses a dynamic global-local memory, built from a long-video-understanding model's KV cache, to colorize animation sequences of about 500 frames with stable color consistency.
-
Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Condition
Hunyuan-GameCraft generates long, action-controlled game videos from a single image by unifying keyboard/mouse inputs into a continuous camera space and conditioning on mixed historical context.
-
FastInit: Fast Noise Initialization for Temporally Consistent Video Generation
A single-pass learned noise predictor, trained to imitate FreeInit's outputs, gives temporally more consistent text-to-video generation at near-zero added inference cost.
-
ViMax: Agentic Video Generation
ViMax introduces a hierarchical multi-agent framework for long-form video generation that uses retrieval-augmented narrative planning and dependency-aware visual state tracking to maintain coherence across scenes.
Discussion (0). Sign in to comment.