REVIEW 10 cited by
Image Conductor: Precision Control for Interactive Video Synthesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Filmmaking and animation production often require sophisticated techniques for coordinating camera transitions and object movements, typically involving labor-intensive real-world capturing. Despite advancements in generative AI for video creation, achieving precise control over motion for interactive video asset generation remains challenging. To this end, we propose Image Conductor, a method for precise control of camera transitions and object movements to generate video assets from a single image. An well-cultivated training strategy is proposed to separate distinct camera and object motion by camera LoRA weights and object LoRA weights. To further address cinematographic variations from ill-posed trajectories, we introduce a camera-free guidance technique during inference, enhancing object movements while eliminating camera transitions. Additionally, we develop a trajectory-oriented video motion data curation pipeline for training. Quantitative and qualitative experiments demonstrate our method's precision and fine-grained control in generating motion-controllable videos from images, advancing the practical application of interactive video synthesis. Project webpage available at https://liyaowei-stu.github.io/project/ImageConductor/
Forward citations
Cited by 10 Pith papers
-
Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representation
A diffusion-based image animation method that uses rendered colored spheres and a checkerboard world envelope as 3D-aware motion control signals, enabling joint camera and object motion control with fine granularity.
-
Video Creation by Demonstration
A self-supervised diffusion approach, δ-Diffusion, transfers action concepts from a demonstration video to a new context image using appearance-bottlenecked action latents.
-
FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control
A single video-diffusion framework composites both static images and dynamic footage along user-defined trajectories by transporting canonical foreground latents directly into the background latent sequence.
-
ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframing
ToonComposer generates cartoon videos from a colored reference frame and sparse keyframe sketches, merging inbetweening and colorization in one diffusion model.
-
AnyI2V: Animating Any Conditional Image with Motion Control
AnyI2V animates arbitrary conditional images with user-defined trajectories by injecting debiased diffusion features and aligning attention queries across frames, without training.
-
VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generation
VidCRAFT3 is a single image-to-video diffusion system that accepts camera, object, and lighting direction controls separately or jointly, trained in three stages with a new synthetic lighting dataset.
-
RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control
Metric-scale depth alignment plus scene-constrained noise shaping improves camera controllability and video quality for image-to-video generation on RealEstate10K.
-
Motion Prompting: Controlling Video Generation with Motion Trajectories
A single-stage ControlNet on the Lumiere video model, conditioned only on dense point tracks, generalizes to sparse and dense trajectory control for object, camera, and transferred motions.
-
CPA: Camera-pose-awareness Diffusion Transformer for Video Generation
CPA adds camera pose control to OpenSora-style diffusion video models by encoding a sparse Plücker motion field into a latent and injecting it into temporal attention layers.
-
Fuel Consumption in Platoons: A Literature Review
A literature review compiling factors that affect fuel consumption in vehicle platoons, including drag reduction, coordination, and instability.
Discussion (0). Continue with ORCID to comment.