REVIEW 3 cited by
Generative Disco: Text-to-Video Generation for Music Visualization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Generative Disco: Text-to-Video Generation for Music Visualization
read the original abstract
Visuals can enhance our experience of music, owing to the way they can amplify the emotions and messages conveyed within it. However, creating music visualization is a complex, time-consuming, and resource-intensive process. We introduce Generative Disco, a generative AI system that helps generate music visualizations with large language models and text-to-video generation. The system helps users visualize music in intervals by finding prompts to describe the images that intervals start and end on and interpolating between them to the beat of the music. We introduce design patterns for improving these generated videos: transitions, which express shifts in color, time, subject, or style, and holds, which help focus the video on subjects. A study with professionals showed that transitions and holds were a highly expressive framework that enabled them to build coherent visual narratives. We conclude on the generalizability of these patterns and the potential of generated video for creative professionals.
Forward citations
Cited by 3 Pith papers
-
Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation
Script2Screen integrates scriptwriting with an interactive text-to-audiovisual pipeline for dialogues, using a user study to show it supports iterative refinement in creative writing.
-
CameraCtrl: Enabling Camera Control for Text-to-Video Generation
CameraCtrl enables accurate camera pose control in video diffusion models through a trained plug-and-play module and dataset choices emphasizing diverse camera trajectories with matching appearance.
-
Examining the Usage of Generative AI Models in Student Learning Activities for Software Programming
ChatGPT helps students pass programming tests but not understand concepts; both heavy reliance and minimal use lead to weaker learning.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.