Pith. sign in

REVIEW 3 cited by

Generative Disco: Text-to-Video Generation for Music Visualization

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2304.08551 v2 pith:CJAHRWH7 submitted 2023-04-17 cs.HC cs.AI

Generative Disco: Text-to-Video Generation for Music Visualization

classification cs.HC cs.AI
keywords musicgenerativediscogeneratedgenerationhelpsholdsintervals
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Visuals can enhance our experience of music, owing to the way they can amplify the emotions and messages conveyed within it. However, creating music visualization is a complex, time-consuming, and resource-intensive process. We introduce Generative Disco, a generative AI system that helps generate music visualizations with large language models and text-to-video generation. The system helps users visualize music in intervals by finding prompts to describe the images that intervals start and end on and interpolating between them to the beat of the music. We introduce design patterns for improving these generated videos: transitions, which express shifts in color, time, subject, or style, and holds, which help focus the video on subjects. A study with professionals showed that transitions and holds were a highly expressive framework that enabled them to build coherent visual narratives. We conclude on the generalizability of these patterns and the potential of generated video for creative professionals.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation

    cs.HC 2025-04 unverdicted novelty 6.0

    Script2Screen integrates scriptwriting with an interactive text-to-audiovisual pipeline for dialogues, using a user study to show it supports iterative refinement in creative writing.

  2. CameraCtrl: Enabling Camera Control for Text-to-Video Generation

    cs.CV 2024-04 unverdicted novelty 6.0

    CameraCtrl enables accurate camera pose control in video diffusion models through a trained plug-and-play module and dataset choices emphasizing diverse camera trajectories with matching appearance.

  3. Examining the Usage of Generative AI Models in Student Learning Activities for Software Programming

    cs.SE 2025-11 conditional novelty 5.0

    ChatGPT helps students pass programming tests but not understand concepts; both heavy reliance and minimal use lead to weaker learning.