An encoder-decoder transformer conditions on text actions and a time-aligned event roll to delete, insert, or enhance individual sound events in dense audio scenes.
PicoAudio: Enabling Precise Timestamp and Frequency Controllability of Audio Events in Text-to-audio Generation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Recently, audio generation tasks have attracted considerable research interests. Precise temporal controllability is essential to integrate audio generation with real applications. In this work, we propose a temporal controlled audio generation framework, PicoAudio. PicoAudio integrates temporal information to guide audio generation through tailored model design. It leverages data crawling, segmentation, filtering, and simulation of fine-grained temporally-aligned audio-text data. Both subjective and objective evaluations demonstrate that PicoAudio dramantically surpasses current state-of-the-art generation models in terms of timestamp and occurrence frequency controllability. The generated samples are available on the demo website https://zeyuxie29.github.io/PicoAudio.github.io.
citation-role summary
baseline 1
citation-polarity summary
fields
cs.SD 1years
2025 1verdicts
CONDITIONAL 1roles
baseline 1polarities
baseline 1representative citing papers
citing papers explorer
-
Recomposer: Event-roll-guided generative audio editing
An encoder-decoder transformer conditions on text actions and a time-aligned event roll to delete, insert, or enhance individual sound events in dense audio scenes.