REVIEW 2 cited by
InstrumentGen: Generating Sample-Based Musical Instruments From Text
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce the text-to-instrument task, which aims at generating sample-based musical instruments based on textual prompts. Accordingly, we propose InstrumentGen, a model that extends a text-prompted generative audio framework to condition on instrument family, source type, pitch (across an 88-key spectrum), velocity, and a joint text/audio embedding. Furthermore, we present a differentiable loss function to evaluate the intra-instrument timbral consistency of sample-based instruments. Our results establish a foundational text-to-instrument baseline, extending research in the domain of automatic sample-based instrument generation.
Forward citations
Cited by 2 Pith papers
-
WildFX: A DAW-Powered Pipeline for In-the-Wild Audio FX Graph Modeling
WildFX generates multi-track audio datasets by rendering real DAW effect graphs with commercial plugins inside Docker, and demonstrates the pipeline on blind mixing-graph estimation.
-
TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
TokenSynth uses a decoder-only transformer over audio tokens, conditioned on MIDI and CLAP timbre embeddings, to perform zero-shot instrument cloning, text-to-instrument synthesis, and text-guided timbre manipulation ...
Discussion (0). Continue with ORCID to comment.