Averaging a small number of audio embeddings per class outperforms zero-shot text-embedding classification for CLAP-based audio classification.
Improving Audio Classification by Transitioning from Zero- to Few-Shot
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated by neural networks trained through contrastive learning to align audio and text representations. Identifying the optimal text description for an audio class is challenging, particularly when the class comprises a wide variety of sounds. This paper examines few-shot methods designed to improve classification accuracy beyond the zero-shot approach. Specifically, audio embeddings are grouped by class and processed to replace the inherently noisy text embeddings. Our results demonstrate that few-shot classification typically outperforms the zero-shot baseline.
fields
cs.SD 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Improving Audio Classification by Transitioning from Zero- to Few-Shot
Averaging a small number of audio embeddings per class outperforms zero-shot text-embedding classification for CLAP-based audio classification.