AHELM standardizes evaluation of audio-language models across 10 aspects and shows simple ASR+LLM systems are competitive with multimodal models.
The Claude 3 model family: Opus, Sonnet, Haiku, 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
AHELM: A Holistic Evaluation of Audio-Language Models
AHELM standardizes evaluation of audio-language models across 10 aspects and shows simple ASR+LLM systems are competitive with multimodal models.