Gemini 2.5 Flash matches human rank correlation within 0.07 on 5 of 8 dimensions and within-1 agreement on 6 of 8 when judging raw stereo full-duplex agent conversations, with rank order transferring across later Gemini models.
SpeechQualityLLM: Llm-based multimodal assessment of speech quality
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
citation-role summary
background 1
citation-polarity summary
years
2026 2roles
background 1polarities
background 1representative citing papers
JASTIN is an instruction-driven audio evaluation system that achieves state-of-the-art correlation with human ratings on speech, sound, music, and out-of-domain tasks without task-specific retraining.
citing papers explorer
-
A Reliability Assessment of LALM Audio Judges for Full-Duplex Voice Agents
Gemini 2.5 Flash matches human rank correlation within 0.07 on 5 of 8 dimensions and within-1 agreement on 6 of 8 when judging raw stereo full-duplex agent conversations, with rank order transferring across later Gemini models.
-
JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions
JASTIN is an instruction-driven audio evaluation system that achieves state-of-the-art correlation with human ratings on speech, sound, music, and out-of-domain tasks without task-specific retraining.