Gemini 2.5 Flash matches human rank correlation within 0.07 on 5 of 8 dimensions and within-1 agreement on 6 of 8 when judging raw stereo full-duplex agent conversations, with rank order transferring across later Gemini models.
ITU-T Recommendation P.808: Subjective evalua- tion of speech quality with a crowdsourcing approach,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
A Reliability Assessment of LALM Audio Judges for Full-Duplex Voice Agents
Gemini 2.5 Flash matches human rank correlation within 0.07 on 5 of 8 dimensions and within-1 agreement on 6 of 8 when judging raw stereo full-duplex agent conversations, with rank order transferring across later Gemini models.