MedMosaic is a large-scale medical audio QA benchmark that shows even state-of-the-art models like Gemini-2.5-pro reach only about 68% accuracy on diverse clinical audio scenarios.
Turn 1 makes a claim then Turn 2 detects SUBTLE rephrasing that may or may not constitute contradiction then Turn 3 must evaluate clinical significance
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SD 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio
MedMosaic is a large-scale medical audio QA benchmark that shows even state-of-the-art models like Gemini-2.5-pro reach only about 68% accuracy on diverse clinical audio scenarios.