MatVQA is a new materials-science visual QA benchmark with automated shortcut removal, and current multimodal LLMs score at most about 52% on it.
Claude 3.7 sonnet: Frontier reasoning made practical
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CE 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Seeing Beyond Words: MatVQA for Challenging Visual-Scientific Reasoning in Materials Science
MatVQA is a new materials-science visual QA benchmark with automated shortcut removal, and current multimodal LLMs score at most about 52% on it.