Introduces ZNO-Vision, a 4,306-item Ukrainian multimodal exam benchmark, plus a translated VQA set and a 20-dish cuisine test, and finds only Gemini, Claude, and Qwen2-VL-72B beat the chance baseline.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains
Introduces ZNO-Vision, a 4,306-item Ukrainian multimodal exam benchmark, plus a translated VQA set and a 20-dish cuisine test, and finds only Gemini, Claude, and Qwen2-VL-72B beat the chance baseline.