Pith. sign in

REVIEW 6 cited by

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2401.14011 v3 pith:SKA6J7WB submitted 2024-01-25 cs.CL cs.AIcs.MM

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning

classification cs.CL cs.AIcs.MM
keywords cmmumllmsknowledgemulti-modalquestionsmultiple-choicereasoningavailable
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Multi-modal large language models(MLLMs) have achieved remarkable progress and demonstrated powerful knowledge comprehension and reasoning abilities. However, the mastery of domain-specific knowledge, which is essential for evaluating the intelligence of MLLMs, continues to be a challenge. Current multi-modal benchmarks for domain-specific knowledge concentrate on multiple-choice questions and are predominantly available in English, which imposes limitations on the comprehensiveness of the evaluation. To this end, we introduce CMMU, a novel benchmark for multi-modal and multi-type question understanding and reasoning in Chinese. CMMU consists of 3,603 questions in 7 subjects, covering knowledge from primary to high school. The questions can be categorized into 3 types: multiple-choice, multiple-response, and fill-in-the-blank, bringing greater challenges to MLLMs. In addition, we propose an evaluation strategy called Positional Error Variance for assessing multiple-choice questions. The strategy aims to perform a quantitative analysis of position bias. We evaluate seven open-source MLLMs along with GPT4-V, Gemini-Pro, and Qwen-VL-Plus. The results demonstrate that CMMU poses a significant challenge to the recent MLLMs. The data and code are available at https://github.com/FlagOpen/CMMU.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection

    cs.CL 2024-10 unverdicted novelty 8.0

    ErrorRadar is a new benchmark of 2,500 multimodal K-12 math problems for MLLM error step identification and categorization, where GPT-4o trails human experts by ~10%.

  2. Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset

    cs.CV 2026-05 unverdicted novelty 7.0

    Introduces CFMME benchmark and reports that top LVLMs reach 66.11% accuracy on financial QA and 77.18 average on detection, recognition, and extraction tasks.

  3. CArtBench: Evaluating Vision-Language Models on Chinese Art Understanding, Interpretation, and Authenticity

    cs.CL 2026-04 unverdicted novelty 7.0

    CArtBench shows VLMs achieve high scores on easy recognition but drop sharply on evidence linking, style inference, long-form appreciation, and authenticity discrimination for Chinese art.

  4. SciExplore: Evaluating Autonomous Agents from Scientific Navigation to Information Integration

    cs.AI 2026-07 conditional novelty 6.0

    A 103-task expert-curated benchmark shows that current LLMs and agents handle simple scientific lookup but mostly fail at ambiguous retrieval, citation grounding, and structured cross-source synthesis.

  5. CArtBench: Evaluating Vision-Language Models on Chinese Art Understanding, Interpretation, and Authenticity

    cs.CL 2026-04 conditional novelty 6.0

    Current VLMs score well on Chinese-art recognition QA but collapse on style-to-period inference, expert-style long-form appreciation, and authenticity discrimination under visual confounds.

  6. Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning

    cs.CL 2025-02 unverdicted novelty 2.0

    Position paper claims multimodal LLMs can significantly advance scientific reasoning and proposes a four-stage roadmap plus challenges and suggestions.