Pith Number

pith:YPVVT7ZX

pith:2024:YPVVT7ZXFHYHHO7BQ3DGEIG62C

not attested not anchored not stored refs resolved

We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?

Chen Li, Chong Sun, Guanting Dong, Honggang Zhang, Miaoxuan Zhang, Minhui Wu, Muxi Diao, Qiuna Tan, Runfeng Qiao, Runqi Qiao, Shanglin Lei, Xiaoshuai Song, Xiao Zong, Yida Xu, Yifan Zhang, Zhe Wei, Zhimin Bao, Zhuoma Gongque

Most large multimodal models solve visual math by rote memorization rather than grasping underlying concepts.

arxiv:2407.01284 v1 · 2024-07-01 · cs.AI · cs.CL · cs.CV · cs.LG · cs.SC

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{YPVVT7ZXFHYHHO7BQ3DGEIG62C}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

the primary challenge of GPT-4o has significantly transitioned from IK to IG, establishing it as the first LMM advancing towards the knowledge generalization stage. In contrast, other LMMs exhibit a marked inclination towards Rote Memorization - they correctly solve composite problems involving multiple knowledge concepts yet fail to answer sub-problems.

C2weakest assumption

That decomposing composite problems into sub-problems according to the required knowledge concepts accurately isolates inherent reasoning issues rather than introducing artifacts from visual parsing errors or ambiguous concept boundaries.

C3one line summary

WE-MATH benchmark reveals most LMMs rely on rote memorization for visual math while GPT-4o has shifted toward knowledge generalization.

References

166 extracted · 166 resolved · 24 Pith anchors

[1] Deep learning.nature, 521(7553):436–444, 2015 2015

[2] Gradient-based learning applied to document recognition 1998

[3] Attention is all you need 2017

[4] Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, 2022

[5] GPT-4 Technical Report 2023 · arXiv:2303.08774

Formal links

2 machine-checked theorem links

Cited by

32 papers in Pith

ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection

Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning

MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problems

VRPRM: Process Reward Modeling via Visual Reasoning

Visual-Advantage On-Policy Distillation for Vision-Language Models

Receipt and verification

First computed	2026-05-17T23:38:46.456615Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

c3eb59ff3729f073bbe186c66220ded0ab065cbf552b72ccd37c1d4642381502

Aliases

arxiv: 2407.01284 · arxiv_version: 2407.01284v1 · doi: 10.48550/arxiv.2407.01284 · pith_short_12: YPVVT7ZXFHYH · pith_short_16: YPVVT7ZXFHYHHO7B · pith_short_8: YPVVT7ZX

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/YPVVT7ZXFHYHHO7BQ3DGEIG62C \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: c3eb59ff3729f073bbe186c66220ded0ab065cbf552b72ccd37c1d4642381502

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "7c039bb5895f2369789dd0dab3df8b0c5538a688f2f9fd9d3c53c8c91157a385",
    "cross_cats_sorted": [
      "cs.CL",
      "cs.CV",
      "cs.LG",
      "cs.SC"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.AI",
    "submitted_at": "2024-07-01T13:39:08Z",
    "title_canon_sha256": "2569764b94b36b7df5a6002cad881f0376ed566570187feb8b19985df880ebaf"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2407.01284",
    "kind": "arxiv",
    "version": 1
  }
}