pith. sign in
Pith Number

pith:7I3KCDAM

pith:2025:7I3KCDAMH7KICXH44C26P7ZB2S
not attested not anchored not stored refs pending

MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation

Aosong Feng, Dairui Liu, Douglas Teodoro, Edison Marrese-Taylor, Fan Gao, Felix Juefei-Xu, Foutse Khomh, Heli Qi, Huitao Li, Irene Li, Jinghui Lu, Junjue Wang, Kunyu Yu, Lei Ma, Nan Liu, Osamu Yoshie, Qingcheng Zeng, Qingyu Chen, Randy Goebel, Ruihai Dong, Rui Yang, Shangding Gu, Shijian Lu, Weihao Xuan, Xiaofei Xie, Xin Li, Yuang Jiang, Yuekang Li, Yun Xing, Yunze Xiao, Yusuke Iwasawa, Yutaka Matsuo

arxiv:2503.10497 v2 · 2025-03-13 · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{7I3KCDAMH7KICXH44C26P7ZB2S}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

7 papers in Pith

Receipt and verification
First computed 2026-07-05T11:09:46.079101Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

fa36a10c0c3fd4815cfce0b5e7ff21d4899fadcd9832063dbbb245ef82a6109b

Aliases

arxiv: 2503.10497 · arxiv_version: 2503.10497v2 · doi: 10.48550/arxiv.2503.10497 · pith_short_12: 7I3KCDAMH7KI · pith_short_16: 7I3KCDAMH7KICXH4 · pith_short_8: 7I3KCDAM
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/7I3KCDAMH7KICXH44C26P7ZB2S \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: fa36a10c0c3fd4815cfce0b5e7ff21d4899fadcd9832063dbbb245ef82a6109b
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "f580cce5636af75d19cfc01a218c8a74598ae2c985f3478139807a80c1b3a09b",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-03-13T15:59:20Z",
    "title_canon_sha256": "68a0aa5742c827d7183a6af5290d1f7a777f3389625c8029b370f1b0268fca6f"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2503.10497",
    "kind": "arxiv",
    "version": 2
  }
}