Pith Number

pith:GDS7MHYH

pith:2024:GDS7MHYH7VWQAE32ACL2RSMBMT

not attested not anchored not stored refs pending

Are We Done with MMLU?

Alberto Carlo Maria Mancino, Alessio Devoto, Aryo Pradipta Gema, Claire Barale, Emile van Krieken, Giwon Hong, Jean Kaddour, Joshua Harris, Joshua Ong Jun Leang, Mohammad Reza Ghasemi Madani, Pasquale Minervini, Robert McHardy, Rohit Saxena, Xiaotang Du, Xuanli He, Yu Zhao

arxiv:2406.04127 v3 · 2024-06-06 · cs.CL · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{GDS7MHYH7VWQAE32ACL2RSMBMT}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

23 papers in Pith

Improved Large Language Diffusion Models

Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients

Knowledge Index of Noah's Ark

Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety

Mellum2 Technical Report

Receipt and verification

First computed	2026-07-05T09:59:16.123997Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

30e5f61f07fd6d00137a0097a8c98164c31549318ce8be9191383e268f7a5d91

Aliases

arxiv: 2406.04127 · arxiv_version: 2406.04127v3 · doi: 10.48550/arxiv.2406.04127 · pith_short_12: GDS7MHYH7VWQ · pith_short_16: GDS7MHYH7VWQAE32 · pith_short_8: GDS7MHYH

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/GDS7MHYH7VWQAE32ACL2RSMBMT \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 30e5f61f07fd6d00137a0097a8c98164c31549318ce8be9191383e268f7a5d91

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "47d71667955c77b30f75cfbfdce825653d66e87629a2771eb9bca5345ad71f03",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-06-06T14:49:06Z",
    "title_canon_sha256": "943a1c434b5b4a487de0e9c3e56d98db7b929f9aa4058d84e6e153a7237e5d4c"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2406.04127",
    "kind": "arxiv",
    "version": 3
  }
}