Pith Number

pith:6YFZ65ZA

pith:2025:6YFZ65ZAMXCLGE5X3QXE7MIZYY

not attested not anchored not stored refs pending

IMProofBench: Benchmarking AI on Research-Level Mathematical Proof Generation

Adam Kurpisz, Aitor Iribar Lopez, Aleksandar Mijatovi\'c, Alessio Bottini, Aluna Rizzoli, Ana Cannas da Silva, Ana-Maria Castravet, Baran Hashemi, Benjamin Doerr, Charles Vial, Chiara Meroni, Claudio Fontanari, Daniel Holmes, Daniel Platt, Daria Sakhanda, David Holmes, David Martins, David Mu\~noz-Lahoz, Diaaeldin Taha, Dylan Possama\"i, Filippo Gaia, Gabriel Ribeiro, Georg Oberdieck, Gergely B\'erczi, Henk van der Pol, Henry Liu, Ignacio Barros, Ingmar Metzler, Jasper Dekoninck, Jeremy Feusi, Jim Bryan, Jo\~ao Camarneiro, Johannes Lengler, Johannes Schmitt, Josef Teichmann, Marc Roth, Martijn Kool, Martina J{\o}rgensen, Martin M\"oller, Michel van Garrel, Niklas Canova, Patrick Schnider, Peter Gr\"unwald, Pieter Belmans, Pim Spelier, Raphael Appenzeller, Ra\'ul S\'anchez Gal\'an, Richard P. Thomas, Robert Nowak, Ronald van Luijk, Samuel Mu\~noz-Ech\'aniz, Sergej Monavari, Stefan Kuhlmann, Steven Kelk, Tim Gehrunger, Timo de Wolff, Victor Jaeck, Yannik Schuler, Yuuji Tanaka, Zheming Sun

arxiv:2509.26076 v2 · 2025-09-30 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{6YFZ65ZAMXCLGE5X3QXE7MIZYY}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

6 papers in Pith

Evaluating SageMath-Augmented LLM Agents for Computational and Experimental Mathematics

Failure Modes of Large Language Models on Research-Level Mathematics: A Taxonomy and an Empirical Characterisation

Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs

Receipt and verification

First computed	2026-07-10T01:19:39.853324Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

f60b9f772065c4b313b7dc2e4fb119c63255043151fc4984d2f0aee56921d044

Aliases

arxiv: 2509.26076 · arxiv_version: 2509.26076v2 · doi: 10.48550/arxiv.2509.26076 · pith_short_12: 6YFZ65ZAMXCL · pith_short_16: 6YFZ65ZAMXCLGE5X · pith_short_8: 6YFZ65ZA

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/6YFZ65ZAMXCLGE5X3QXE7MIZYY \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f60b9f772065c4b313b7dc2e4fb119c63255043151fc4984d2f0aee56921d044

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "078632ad139486c8707c08ab5c8a0da2aa872f426f324b94164bac8927f66e48",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-09-30T10:50:37Z",
    "title_canon_sha256": "885e4921a7ac22b51c7b6b08347db14250690ce28767e8904b9b832bcecd6463"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2509.26076",
    "kind": "arxiv",
    "version": 2
  }
}