Pith Number

pith:PWNZGQI4

pith:2024:PWNZGQI46DAA3JDGJGDFBJWFEV

not attested not anchored not stored refs pending

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Catherine Wu, Charlotte Zhuang, Dean Lee, Dylan Slack, Hugh Zhang, Jeff Da, Michele Lunati, Pranav Raja, Qin Lyu, Russell Kaplan, Sean Hendryx, Summer Yue, Tiffany Zhao, Vaughn Robinson, Will Song

arxiv:2405.00332 v4 · 2024-05-01 · cs.CL · cs.AI · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{PWNZGQI46DAA3JDGJGDFBJWFEV}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

11 papers in Pith

RigorBench: Benchmarking Engineering Process Discipline in Autonomous AI Coding Agents

Testing Frontier Large Language Models' Physics Literacy in Parallel Physical Worlds

CoEval: Ranking Language Models for Custom Tasks Without Labeled Data or Trustworthy Benchmarks

RigorBench: Benchmarking Engineering Process Discipline in Autonomous AI Coding Agents

Lessons from the Trenches on Reproducible Evaluation of Language Models

Receipt and verification

First computed	2026-07-05T09:39:22.852176Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

7d9b93411cf0c00da466498650a6c5255688f79c3ccf356a7493801b3582eec8

Aliases

arxiv: 2405.00332 · arxiv_version: 2405.00332v4 · doi: 10.48550/arxiv.2405.00332 · pith_short_12: PWNZGQI46DAA · pith_short_16: PWNZGQI46DAA3JDG · pith_short_8: PWNZGQI4

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/PWNZGQI46DAA3JDGJGDFBJWFEV \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 7d9b93411cf0c00da466498650a6c5255688f79c3ccf356a7493801b3582eec8

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "bf05f2b667fd90f7735da877121a5ea617547691104587b6bc99d992d900c258",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.LG"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-05-01T05:52:05Z",
    "title_canon_sha256": "99aa56fec77c1c0e6ca55815bf7eae7d2269ef7d222ec0b07fb9ced9d31ac0d4"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2405.00332",
    "kind": "arxiv",
    "version": 4
  }
}