Pith Number

pith:4CYQ5DEN

pith:2022:4CYQ5DENLPHF264KK5UCLLMU3H

not attested not anchored not stored refs pending

What Language Model to Train if You Have One Million GPU Hours?

Colin Raffel, Daniel Hesslow, Hady Elsahar, Iz Beltagy, Jaesung Tae, Jason Phang, Julien Launay, Lintang Sutawika, Lucile Saulnier, M Saiful Bari, Niklas Muennighoff, Ofir Press, Sheng Shen, Stas Bekman, Stella Biderman, Teven Le Scao, Thomas Wang, Victor Sanh, Zheng Xin Yong

arxiv:2210.15424 v2 · 2022-10-27 · cs.CL · cs.AI · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{4CYQ5DENLPHF264KK5UCLLMU3H}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

4 papers in Pith

Scaling Data-Constrained Language Models

The Falcon Series of Open Language Models

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

StarCoder 2 and The Stack v2: The Next Generation

Receipt and verification

First computed	2026-07-05T05:13:58.043279Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

e0b10e8c8d5bce5d7b8a576825ad94d9c433487c95bcb03a44a600543e3ce33a

Aliases

arxiv: 2210.15424 · arxiv_version: 2210.15424v2 · doi: 10.48550/arxiv.2210.15424 · pith_short_12: 4CYQ5DENLPHF · pith_short_16: 4CYQ5DENLPHF264K · pith_short_8: 4CYQ5DEN

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/4CYQ5DENLPHF264KK5UCLLMU3H \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e0b10e8c8d5bce5d7b8a576825ad94d9c433487c95bcb03a44a600543e3ce33a

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "6be65f477250d59a3af3a1452a35bd52efb60b366cd284979801b1c0f166da0f",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.LG"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2022-10-27T13:43:27Z",
    "title_canon_sha256": "9e629789f31fe27f27e0286800bf1661449b833613af81d14c5fdc29af00f5b2"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2210.15424",
    "kind": "arxiv",
    "version": 2
  }
}