Pith Number

pith:32AGNVES

pith:2025:32AGNVESK7C6YI24VJUC4G546R

not attested not anchored not stored refs pending

LLM Pretraining with Continuous Concepts

Andrew Cohen, Ilia Kulikov, Jack Lanchantin, Jane Yu, Janice Lan, Jason Weston, Jihoon Tack, Shibo Hao, Xian Li, Yuandong Tian

arxiv:2502.08524 v1 · 2025-02-12 · cs.LG · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{32AGNVESK7C6YI24VJUC4G546R}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

11 papers in Pith

Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories

NITP: Next Implicit Token Prediction for LLM Pre-training

Learn from your own latents and not from tokens: A sample-complexity theory

Unlocking the Working Memory of Large Language Models for Latent Reasoning

Receipt and verification

First computed	2026-07-05T10:13:24.358671Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

de8066d49257c5ec235caa682e1bbcf446f38f4239e1848df90b5c9d030327c8

Aliases

arxiv: 2502.08524 · arxiv_version: 2502.08524v1 · doi: 10.48550/arxiv.2502.08524 · pith_short_12: 32AGNVESK7C6 · pith_short_16: 32AGNVESK7C6YI24 · pith_short_8: 32AGNVES

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/32AGNVESK7C6YI24VJUC4G546R \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: de8066d49257c5ec235caa682e1bbcf446f38f4239e1848df90b5c9d030327c8

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "0b47c7623be47e9f9c7e19780f79d3b11ebbbcfdd9776dbeeff9a3fe66a0317d",
    "cross_cats_sorted": [
      "cs.CL"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2025-02-12T16:00:11Z",
    "title_canon_sha256": "7fe977c8f17f7b8ba023c59cff72900b5b66bd6e5d01f452accf094fb260ed69"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2502.08524",
    "kind": "arxiv",
    "version": 1
  }
}