Pith. sign in
Pith Number

pith:WV23MRAK

pith:2022:WV23MRAKMFBGEAXVZ6JONP6E37
not attested not anchored not stored refs pending

Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse

Antonio Orvieto, Aurelien Lucchi, Lorenzo Noci, Luca Biggio, Sidak Pal Singh, Sotiris Anagnostidis

arxiv:2206.03126 v1 · 2022-06-07 · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?
Add to your LaTeX paper 
\usepackage{pith}
\pithnumber{WV23MRAKMFBGEAXVZ6JONP6E37}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
✓ Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

6 papers in Pith

Dead-Direction Signatures: A Cheap Spectral Reading of Singular Complexity
Algebraic Dead Directions in LayerNorm Transformers: A Forward-Pass-Only Diagnostic at LLM Scale
Dead Directions: Geometric Singular Learning
Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation
A Unified Framework for Critical Scaling of Inverse Temperature in Self-Attention
Receipt and verification
First computed 2026-07-05T04:29:39.585737Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

b575b6440a61426202f5cf92e6bfc4dfc1b83ab8e97d382d09046fafe37bcb24

Aliases

arxiv: 2206.03126 · arxiv_version: 2206.03126v1 · doi: 10.48550/arxiv.2206.03126 · pith_short_12: WV23MRAKMFBG · pith_short_16: WV23MRAKMFBGEAXV · pith_short_8: WV23MRAK
Agent API
Resolver JSON Graph JSON Events JSON Schema Signing key
Verify this Pith Number yourself 
curl -sH 'Accept: application/ld+json' https://pith.science/pith/WV23MRAKMFBGEAXVZ6JONP6E37 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: b575b6440a61426202f5cf92e6bfc4dfc1b83ab8e97d382d09046fafe37bcb24
Canonical record JSON 
{
  "metadata": {
    "abstract_canon_sha256": "cf87d8c3d4d1f5e739795a95fd45e8b8ab35984e2c81ece3f9b0046890e9cf47",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2022-06-07T09:07:24Z",
    "title_canon_sha256": "6cdeb7aabb272cf3abc49a57708d97a355f81aac94ace690191eaa223f43a6db"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2206.03126",
    "kind": "arxiv",
    "version": 1
  }
}