Pith Number

pith:LUU4NGDJ

pith:2024:LUU4NGDJYCFK4A4QTHVPEZKG3M

not attested not anchored not stored refs pending

Upcycling Large Language Models into Mixture of Experts

Abhinav Khattar, Ashwath Aithal, Bryan Catanzaro, Ethan He, Mohammad Shoeybi, Ryan Prenger, Shiqing Fan, Tong Liu, Vijay Korthikanti, Zijie Yan

arxiv:2410.07524 v2 · 2024-10-10 · cs.CL · cs.AI · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{LUU4NGDJYCFK4A4QTHVPEZKG3M}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

7 papers in Pith

Reversible Foundations: Training a 120B Sparse MoE through State-Preserving Scaling

Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

Mixture-of-Experts Can Surpass Dense LLMs Under Strictly Equal Resource

Beyond Sunk Costs: Boosting LLM Pre-training Efficiency via Orthogonal Growth of Mixture-of-Experts

SpikingBrain: Spiking Brain-inspired Large Models

Receipt and verification

First computed	2026-07-05T11:21:36.784186Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

5d29c69869c08aae039099eaf26546db093bf6121b61e136c8f87da12500f2ed

Aliases

arxiv: 2410.07524 · arxiv_version: 2410.07524v2 · doi: 10.48550/arxiv.2410.07524 · pith_short_12: LUU4NGDJYCFK · pith_short_16: LUU4NGDJYCFK4A4Q · pith_short_8: LUU4NGDJ

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/LUU4NGDJYCFK4A4QTHVPEZKG3M \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 5d29c69869c08aae039099eaf26546db093bf6121b61e136c8f87da12500f2ed

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "7e8c808f788e551fb5920ec128e1bc6a1baaa9e41548ebe07b3ba35a72ceb608",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.LG"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-10-10T01:36:03Z",
    "title_canon_sha256": "71acd7b0c7e3c19ade3d4443e21543799523a60e8cbb7858ba625f601bb7d9bc"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2410.07524",
    "kind": "arxiv",
    "version": 2
  }
}