Pith Number

pith:RW5XONPR

pith:2024:RW5XONPRALUDJDUGBESKZJT2PU

not attested not anchored not stored refs pending

Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models

Biye Li, Bo Zhu, Cheng cheng, Han Fang, Jianhao Zhang, Liang Zeng, Liang Zhao, Peng Cheng, Rui Hu, Shuicheng Yan, Tianwen Wei, Weiwei L\"u, Xiaokun Wang, Xiaoyu Zhang, Yahui Zhou, Yutuan Ma

arxiv:2406.06563 v1 · 2024-06-03 · cs.CL · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{RW5XONPRALUDJDUGBESKZJT2PU}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

11 papers in Pith

SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment

GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts

Optimization Hyper-parameter Laws for Large Language Models

Mixture-of-Experts Can Surpass Dense LLMs Under Strictly Equal Resource

Receipt and verification

First computed	2026-07-05T08:29:47.523700Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

8dbb7735f102e8348e860924aca67a7d08187c5ca7fa346374c42620a351bd02

Aliases

arxiv: 2406.06563 · arxiv_version: 2406.06563v1 · doi: 10.48550/arxiv.2406.06563 · pith_short_12: RW5XONPRALUD · pith_short_16: RW5XONPRALUDJDUG · pith_short_8: RW5XONPR

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/RW5XONPRALUDJDUGBESKZJT2PU \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 8dbb7735f102e8348e860924aca67a7d08187c5ca7fa346374c42620a351bd02

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "70e6a03e57a3b2cb107beef0010d4d9d631c63401d32aa1285188fe444594fa1",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-06-03T03:58:41Z",
    "title_canon_sha256": "19be60bf4420a9da3c11bd67d528d09e86c9af4e75b575b31331cdc395641525"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2406.06563",
    "kind": "arxiv",
    "version": 1
  }
}