pith. sign in
Pith Number

pith:4WURVMDY

pith:2026:4WURVMDYD4OOYRCIGT2UBXIPKJ
not attested not anchored not stored refs pending

River-LLM: Large Language Model Seamless Exit Based on KV Share

An Zou, Yingtao Shen

River-LLM enables token-level early exit in decoder LLMs by generating missing KV caches through layer sharing.

arxiv:2604.18396 v3 · 2026-04-20 · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{4WURVMDYD4OOYRCIGT2UBXIPKJ}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

River-LLM, a training-free framework that enables seamless token-level Early Exit... achieves 1.71 to 2.16 times of practical speedup while maintaining high generation quality.

C2weakest assumption

That state transition similarity within decoder blocks can reliably predict cumulative KV errors and guide exit decisions without causing noticeable quality degradation or error drift over sequences, especially since no training is used to calibrate the predictor.

C3one line summary

River-LLM enables seamless token-level early exit in decoder-only LLMs via a KV-shared river mechanism and similarity-based error prediction, delivering 1.71-2.16x practical speedup on reasoning tasks while preserving generation quality.

Receipt and verification
First computed 2026-05-26T02:04:11.024606Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

e5a91ab0781f1cec444834f540dd0f524e8b82a8cb8c1200a2396571b5f57cd0

Aliases

arxiv: 2604.18396 · arxiv_version: 2604.18396v3 · doi: 10.48550/arxiv.2604.18396 · pith_short_12: 4WURVMDYD4OO · pith_short_16: 4WURVMDYD4OOYRCI · pith_short_8: 4WURVMDY
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/4WURVMDYD4OOYRCIGT2UBXIPKJ \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e5a91ab0781f1cec444834f540dd0f524e8b82a8cb8c1200a2396571b5f57cd0
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "4344ba24f4a63f75da7f4c4df90d93c78b5afe8f6f72de8309b7e3fea378472c",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2026-04-20T15:20:17Z",
    "title_canon_sha256": "7e1af3bc0d2963a3548b7b5db3bf5e803a3da1a241f068a4ec92d2309a9ab290"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2604.18396",
    "kind": "arxiv",
    "version": 3
  }
}