pith:4WURVMDY
River-LLM: Large Language Model Seamless Exit Based on KV Share
River-LLM enables token-level early exit in decoder LLMs by generating missing KV caches through layer sharing.
arxiv:2604.18396 v3 · 2026-04-20 · cs.CL
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{4WURVMDYD4OOYRCIGT2UBXIPKJ}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
River-LLM, a training-free framework that enables seamless token-level Early Exit... achieves 1.71 to 2.16 times of practical speedup while maintaining high generation quality.
That state transition similarity within decoder blocks can reliably predict cumulative KV errors and guide exit decisions without causing noticeable quality degradation or error drift over sequences, especially since no training is used to calibrate the predictor.
River-LLM enables seamless token-level early exit in decoder-only LLMs via a KV-shared river mechanism and similarity-based error prediction, delivering 1.71-2.16x practical speedup on reasoning tasks while preserving generation quality.
Receipt and verification
| First computed | 2026-05-26T02:04:11.024606Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
e5a91ab0781f1cec444834f540dd0f524e8b82a8cb8c1200a2396571b5f57cd0
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/4WURVMDYD4OOYRCIGT2UBXIPKJ \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e5a91ab0781f1cec444834f540dd0f524e8b82a8cb8c1200a2396571b5f57cd0
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "4344ba24f4a63f75da7f4c4df90d93c78b5afe8f6f72de8309b7e3fea378472c",
"cross_cats_sorted": [],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"primary_cat": "cs.CL",
"submitted_at": "2026-04-20T15:20:17Z",
"title_canon_sha256": "7e1af3bc0d2963a3548b7b5db3bf5e803a3da1a241f068a4ec92d2309a9ab290"
},
"schema_version": "1.0",
"source": {
"id": "2604.18396",
"kind": "arxiv",
"version": 3
}
}