pith:6WDVKKSF
Pyramid Forcing: Head-Aware Pyramid KV Cache Policy for High-Quality Long Video Generation
Pyramid Forcing assigns different KV cache lengths to three attention head types to reduce error accumulation in long autoregressive video generation.
arxiv:2605.13111 v1 · 2026-05-13 · cs.CV
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{6WDVKKSFBK4XGFSUC5SCV4BXMY}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Pyramid Forcing consistently improves long-horizon generation quality on VBench-Long, increasing the 60-second Self Forcing score from 77.87 to 81.21 while enhancing motion dynamics, visual fidelity, and semantic consistency.
The three head types (Anchor, Wave, Veil) are stable across different models and datasets and can be reliably identified offline without retraining or runtime overhead.
Pyramid Forcing classifies attention heads into Anchor, Wave, and Veil types and applies type-specific KV cache policies to improve long-horizon autoregressive video generation quality.
References
Formal links
Receipt and verification
| First computed | 2026-05-18T03:08:58.115445Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
f587552a450ab973165417642af0376610e9f47f9fca2987620064cce90f9923
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/6WDVKKSFBK4XGFSUC5SCV4BXMY \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f587552a450ab973165417642af0376610e9f47f9fca2987620064cce90f9923
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "75348fc516cdb834c97cc03a6a77d15ec404b5a3b0f3efe1bd8c934986d90c1c",
"cross_cats_sorted": [],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CV",
"submitted_at": "2026-05-13T07:23:02Z",
"title_canon_sha256": "ce189f10a6b255df28ffdde68e05f4dfca67e591ce6a0c610c34cf63fb17e514"
},
"schema_version": "1.0",
"source": {
"id": "2605.13111",
"kind": "arxiv",
"version": 1
}
}