OasisKV uses speculative-decoding draft tokens to predict the next step's important KV-cache blocks, prefetching them from CPU or remote memory so HBM holds only a sparse working set.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DC 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
OasisKV uses speculative-decoding draft tokens to predict the next step's important KV-cache blocks, prefetching them from CPU or remote memory so HBM holds only a sparse working set.