LazyAttention kernelizes deferred positional encoding to enable zero-copy, position-agnostic KV cache reuse, delivering 1.37× lower TTFT and 1.40× higher throughput than Block-Attention under skewed document distributions while preserving output quality.
Efficient sampling approaches to shapley value approximation.Proceedings of the ACM on Management of Data, 1(1):1–24
2 Pith papers cite this work, alongside 37 external citations. Polarity classification is still indexing.
2
Pith papers citing it
37
external citations · OpenAlex
years
2026 2representative citing papers
citing papers explorer
-
LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encoding
LazyAttention kernelizes deferred positional encoding to enable zero-copy, position-agnostic KV cache reuse, delivering 1.37× lower TTFT and 1.40× higher throughput than Block-Attention under skewed document distributions while preserving output quality.
- First-Order Efficiency for Probabilistic Value Estimation via A Statistical Viewpoint