Introduces SemanticSeg dataset with over 30k instances and a block distillation framework to achieve near full-attention performance with automatic block segmentation.
Prompt Cache: Modular Attention Reuse for Low-Latency Inference , booktitle =
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation
Introduces SemanticSeg dataset with over 30k instances and a block distillation framework to achieve near full-attention performance with automatic block segmentation.