An acceleration method for adaptive RAG that reuses cached key-value representations of overlapping documents and uses document-derived drafts for parallel decoding, achieving about 2x end-to-end speedup.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Accelerating Adaptive Retrieval Augmented Generation via Instruction-Driven Representation Reduction of Retrieval Overlaps
An acceleration method for adaptive RAG that reuses cached key-value representations of overlapping documents and uses document-derived drafts for parallel decoding, achieving about 2x end-to-end speedup.