ContextCache adds conversation context to LLM semantic caching via self-attention over query history, improving cache precision and recall over GPTCache by roughly 11-15% and serving cached responses about 10 times faster than calling the LLM.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models
ContextCache adds conversation context to LLM semantic caching via self-attention over query history, improving cache precision and recall over GPTCache by roughly 11-15% and serving cached responses about 10 times faster than calling the LLM.