A test-time reinforcement learning framework for joint model caching and inference offloading is claimed to cut simulated long-context LLM serving costs at the mobile edge by at least 30%.
Retention-aware container caching for serverless edge computing,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.NI 1years
2025 1verdicts
REJECT 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Serving Long-Context LLMs at the Mobile Edge: Test-Time Reinforcement Learning-based Model Caching and Inference Offloading
A test-time reinforcement learning framework for joint model caching and inference offloading is claimed to cut simulated long-context LLM serving costs at the mobile edge by at least 30%.