TimelyLLM segments LLM-generated robot plans into executable pieces and schedules those pieces by urgency, reducing response delays for time-critical robot tasks.
Taming throughput-latency tradeoff in llm inference with sarathi-serve
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.RO 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
TimelyLLM: Segmented LLM Serving System for Time-sensitive Robotic Applications
TimelyLLM segments LLM-generated robot plans into executable pieces and schedules those pieces by urgency, reducing response delays for time-critical robot tasks.