Kubernetes with per-VNI Slingshot isolation is demonstrated on ARM64 Isambard-AI for a Trusted Research Environment and multi-node LLM serving, with ~0.9 us latency overhead.
Llama 3.1 405b now runs at 969 tokens/s on cerebras infer- ence, 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
baseline 1
citation-polarity summary
fields
cs.DC 1years
2026 1verdicts
CONDITIONAL 1roles
baseline 1polarities
baseline 1representative citing papers
citing papers explorer
-
Multi-tenant Kubernetes Use Cases for AI, Secure Computing and Data Services, and More
Kubernetes with per-VNI Slingshot isolation is demonstrated on ARM64 Isambard-AI for a Trusted Research Environment and multi-node LLM serving, with ~0.9 us latency overhead.