A routing framework for distributed edge MoE inference that co-optimizes expert placement, GPU/CPU residency, quantization precision, and per-token set-level routing, reporting large latency and throughput gains in simulation.
A Survey on Large Language Model Based Autonomous Agents,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.NI 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference
A routing framework for distributed edge MoE inference that co-optimizes expert placement, GPU/CPU residency, quantization precision, and per-token set-level routing, reporting large latency and throughput gains in simulation.