A co-designed edge accelerator that avoids loading redundant expert weights when speculative decoding meets mixture-of-experts, cutting latency by up to 56.3% and energy by up to 44.1% in simulation.
SMoLPU: 122.1µJ/Token Sparse MoE- Based Speculative Decoding Language Processing Unit with Adaptive- Offload NPU-CIM Core,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.AR 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
EdgeXpert: An Edge Device for Memory-Efficient LLM Inference with Mixture-of-Experts and Speculative Decoding
A co-designed edge accelerator that avoids loading redundant expert weights when speculative decoding meets mixture-of-experts, cutting latency by up to 56.3% and energy by up to 44.1% in simulation.