A new testbed for MoE models uses domain-based ideal routing as benchmark to quantify expert specialization and compare routing methods at small scale.
From a throughput perspective, perfect balance at every micro-batch is strictly optimal
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale
A new testbed for MoE models uses domain-based ideal routing as benchmark to quantify expert specialization and compare routing methods at small scale.