M4Fuse introduces a lightweight state-space MoE architecture with cross-scale dual-stage gating that reduces parameters by 62.63% and improves average performance by 0.09% on BraTS2019 and BraTS2021 even at half the usual input resolution.
Mpmoe: Memory efficient moe for pre-trained models with adaptive pipeline parallelism.IEEE Transactions on Parallel and Distributed Systems, 35(6):998–1011, 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
M\textsuperscript{4}Fuse: Lightweight State-Space MoE with a Cross-Scale Gating Bridge for Brain Tumor Segmentation
M4Fuse introduces a lightweight state-space MoE architecture with cross-scale dual-stage gating that reduces parameters by 62.63% and improves average performance by 0.09% on BraTS2019 and BraTS2021 even at half the usual input resolution.