A simulation-based search framework that automatically picks parallel training strategies for heterogeneous and dynamic-network GPU clusters, reporting simulated speedups up to 4.69x over Megatron.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DC 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Rethinking Dynamic Networks and Heterogeneous Computing with Automatic Parallelization
A simulation-based search framework that automatically picks parallel training strategies for heterogeneous and dynamic-network GPU clusters, reporting simulated speedups up to 4.69x over Megatron.