Federated Q-learning in heterogeneous environments achieves linear speedup in K agents for sampling error but is limited to Θ(E/T) convergence when averaging every E steps, with a two-phase error decay-then-rise behavior in experiments.
The blessing of heterogeneity in federated q-learning: Linear speedup and beyond
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2024 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
Federated Q-learning in heterogeneous environments achieves linear speedup in K agents for sampling error but is limited to Θ(E/T) convergence when averaging every E steps, with a two-phase error decay-then-rise behavior in experiments.