DPGA combines delayed gradient averaging with randomly sampled partial-gradient masks, and its CIFAR-10/100 experiments report much higher accuracy and lower communication than FedAvg, DGA, and LG-Fed.
Server Free Wireless Federated Learning: Architecture, Algorithm, and Analysis
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We demonstrate that merely analog transmissions and match filtering can realize the function of an edge server in federated learning (FL). Therefore, a network with massively distributed user equipments (UEs) can achieve large-scale FL without an edge server. We also develop a training algorithm that allows UEs to continuously perform local computing without being interrupted by the global parameter uploading, which exploits the full potential of UEs' processing power. We derive convergence rates for the proposed schemes to quantify their training efficiency. The analyses reveal that when the interference obeys a Gaussian distribution, the proposed algorithm retrieves the convergence rate of a server-based FL. But if the interference distribution is heavy-tailed, then the heavier the tail, the slower the algorithm converges. Nonetheless, the system run time can be largely reduced by enabling computation in parallel with communication, whereas the gain is particularly pronounced when communication latency is high. These findings are corroborated via excessive simulations.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2024 1verdicts
REJECT 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Delayed Random Partial Gradient Averaging for Federated Learning
DPGA combines delayed gradient averaging with randomly sampled partial-gradient masks, and its CIFAR-10/100 experiments report much higher accuracy and lower communication than FedAvg, DGA, and LG-Fed.