The GBMA algorithm lets distributed nodes transmit analog gradients over a fading multiple access channel without power control, and provably approaches centralized gradient descent convergence as the number of nodes grows.
Energy-Efficient Radio Resource Allocation for Federated Edge Learning
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Edge machine learning involves the development of learning algorithms at the network edge to leverage massive distributed data and computation resources. Among others, the framework of federated edge learning (FEEL) is particularly promising for its data-privacy preservation. FEEL coordinates global model training at a server and local model training at edge devices over wireless links. In this work, we explore the new direction of energy-efficient radio resource management (RRM) for FEEL. To reduce devices' energy consumption, we propose energy-efficient strategies for bandwidth allocation and scheduling. They adapt to devices' channel states and computation capacities so as to reduce their sum energy consumption while warranting learning performance. In contrast with the traditional rate-maximization designs, the derived optimal policies allocate more bandwidth to those scheduled devices with weaker channels or poorer computation capacities, which are the bottlenecks of synchronized model updates in FEEL. On the other hand, the scheduling priority function derived in closed form gives preferences to devices with better channels and computation capacities. Substantial energy reduction contributed by the proposed strategies is demonstrated in learning experiments.
fields
cs.LG 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
On Analog Gradient Descent Learning over Multiple Access Fading Channels
The GBMA algorithm lets distributed nodes transmit analog gradients over a fading multiple access channel without power control, and provably approaches centralized gradient descent convergence as the number of nodes grows.