Dynamic scheduling for over-the-air federated edge learning with energy constraints
File(s)SZNG_JSAC21.pdf (4.02 MB)
Accepted version
Author(s)
Sun, Yuxuan
Zhou, Sheng
Niu, Zhisheng
Gunduz, Deniz
Type
Journal Article
Abstract
Machine learning and wireless communication technologies are jointly facilitating an intelligent edge, where federated edge learning (FEEL) is emerging as a promising training framework. As wireless devices involved in FEEL are resource limited in terms of communication bandwidth, computing power and battery capacity, it is important to carefully schedule them to optimize the training performance. In this work, we consider an over-the-air FEEL system with analog gradient aggregation, and propose an energy-aware dynamic device scheduling algorithm to optimize the training performance within the energy constraints of devices, where both communication energy for gradient aggregation and computation energy for local training are considered. The consideration of computation energy makes dynamic scheduling challenging, as devices are scheduled before local training, but the communication energy for over-the-air aggregation depends on the l2-norm of local gradient, which is known only after local training. We thus incorporate estimation methods into scheduling to predict the gradient norm. Taking the estimation error into account, we characterize the performance gap between the proposed algorithm and its offline counterpart. Experimental results show that, under a highly unbalanced local data distribution, the proposed algorithm can increase the accuracy by 4.9% on CIFAR-10 dataset compared with the myopic benchmark, while satisfying the energy constraints.
Date Issued
2021-11-13
Date Acceptance
2021-10-15
Citation
IEEE Journal on Selected Areas in Communications, 2021, 40 (1), pp.227-242
ISSN
0733-8716
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
227
End Page
242
Journal / Book Title
IEEE Journal on Selected Areas in Communications
Volume
40
Issue
1
Copyright Statement
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Commission of the European Communities
Engineering & Physical Science Research Council (EPSRC)
Identifier
https://ieeexplore.ieee.org/document/9605599
Grant Number
677854
EP/T023600/1
Subjects
Science & Technology
Technology
Engineering, Electrical & Electronic
Telecommunications
Engineering
Federated edge learning
over-the-air computation
energy constraints
dynamic scheduling
Lyapunov optimization
CONVERGENCE
OPTIMIZATION
CHALLENGES
ALLOCATION
NETWORKS
DESIGN
0805 Distributed Computing
0906 Electrical and Electronic Engineering
1005 Communications Technologies
Networking & Telecommunications
Publication Status
Published
Date Publish Online
2021-11-13