Distributed learning over networks under subspace constraints
File(s)asilomar2019.pdf (1.3 MB)
Accepted version
Author(s)
Nassif, Roula
Vlaski, Stefan
Sayed, Ali H
Type
Conference Paper
Abstract
This work presents and studies a distributed algorithm for solving optimization problems over networks where agents have individual costs to minimize subject to subspace constraints that require the minimizers across the network to lie in a low-dimensional subspace. The algorithm consists of two steps: i) a self-learning step where each agent minimizes its own cost using a stochastic gradient update; ii) and a social-learning step where each agent combines the updated estimates from its neighbors using the entries of a combination matrix that converges in the limit to the projection onto the low-dimensional subspace. We obtain analytical formulas that reveal how the step-size, data statistical properties, gradient noise, and subspace constraints influence the network mean-square-error performance. The results also show that in the small step-size regime, the iterates generated by the distributed algorithm achieve the centralized steady-state MSE performance. We provide simulations to illustrate the theoretical findings.
Editor(s)
Matthews, MB
Date Issued
2020-03-30
Date Acceptance
2019-11-01
Citation
2019 53rd Asilomar Conference on Signals, Systems, and Computers, 2020, pp.194-198
ISSN
1058-6393
Publisher
IEEE
Start Page
194
End Page
198
Journal / Book Title
2019 53rd Asilomar Conference on Signals, Systems, and Computers
Copyright Statement
Copyright © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000544249200039&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
53rd Asilomar Conference on Signals, Systems, and Computers (ACSSC)
Subjects
ADAPTATION
Computer Science
Computer Science, Information Systems
Engineering
Engineering, Electrical & Electronic
PROJECTION ALGORITHMS
Science & Technology
SENSOR NETWORKS
Technology
Telecommunications
Publication Status
Published
Start Date
2019-11-03
Finish Date
2019-11-06
Coverage Spatial
Pacific Grove, CA, USA