Finite bit quantization for decentralized learning under subspace constraints
File(s)EUSIPCO2022.pdf (538.37 KB)
Accepted version
Author(s)
Type
Conference Paper
Abstract
In this paper, we consider decentralized optimization problems where agents have individual cost functions to mini-mize subject to subspace constraints that require the min-imizers across the network to lie in low-dimensional sub-spaces. This constrained formulation includes consensus optimization as special case, and allows for more general task relatedness models such as multitask smoothness and coupled optimization. In order to cope with communication constraints, we propose and study a quantized differential based approach where the communicated estimates among agents are quantized. The analysis shows that, under some general conditions on the quantization noise, and for sufficiently small step-sizes µ, the strategy is stable in the mean-square error sense. The analysis also reveals the influence of the gradient and quantization noises on the performance.
Date Issued
2022-10-18
Date Acceptance
2022-08-01
Citation
2022 30th European Signal Processing Conference (EUSIPCO), 2022, pp.1851-1855
ISSN
2076-1465
Publisher
IEEE
Start Page
1851
End Page
1855
Journal / Book Title
2022 30th European Signal Processing Conference (EUSIPCO)
Copyright Statement
Copyright © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000918827600363&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
30th European Signal Processing Conference (EUSIPCO)
Subjects
Acoustics
ADAPTATION
Computer Science
Computer Science, Software Engineering
Decentralized stochastic optimization
DISTRIBUTED SUBGRADIENT METHODS
Engineering
Engineering, Electrical & Electronic
Imaging Science & Photographic Technology
NETWORKS
quantization effects
Science & Technology
subspace projection
Technology
Telecommunications
Publication Status
Published
Start Date
2022-08-29
Finish Date
2022-09-02
Coverage Spatial
Belgrade, Serbia