A regularization framework for learning over multitask graphs
File(s)nassif2018regularization.pdf (726.38 KB)
Accepted version
Author(s)
Nassif, Roula
Vlaski, Stefan
Richard, Cedric
Sayed, Ali H
Type
Journal Article
Abstract
This letter proposes a general regularization framework for inference over multitask networks. The optimization approach relies on minimizing a global cost consisting of the aggregate sum of individual costs regularized by a term that allows to incorporate global information about the graph structure and the individual parameter vectors into the solution of the inference problem. An adaptive strategy, which responds to streaming data and employs stochastic approximations in place of actual gradient vectors, is devised and studied. Methods allowing the distributed implementation of the regularization step are also discussed. This letter shows how to blend real-time adaptation with graph filtering and a generalized regularization framework to result in a graph diffusion strategy for distributed learning over multitask networks.
Date Issued
2019-02
Date Acceptance
2018-12-19
Citation
IEEE Signal Processing Letters, 2019, 26 (2), pp.297-301
ISSN
1070-9908
Publisher
Institute of Electrical and Electronics Engineers
Start Page
297
End Page
301
Journal / Book Title
IEEE Signal Processing Letters
Volume
26
Issue
2
Copyright Statement
Copyright © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000455914600004&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Subjects
ADAPTATION
ALGORITHMS
CONSENSUS
distributed implementation
Engineering
Engineering, Electrical & Electronic
gradient noise
Multitask graphs
NETWORKS
Science & Technology
spectral based regularization
Technology
Publication Status
Published
Date Publish Online
2019-01-08