When edge meets learning: adaptive control for resource-constrained distributed machine learning

File Description SizeFormat 
Infocom_2018_distributed_ML.pdfFile embargoed until 01 January 10000661.73 kBAdobe PDF    Request a copy
Title: When edge meets learning: adaptive control for resource-constrained distributed machine learning
Authors: Leung, KK
Wang, S
Tuor, T
Salonidis, T
Makaya, C
He, T
Chan, K
Item Type: Conference Paper
Abstract: Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient- descent based approaches. We analyze the convergence rate of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best trade-off between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.
Issue Date: 16-Apr-2018
Date of Acceptance: 27-Nov-2017
URI: http://hdl.handle.net/10044/1/58765
Publisher: IEEE
Journal / Book Title: Proceeedings of IEEE Infocom 2018
Copyright Statement: This paper is embargoed until publication.
Sponsor/Funder: IBM United Kingdom Ltd
Funder's Grant Number: 4603317662
Conference Name: IEEE Infocom 2018
Publication Status: Accepted
Start Date: 2018-04-16
Finish Date: 2018-04-19
Conference Place: Hawaii, USA
Embargo Date: publication subject to indefinite embargo
Appears in Collections:Faculty of Engineering
Electrical and Electronic Engineering

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx