Distributed optimization framework for in-network data processing
File(s)
Author(s)
Leung, Kin
Nazemi, Sepideh
Swami, Ananthram
Type
Journal Article
Abstract
In-Network Processing (INP) is an effective way to aggregate and process data from different sources and forward the aggregated data to other nodes for further processing until it reaches the end user. There is a trade-off between energy consumption for processing data and communication energy spent on transferring the data. Specifically, aggressive data aggregation consumes much energy for processing, but results in less data for transmission, thus using less energy for communications, and
vice versa. An essential requirement in the INP process is to ensure that the user expectation of quality of information (QoI) is delivered during the process. Using wireless sensor networks for illustration and with the aim of minimising the total energy consumption of the system, we study and formulate the trade-off problem as a nonlinear optimisation problem where the goal is to determine the optimal data reduction rate, while satisfying the QoI required by the user. The formulated problem is a Signomial Programming (SP) problem, which is a non-convex optimisation
problem and very hard to be solved directly. We propose two solution frameworks. First, we introduce an equivalent problem which is still SP and non-convex as the original one, but we prove that the strong duality property holds, and propose an efficient distributed algorithm to obtain the optimal data reduction rates, while delivering the required QoI. The second framework applies to the system with identical nodes and parameter settings. In such cases, we prove that the complexity of the problem can be reduced logarithmically. We evaluate our proposed frameworks under different parameter settings and illustrate the validity and performance of the proposed techniques through extensive simulation.
vice versa. An essential requirement in the INP process is to ensure that the user expectation of quality of information (QoI) is delivered during the process. Using wireless sensor networks for illustration and with the aim of minimising the total energy consumption of the system, we study and formulate the trade-off problem as a nonlinear optimisation problem where the goal is to determine the optimal data reduction rate, while satisfying the QoI required by the user. The formulated problem is a Signomial Programming (SP) problem, which is a non-convex optimisation
problem and very hard to be solved directly. We propose two solution frameworks. First, we introduce an equivalent problem which is still SP and non-convex as the original one, but we prove that the strong duality property holds, and propose an efficient distributed algorithm to obtain the optimal data reduction rates, while delivering the required QoI. The second framework applies to the system with identical nodes and parameter settings. In such cases, we prove that the complexity of the problem can be reduced logarithmically. We evaluate our proposed frameworks under different parameter settings and illustrate the validity and performance of the proposed techniques through extensive simulation.
Date Issued
2019-12-05
Date Acceptance
2019-10-19
Citation
IEEE ACM Transactions on Networking, 2019, 27 (6), pp.2432-2443
ISSN
1063-6692
Publisher
Association for Computing Machinery (ACM)
Start Page
2432
End Page
2443
Journal / Book Title
IEEE ACM Transactions on Networking
Volume
27
Issue
6
Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
IBM United Kingdom Ltd
Identifier
https://ieeexplore.ieee.org/document/8924930
Grant Number
4603317662
Subjects
Science & Technology
Technology
Computer Science, Hardware & Architecture
Computer Science, Theory & Methods
Engineering, Electrical & Electronic
Telecommunications
Computer Science
Engineering
Optimization
Data aggregation
Energy consumption
Wireless sensor networks
Distributed databases
Cloud computing
In-network processing
quality of information
data aggregation
distributed optimization
non-convex optimization
data reduction rate
trade-off
energy efficiency
Networking & Telecommunications
0805 Distributed Computing
0906 Electrical and Electronic Engineering
1005 Communications Technologies
Publication Status
Published
Date Publish Online
2019-12-05