Frontier: Resilient Edge Processing for the Internet of Things
File(s)vldb18-frontier.pdf (1.54 MB)
Accepted version
Author(s)
O'Keeffe, Dan
Salonidis, Theodoros
Pietzuch, PR
Type
Conference Paper
Abstract
In an edge deployment model, Internet-of-Things (IoT) applications, e.g. for building automation or video surveillance, must process data locally on IoT devices without relying on permanent connectivity to a cloud backend. The ability to harness the combined resources of multiple IoT devices for computation is influenced by the quality of wireless network connectivity. An open challenge is how practical edge-based IoT applications can be realised that are robust to changes in network bandwidth between IoT devices, due to interference and intermittent connectivity.
We present Frontier, a distributed and resilient edge processing platform for IoT devices. The key idea is to express data-intensive IoT applications as continuous data-parallel streaming queries and to improve query throughput in an unreliable wireless network by exploiting network path diversity: a query includes operator replicas at different IoT nodes, which increases possible network paths for data. Frontier dynamically routes stream data to operator replicas based on network path conditions. Nodes probe path throughput and use backpressure stream routing to decide on transmission rates, while exploiting multiple operator replicas for data-parallelism. If a node loses network connectivity, a transient disconnection recovery mechanism reprocesses the lost data. Our experimental evaluation of Frontier shows that network path diversity improves throughput by 1.3×−2.8×for different IoT applications, while being resilient to intermittent network connectivity.
We present Frontier, a distributed and resilient edge processing platform for IoT devices. The key idea is to express data-intensive IoT applications as continuous data-parallel streaming queries and to improve query throughput in an unreliable wireless network by exploiting network path diversity: a query includes operator replicas at different IoT nodes, which increases possible network paths for data. Frontier dynamically routes stream data to operator replicas based on network path conditions. Nodes probe path throughput and use backpressure stream routing to decide on transmission rates, while exploiting multiple operator replicas for data-parallelism. If a node loses network connectivity, a transient disconnection recovery mechanism reprocesses the lost data. Our experimental evaluation of Frontier shows that network path diversity improves throughput by 1.3×−2.8×for different IoT applications, while being resilient to intermittent network connectivity.
Date Issued
2018-06-30
Date Acceptance
2018-06-29
Citation
Proceedings of the VLDB Endowment, 2018, 11 (10), pp.1178-1191
ISSN
2150-8097
Publisher
ACM
Start Page
1178
End Page
1191
Journal / Book Title
Proceedings of the VLDB Endowment
Volume
11
Issue
10
Copyright Statement
© 2018 VLDB Endowment.
Sponsor
IBM United Kingdom Ltd
IBM United Kingdom Ltd
Grant Number
PO 4602911792
PO4603106973
Source
Very Large Databases (VLDB)
Publication Status
Published
Start Date
2018-08-27
Finish Date
2018-08-31
Coverage Spatial
Rio de Janeiro, Brazil