Designing parallel data processing for large-scale sensor orchestration
Author(s)
Kabac, M
Consel, C
Type
Conference Paper
Abstract
Masses of sensors are being deployed at the scale of cities to manage parking spaces, transportation infrastructures to monitor traffic,, campuses of buildings to reduce energy consumption. These large-scale infrastructures become a reality for citizens via applications that orchestrate sensors to deliver high-value, innovative services. These applications critically rely on the processing of large amounts of data to analyze situations, inform users,, control devices. This paper proposes a design-driven approach to developing orchestrating applications for masses of sensors that integrates parallel processing of large amounts of data. Specifically, an application design exposes declarations that are used to generate a programming framework based on the MapReduce programming model. We have developed a prototype of our approach, using Apache Hadoop. We applied it to a case study, obtained significant speedups by parallelizing computations over twelve nodes. In doing so, we demonstrate that our design-driven approach allows to abstract over implementation details, while exposing architectural properties used to generate high-performance code for processing large datasets.
Editor(s)
ElBaz, D
Bourgeois, J
Date Issued
2017-01-16
Date Acceptance
2016-07-18
Citation
Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld), 2016 Intl IEEE Conferences, 2017, pp.57-65
Publisher
IEEE
Start Page
57
End Page
65
Journal / Book Title
Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld), 2016 Intl IEEE Conferences
Copyright Statement
© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000393306500008&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Source
13th IEEE Int Conf on Ubiquitous Intelligence and Comp/13th IEEE Int Conf on Adv and Trusted Comp/16th IEEE Int Conf on Scalable Comp and Commun/IEEE Int Conf on Cloud and Big Data Comp/IEEE Int Conf on Internet of People/IEEE Smart World Congress
Subjects
Science & Technology
Technology
Computer Science, Interdisciplinary Applications
Computer Science
MAPREDUCE
Publication Status
Published
Start Date
2016-07-18
Finish Date
2016-07-21
Coverage Spatial
Toulouse, FRANCE
OA Location
https://hal.inria.fr/hal-01319730