MEAD: model-based vertical auto-scaling for data stream processing
File(s)mead-ccgrid.pdf (925.51 KB)
Accepted version
Author(s)
Russo Russo, G
Cardellini, V
Casale, Giuliano
Lo Presti, F
Type
Conference Paper
Abstract
The unpredictable variability of Data Stream Pro-cessing (DSP) application workloads calls for advanced mechanisms and policies for elastically scaling the processing capacity of DSP operators. Whilst many different approaches have been used to devise policies, most of the solutions have focused on data arrival rate and operator resource utilization as key metrics for auto-scaling. We here show that, under burstiness in the dataflows, overly simple characterizations of the input stream can yet lead to very inaccurate performance estimations that affect such policies, resulting in sub-optimal resource allocation. We then present MEAD, a vertical auto-scaling solution that relies on online state-based representation of burstiness to drive resource allocation. We use in particular Markovian Arrival Processes (MAPs), which are composable with analytical queueing models, allowing us to efficiently predict performance at run-time under burstiness. We integrate MEAD in Apache Flink, and evaluate its benefits over simpler yet popular auto-scaling solutions, using both synthetic and real-world workloads. Differently from existing approaches, MEAD satisfies response time requirements under burstiness, while saving up to 50%CPUresources with respect to a static allocation.
Date Issued
2021-08-02
Date Acceptance
2021-02-16
Citation
2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2021
Publisher
IEEE
Journal / Book Title
2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid)
Copyright Statement
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Sponsor
Commission of the European Communities
Grant Number
825040
Source
The 21st IEEE/ACM international Symposium on Cluster, Cloud and Internet Computing (CCGrid 2021)
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Computer Science, Theory & Methods
Computer Science
data stream processing
auto-scaling
workload characterization
Markovian Arrival Processes
Publication Status
Published
Start Date
2021-05-10
Finish Date
2021-05-13
Coverage Spatial
Melbourne, Victoria, Australia