ATOM: model-driven autoscaling for microservices
File(s)ICDCS_ATOM.pdf (452.77 KB)
Accepted version
Author(s)
Gias, Alim
Casale, Giuliano
Woodside, Murray
Type
Conference Paper
Abstract
Microservices based architectures are increasinglywidespread in the cloud software industry. Still, there is ashortage of auto-scaling methods designed to leverage the uniquefeatures of these architectures, such as the ability to indepen-dently scale a subset of microservices, as well as the ease ofmonitoring their state and reciprocal calls.We propose to address this shortage with ATOM, a model-driven autoscaling controller for microservices. ATOM instanti-ates and solves at run-time a layered queueing network model ofthe application. Computational optimization is used to dynami-cally control the number of replicas for each microservice and itsassociated container CPU share, overall achieving a fine-grainedcontrol of the application capacity at run-time.Experimental results indicate that for heavy workloads ATOMoffers around 30%-37% higher throughput than baseline model-agnostic controllers based on simple static rules. We also find thatmodel-driven reasoning reduces the number of actions needed toscale the system as it reduces the number of bottleneck shiftsthat we observe with model-agnostic controllers.
Date Issued
2019-10-31
Date Acceptance
2019-03-29
Citation
2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), 2019, pp.1994-2004
ISBN
9781728125190
ISSN
2575-8411
Publisher
IEEE
Start Page
1994
End Page
2004
Journal / Book Title
2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS)
Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
European Commission
Grant Number
825040
Source
IEEE International Conference on Distributed Computing Systems (ICDCS)
Subjects
Science & Technology
Technology
Computer Science, Hardware & Architecture
Computer Science, Information Systems
Computer Science, Software Engineering
Computer Science, Theory & Methods
Computer Science
microservices
autoscaling
layered queueing network
performance optimization
PERFORMANCE
SYSTEMS
Publication Status
Published
Start Date
2019-07-07
Finish Date
2019-07-10
Coverage Spatial
Dallas, Texas, USA
Date Publish Online
2019-10-31