COCOA: cold start aware capacity planning for function-as-a-service platforms
File(s)cocoa-submitted.pdf (513.9 KB)
Submitted version
Author(s)
Gias, Alim
Casale, Giuliano
Type
Conference Paper
Abstract
Function-as-a-Service (FaaS) is increasingly popularin the software industry due to the implied cost-savings in event-driven workloads and its synergy with DevOps. To size an on-premise FaaS platform, it is important to estimate the requiredCPU and memory capacity to serve the expected loads. Giventhe service-level agreements, it is however challenging to takethe cold start issue into account during the sizing process. Wehave investigated the similarity of this problem with the hitrate improvement problem in TTL caches and concluded thatsolutions for TTL cache, although potentially applicable, lead toover-provisioning in FaaS. Thus, we propose a novel approach,COCOA, to solve this issue. COCOA uses a queueing-basedapproach to assess the effect of cold starts on FaaS responsetimes. It also considers different memory consumption valuesdepending on whether the function is idle or in execution. Usingan event-driven FaaS simulator,FaasSim, we have developed, weshow that COCOA can reduce over-provisioning by over 70% insome workloads, while satisfying the service-level agreements.
Date Issued
2020-12-21
Date Acceptance
2020-09-04
Citation
2020, pp.1-8
Publisher
IEEE
Start Page
1
End Page
8
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Commission of the European Communities
Identifier
https://ieeexplore.ieee.org/abstract/document/9285966
Grant Number
825040
Source
IEEE MASCOTS 2020
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Engineering, Electrical & Electronic
Telecommunications
Computer Science
Engineering
Function-as-a-service
serverless computing
cold start
sizing
layered queueing network
Publication Status
Published
Start Date
2020-11-17
Finish Date
2020-11-19
Coverage Spatial
Nice, France
Date Publish Online
2020-12-21