MetaNet: automated dynamic selection of scheduling policies in cloud environments
File(s)2205.10642v1.pdf (1000.88 KB)
Accepted version
Author(s)
Tuli, Shreshth
Casale, Giuliano
Jennings, Nicholas R
Type
Conference Paper
Abstract
Task scheduling is a well-studied problem in the context of optimizing the
Quality of Service (QoS) of cloud computing environments. In order to sustain
the rapid growth of computational demands, one of the most important QoS
metrics for cloud schedulers is the execution cost. In this regard, several
data-driven deep neural networks (DNNs) based schedulers have been proposed in
recent years to allow scalable and efficient resource management in dynamic
workload settings. However, optimal scheduling frequently relies on
sophisticated DNNs with high computational needs implying higher execution
costs. Further, even in non-stationary environments, sophisticated schedulers
might not always be required and we could briefly rely on low-cost schedulers
in the interest of cost-efficiency. Therefore, this work aims to solve the
non-trivial meta problem of online dynamic selection of a scheduling policy
using a surrogate model called MetaNet. Unlike traditional solutions with a
fixed scheduling policy, MetaNet on-the-fly chooses a scheduler from a large
set of DNN based methods to optimize task scheduling and execution costs in
tandem. Compared to state-of-the-art DNN schedulers, this allows for
improvement in execution costs, energy consumption, response time and service
level agreement violations by up to 11, 43, 8 and 13 percent, respectively.
Quality of Service (QoS) of cloud computing environments. In order to sustain
the rapid growth of computational demands, one of the most important QoS
metrics for cloud schedulers is the execution cost. In this regard, several
data-driven deep neural networks (DNNs) based schedulers have been proposed in
recent years to allow scalable and efficient resource management in dynamic
workload settings. However, optimal scheduling frequently relies on
sophisticated DNNs with high computational needs implying higher execution
costs. Further, even in non-stationary environments, sophisticated schedulers
might not always be required and we could briefly rely on low-cost schedulers
in the interest of cost-efficiency. Therefore, this work aims to solve the
non-trivial meta problem of online dynamic selection of a scheduling policy
using a surrogate model called MetaNet. Unlike traditional solutions with a
fixed scheduling policy, MetaNet on-the-fly chooses a scheduler from a large
set of DNN based methods to optimize task scheduling and execution costs in
tandem. Compared to state-of-the-art DNN schedulers, this allows for
improvement in execution costs, energy consumption, response time and service
level agreement violations by up to 11, 43, 8 and 13 percent, respectively.
Date Issued
2022-08-24
Date Acceptance
2022-05-19
Citation
IEEE International Conference on Cloud Computing, CLOUD, 2022, pp.331-341
ISSN
2159-6182
Publisher
IEEE
Start Page
331
End Page
341
Journal / Book Title
IEEE International Conference on Cloud Computing, CLOUD
Copyright Statement
Copyright © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://arxiv.org/abs/2205.10642v1
Source
2022 IEEE 15th International Conference on Cloud Computing (CLOUD)
Subjects
cs.DC
cs.DC
cs.AI
Notes
Accepted in IEEE CLOUD 2022
Publication Status
Published
Start Date
2022-07-10
Finish Date
2022-07-16
Coverage Spatial
Barcelona, Spain
Date Publish Online
2022-08-24