Resource management in distributed SDN using reinforcement learning

File Description SizeFormat 
106350M.pdfPublished version907.05 kBAdobe PDFView/Open
Title: Resource management in distributed SDN using reinforcement learning
Authors: Ma, L
Zhang, Z
Ko, B
Srivatsa, M
Leung, KK
Item Type: Conference Paper
Abstract: Distributed software-defined networking (SDN), which consists of multiple inter-connected network domains and each managed by one SDN controller, is an emerging networking architecture that offers balanced centralized/distributed control. Under such networking paradigm, resource management among various domains (e.g., optimal resource allocation) can be extremely challenging. This is because many tasks posted to the network require resources (e.g., CPU, memory, bandwidth, etc.) from different domains, where cross-domain resources are correlated, e.g., their feasibility depends on the existence of a reliable communication channel connecting them. To address this issue, we employ the reinforcement learning framework, targeting to automate this resource management and allocation process by proactive learning and interactions. Specifically, we model this issue as an MDP (Markov Decision Process) problem with different types of reward functions, where our objective is to minimize the average task completion time. Regarding this problem, we investigate the scenario where the resource status among controllers is fully synchronized. Under such scenario, the SDN controller has complete knowledge of the resource status of all domains, i.e., resource changes upon any policies are directly observable by controllers, for which Q-learning-based strategy is proposed to approach the optimal solution.
Editors: Kolodny, MA
Wiegmann, DM
Pham, T
Issue Date: 4-May-2018
Date of Acceptance: 15-Apr-2018
URI: http://hdl.handle.net/10044/1/69240
DOI: https://doi.org/10.1117/12.2306087
ISSN: 0277-786X
Publisher: Proceedings of SPIE
Journal / Book Title: Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX
Volume: 10635
Copyright Statement: © 2018 SPIE.
Sponsor/Funder: IBM United Kingdom Ltd
Funder's Grant Number: 4603317662
Conference Name: 9th Conference on Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR part of the SPIE Defense + Commercial Sensing Conference
Keywords: Science & Technology
Physical Sciences
Optics
Resource Management
SDN
Task Fragmentation
Reinforcement Learning
Q-learning
SOFTWARE-DEFINED NETWORKING
Publication Status: Published
Start Date: 2018-04-15
Finish Date: 2018-04-19
Conference Place: Orlando, FL
Online Publication Date: 2018-05-04
Appears in Collections:Computing
Electrical and Electronic Engineering



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx