DQ Scheuler: deep reinforcement learning based controller synchronization in distributed SDN

File Description SizeFormat 
ICC-2019-DB-SDN-controller-Spike.pdfFile embargoed until 01 January 10000524.76 kBAdobe PDF    Request a copy
Title: DQ Scheuler: deep reinforcement learning based controller synchronization in distributed SDN
Authors: Zhang, Z
Ma, L
Poularakis, K
Leung, K
Wu, L
Item Type: Conference Paper
Abstract: In distributed software-defined networks (SDN), mul-tiple physical SDN controllers, each managing a networkdomain,are implemented to balance centralized control, scalability andreliability requirements. In such networking paradigm, controllerssynchronize with each other to maintain a logically centralizednetwork view. Despite various proposals of distributed SDNcontroller architectures, most existing works only assume thatsuch logically centralized network viewcanbe achieved withsome synchronization designs, but the question ofhowexactlycontrollers should synchronize with each other to maximizethe benefits of synchronization under the eventual consistencyassumptions is largely overlooked. To this end, we formulatethe controller synchronization problem as aMarkov DecisionProcess (MDP)and apply reinforcement learning techniquescombined with deep neural network to train asmartcontrollersynchronization policy, which we call theDeep-Q (DQ) Scheduler.Evaluation results show that DQ Scheduler outperforms the anti-entropy algorithm implemented in the ONOS controller by up to95.2%for inter-domain routing tasks.
Issue Date: 20-May-2019
Date of Acceptance: 31-Jan-2019
URI: http://hdl.handle.net/10044/1/69935
ISSN: 0536-1486
Publisher: Institute of Electrical and Electronics Engineers
Journal / Book Title: IEEE International Conference on Communications
Copyright Statement: This paper is embargoed until publication.
Sponsor/Funder: IBM United Kingdom Ltd
Funder's Grant Number: 4603317662
Conference Name: IEEE ICC 2019
Publication Status: Accepted
Start Date: 2019-05-20
Finish Date: 2019-05-24
Conference Place: Shanghai, China
Embargo Date: publication subject to indefinite embargo
Appears in Collections:Computing
Electrical and Electronic Engineering

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx