Customisable Control Policy Learning for Robotics
File(s)PID5964581.pdf (743.66 KB)
Accepted version
Author(s)
Guo, Ce
Luk, Wayne
Warren, Alexander
Loh, Qing Shui
Levine, Joshua
Type
Conference Paper
Abstract
Deep reinforcement learning algorithms integratedeep neural networks with traditional reinforcement learningmethodologies. These techniques have been developed and usedfor various applications to produce exciting results in manyfields, including robotics. However, physical robots require alarge amount of training episodes which can damage the robotif directed by immature policies. Training using simulations canserve as a viable alternative before a robot is deployed in thefield. This study addresses a computational challenge of deepreinforcement learning by developing a hardware architecturefor the Deep Deterministic Policy Gradient (DDPG) algorithm.Additionally, we identify the customisation opportunities for afull-stack development framework with reinforcement learningto discover control policies for robotic arms. Finally, we transferpolicies encoded in fixed-point numbers from our FPGA DDPGimplementation to a robotic arm to evaluate the feasibility of ourlearning platform.
Date Issued
2019-09-05
Date Acceptance
2019-05-11
Citation
2019 IEEE 30th International Conference on Application-specific Systems, Architectures and Processors (ASAP), 2019
Publisher
IEEE
Journal / Book Title
2019 IEEE 30th International Conference on Application-specific Systems, Architectures and Processors (ASAP)
Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
Engineering & Physical Science Research Council (EPSRC)
Grant Number
516075101 (EP/N031768/1)
EP/P010040/1
Source
The 30th IEEE International Conference on Application-Specific Systems, Architectures and Processors
Publication Status
Published
Start Date
2019-07-15
Finish Date
2019-07-17
Coverage Spatial
New York, USA