Robot Motor Skill Coordination with EM-based Reinforcement Learning
File(s)Kormushev-IROS2010.pdf (1.5 MB)
Accepted version
Author(s)
Kormushev, Petar
Calinon, S
Caldwell, DG
Type
Conference Paper
Abstract
We present an approach allowing a robot to acquire new motor skills by learning the couplings across motor control variables. The demonstrated skill is first encoded in a compact form through a modified version of Dynamic Movement Primitives (DMP) which encapsulates correlation information. Expectation-Maximization based Reinforcement Learning is then used to modulate the mixture of dynamical systems initialized from the users demonstration. The approach is evaluated on a torque-controlled 7 DOFs Barrett WAM robotic arm. Two skill learning experiments are conducted: a reaching task where the robot needs to adapt the learned movement to avoid an obstacle, and a dynamic pancake-flipping task. ©2010 IEEE.
Date Issued
2010-10
Date Acceptance
2010-10-18
Citation
Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS), 2010, pp.3232-3237
ISBN
978-1-4244-6674-0
ISSN
2153-0858
Publisher
IEEE
Start Page
3232
End Page
3237
Journal / Book Title
Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS)
Copyright Statement
© 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Publication Status
Published
Start Date
2010-10-18
Finish Date
2010-10-22
Coverage Spatial
Taipei