Policy Search For Learning Robot Control Using Sparse Data

File Description SizeFormat 
paper.pdfAccepted version1.97 MBAdobe PDFDownload
Title: Policy Search For Learning Robot Control Using Sparse Data
Author(s): Bischoff, B
Nguyen-Tuong, D
van Hoof, H
McHutchon, A
Rasmussen, CE
Knoll, A
Peters, J
Deisenroth, MP
Item Type: Conference Paper
Abstract: © 2014 IEEE.In many complex robot applications, such as grasping and manipulation, it is difficult to program desired task solutions beforehand, as robots are within an uncertain and dynamic environment. In such cases, learning tasks from experience can be a useful alternative. To obtain a sound learning and generalization performance, machine learning, especially, reinforcement learning, usually requires sufficient data. However, in cases where only little data is available for learning, due to system constraints and practical issues, reinforcement learning can act suboptimally. In this paper, we investigate how model-based reinforcement learning, in particular the probabilistic inference for learning control method (Pilco), can be tailored to cope with the case of sparse data to speed up learning. The basic idea is to include further prior knowledge into the learning process. As Pilco is built on the probabilistic Gaussian processes framework, additional system knowledge can be incorporated by defining appropriate prior distributions, e.g. A linear mean Gaussian prior. The resulting Pilco formulation remains in closed form and analytically tractable. The proposed approach is evaluated in simulation as well as on a physical robot, the Festo Robotino XT. For the robot evaluation, we employ the approach for learning an object pick-up task. The results show that by including prior knowledge, policy learning can be sped up in presence of sparse data.
Publication Date: 1-Jun-2014
URI: http://hdl.handle.net/10044/1/12813
Copyright Statement: © 2014 IEEE
Conference Name: 2014 IEEE International Conference on Robotics and Automation (ICRA 2014)
Conference Location: Hong Kong, China
Publication Status: Accepted
Start Date: 2014-05-31
Finish Date: 2014-06-07
Conference Place: Hong Kong, China
Appears in Collections:Computing



Items in Spiral are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons