RLBench: The robot learning benchmark & learning environment
File(s)1909.12271.pdf (3.56 MB)
Accepted version
Author(s)
James, Stephen
Ma, Zicong
Arrojo, David Rovick
Davison, Andrew J
Type
Journal Article
Abstract
We present a challenging new benchmark and learning-environment for robot learning: RLBench. The benchmark features 100 completely unique, hand-designed tasks, ranging in difficulty from simple target reaching and door opening to longer multi-stage tasks, such as opening an oven and placing a tray in it. We provide an array of both proprioceptive observations and visual observations, which include rgb, depth, and segmentation masks from an over-the-shoulder stereo camera and an eye-in-hand monocular camera. Uniquely, each task comes with an infinite supply of demos through the use of motion planners operating on a series of waypoints given during task creation time; enabling an exciting flurry of demonstration-based learning possibilities. RLBench has been designed with scalability in mind; new tasks, along with their motion-planned demos, can be easily created and then verified by a series of tools, allowing users to submit their own tasks to the RLBench task repository. This large-scale benchmark aims to accelerate progress in a number of vision-guided manipulation research areas, including: reinforcement learning, imitation learning, multi-task learning, geometric computer vision, and in particular, few-shot learning. With the benchmark's breadth of tasks and demonstrations, we propose the first large-scale few-shot challenge in robotics. We hope that the scale and diversity of RLBench offers unparalleled research opportunities in the robot learning community and beyond. Benchmarking code and videos can be found at https://sites.google.com/view/rlbench .
Date Issued
2020-04
Date Acceptance
2020-01-27
Citation
IEEE Robotics and Automation Letters, 2020, 5 (2), pp.3019-3026
ISSN
2377-3766
Publisher
Institute of Electrical and Electronics Engineers
Start Page
3019
End Page
3026
Journal / Book Title
IEEE Robotics and Automation Letters
Volume
5
Issue
2
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Dyson Technology Limited
Dyson Technology Limited
Identifier
https://ieeexplore.ieee.org/document/9001253
Grant Number
PO 4500501004
PO4500503359
Subjects
0913 Mechanical Engineering
Publication Status
Published online
Date Publish Online
2020-02-18