Transferring visuomotor learning from simulation to the real world for robotics manipulation tasks
File(s)iros2018-learning-visual-stamped.pdf (4.15 MB)
Accepted version
Author(s)
Type
Conference Paper
Abstract
Hand-eye coordination is a requirement for many manipulation tasks including grasping and reaching. However, accurate hand-eye coordination has shown to be especially difficult to achieve in complex robots like the iCub humanoid. In this work, we solve the hand-eye coordination task using a visuomotor deep neural network predictor that estimates the arm's joint configuration given a stereo image pair of the arm and the underlying head configuration. As there are various unavoidable sources of sensing error on the physical robot, we train the predictor on images obtained from simulation. The images from simulation were modified to look realistic using an image-to-image translation approach. In various experiments, we first show that the visuomotor predictor provides accurate joint estimates of the iCub's hand in simulation. We then show that the predictor can be used to obtain the systematic error of the robot's joint measurements on the physical iCub robot. We demonstrate that a calibrator can be designed to automatically compensate this error. Finally, we validate that this enables accurate reaching of objects while circumventing manual fine-calibration of the robot.
Date Issued
2018-10-05
Date Acceptance
2018-06-29
Citation
2018, pp.6667-6674
ISBN
9781538680940
ISSN
2153-0866
Publisher
IEEE
Start Page
6667
End Page
6674
Copyright Statement
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
IEEE/RSJ International Conference on Intelligent Robots and Systems
Publication Status
Published
Start Date
2018-10-01
Finish Date
2018-10-05
Coverage Spatial
Madrid, Spain
Date Publish Online
2019-01-07