Online unsupervised learning of the 3D kinematic structure of arbitrary rigid bodies
Author(s)
Nunes, Urbano Miguel
Demiris, Yiannis
Type
Conference Paper
Abstract
This work addresses the problem of 3D kinematic structure learning of arbitrary articulated rigid bodies from RGB-D data sequences. Typically, this problem is addressed by offline methods that process a batch of frames, assuming that complete point trajectories are available. However, this approach is not feasible when considering scenarios that require continuity and fluidity, for instance, human-robot interaction. In contrast, we propose to tackle this problem in an online unsupervised fashion, by recursively maintaining the metric distance of the scene's 3D structure, while achieving real-time performance. The influence of noise is mitigated by building a similarity measure based on a linear embedding representation and incorporating this representation into the original metric distance. The kinematic structure is then estimated based on a combination of implicit motion and spatial properties. The proposed approach achieves competitive performance both quantitatively and qualitatively in terms of estimation accuracy, even compared to offline methods.
Date Issued
2020-02-27
Date Acceptance
2019-07-22
Citation
2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2020, pp.3808-3816
ISSN
1550-5499
Publisher
IEEE Computer Soc
Start Page
3808
End Page
3816
Journal / Book Title
2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Copyright Statement
© 2019 IEEE. These ICCV 2019 papers are the Open Access versions, provided by the Computer Vision Foundation.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Royal Academy Of Engineering
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000531438103096&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
EP/S032398/1
CiET1718\46
Source
IEEE/CVF International Conference on Computer Vision (ICCV)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Engineering, Electrical & Electronic
Computer Science
Engineering
MOTION
SEGMENTATION
MODELS
SHAPE
Publication Status
Published
Start Date
2019-10-27
Finish Date
2019-11-02
Coverage Spatial
Seoul, SOUTH KOREA
Date Publish Online
2019-10-28