Learning kinematic structure correspondences using multi-order similarities
File(s)tpami-learning-kinematic-stamped.pdf (4.29 MB)
Accepted version
Author(s)
Chang, HJ
Fischer, T
Petit, M
Zambelli, M
Demiris, Y
Type
Journal Article
Abstract
We present a novel framework for finding the kinematic structure correspondences between two articulated objects in videos via hypergraph matching. In contrast to appearance and graph alignment based matching methods, which have been applied among two similar static images, the proposed method finds correspondences between two dynamic kinematic structures of heterogeneous objects in videos. Thus our method allows matching the structure of objects which have similar topologies or motions, or a combination of the two. Our main contributions are summarised as follows: (i)casting the kinematic structure correspondence problem into a hypergraph matching problem by incorporating multi-order similarities with normalising weights, (ii)introducing a structural topology similarity measure by aggregating topology constrained subgraph isomorphisms, (iii)measuring kinematic correlations between pairwise nodes, and (iv)proposing a combinatorial local motion similarity measure using geodesic distance on the Riemannian manifold. We demonstrate the robustness and accuracy of our method through a number of experiments on synthetic and real data, showing that various other recent and state of the art methods are outperformed. Our method is not limited to a specific application nor sensor, and can be used as building block in applications such as action recognition, human motion retargeting to robots, and articulated object manipulation.
Date Issued
2018-12-01
Date Acceptance
2017-11-04
Citation
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40 (12), pp.2920-2934
ISSN
0162-8828
Publisher
Institute of Electrical and Electronics Engineers
Start Page
2920
End Page
2934
Journal / Book Title
IEEE Transactions on Pattern Analysis and Machine Intelligence
Volume
40
Issue
12
Copyright Statement
© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Commission of the European Communities
Identifier
http://ieeexplore.ieee.org/document/8119820
Grant Number
612139
Subjects
Articulated kinematic structure correspondences
hypergraph matching
subgraph isomorphism aggregation
kinematic correlation
combinatorial local motion similarity
humanoid robots
Publication Status
Published
Date Publish Online
2017-11-24