Learning Dynamical Representations of Tools for Tool-Use Recognition
File(s)robio2011.pdf (2.53 MB)
Accepted version
Author(s)
Wu, Yan
Demiris, Yiannis
Type
Conference Paper
Abstract
We consider the problem of representing and recognising tools, a subset of objects that have special functionality and action patterns. Our proposed framework is based on the biological evidence of hierarchical representation of tools in the region of the human cortex that generates action semantics. It addresses the shortfalls of traditional learning models of object representation applied on tools. To showcase its merits, this framework is implemented as a hybrid model between the Hierarchical Attentive Multiple Models for Execution and Recognition of Actions Architecture (HAMMER) and Hidden Markov Model (HMM) to recognise and describe tools as dynamic patterns at symbolic level. The implemented model is tested and validated on two sets of experiments of 50 human demonstrations each on using 5 different tools. In the experiment with precise and accurate input data, the cross-validation statistics suggest very robust identification of the learned tools. In the experiment with unstructured environment, all errors can be explained systematically.
Date Issued
2011-12
Citation
2011, pp.2664-2669
ISBN
978-1-4577-2136-6
Publisher
IEEE
Start Page
2664
End Page
2669
Copyright Statement
© 2011 IEEE. . Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Description
16/01/14 MEB. Pre-print version, OK to pub.
Source
International Conference on Robotics and Biomimetics (ROBIO)
Source Place
Phuket, Thailand.
Publication Status
Published
Start Date
2011-12-07
Finish Date
2011-12-11
Coverage Spatial
Phuket, Thailand.