Repository logo
  • Log In
    Log in via Symplectic to deposit your publication(s).
Repository logo
  • About
  • Communities & Collections
  • Advanced Search
  • Statistics
  • Log In
    Log in via Symplectic to deposit your publication(s).
  1. Home
  2. Faculty of Engineering
  3. Faculty of Engineering
  4. A multimodal intention detection sensor suite for shared autonomy of upper-limb robotic prostheses
 
  • Details
A multimodal intention detection sensor suite for shared autonomy of upper-limb robotic prostheses
File(s)
sensors-20-06097.pdf (2.92 MB)
Published version
Author(s)
Gardner, Marcus
Mancero Castillo, Carlos
Wilson, Samuel
Farina, Dario
Burdet, Etienne
more
Type
Journal Article
Abstract
Neurorobotic augmentation (e.g., robotic assist) is now in regular use to support individuals suffering from impaired motor functions. A major unresolved challenge, however, is the excessive cognitive load necessary for the human–machine interface (HMI). Grasp control remains one of the most challenging HMI tasks, demanding simultaneous, agile, and precise control of multiple degrees-of-freedom (DoFs) while following a specific timing pattern in the joint and human–robot task spaces. Most commercially available systems use either an indirect mode-switching configuration or a limited sequential control strategy, limiting activation to one DoF at a time. To address this challenge, we introduce a shared autonomy framework centred around a low-cost multi-modal sensor suite fusing: (a) mechanomyography (MMG) to estimate the intended muscle activation, (b) camera-based visual information for integrated autonomous object recognition, and (c) inertial measurement to enhance intention prediction based on the grasping trajectory. The complete system predicts user intent for grasp based on measured dynamical features during natural motions. A total of 84 motion features were extracted from the sensor suite, and tests were conducted on 10 able-bodied and 1 amputee participants for grasping common household objects with a robotic hand. Real-time grasp classification accuracy using visual and motion features obtained 100%, 82.5%, and 88.9% across all participants for detecting and executing grasping actions for a bottle, lid, and box, respectively. The proposed multimodal sensor suite is a novel approach for predicting different grasp strategies and automating task performance using a commercial upper-limb prosthetic device. The system also shows potential to improve the usability of modern neurorobotic systems due to the intuitive control design.
Date Issued
2020-10-27
Date Acceptance
2020-10-23
Citation
Sensors, 2020, 20 (21)
URI
http://hdl.handle.net/10044/1/85026
DOI
https://www.dx.doi.org/10.3390/s20216097
ISSN
1424-8220
Publisher
MDPI AG
Journal / Book Title
Sensors
Volume
20
Issue
21
Copyright Statement
©2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open accessarticle distributed under the terms and conditions of the Creative Commons Attribution(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
License URL
http://creativecommons.org/licenses/by/4.0/
Subjects
Science & Technology
Physical Sciences
Technology
Chemistry, Analytical
Engineering, Electrical & Electronic
Instruments & Instrumentation
Chemistry
Engineering
shared autonomy
prosthetic technology
mechanomyography
HAND
RECOGNITION
STATE
mechanomyography
prosthetic technology
shared autonomy
Analytical Chemistry
0301 Analytical Chemistry
0805 Distributed Computing
0906 Electrical and Electronic Engineering
0502 Environmental Science and Management
0602 Ecology
Publication Status
Published
Article Number
ARTN 6097
About
Spiral Depositing with Spiral Publishing with Spiral Symplectic
Contact us
Open access team Report an issue
Other Services
Scholarly Communications Library Services
logo

Imperial College London

South Kensington Campus

London SW7 2AZ, UK

tel: +44 (0)20 7589 5111

Accessibility Modern slavery statement Cookie Policy

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback