"Wink to grasp" – comparing eye, voice & EMG gesture control of grasp with soft-robotic gloves
File(s)ICORR2017grasp.sabine.aldo.sabine.aldo.pdf (2.05 MB)
Accepted version
Author(s)
Noronha, B
Dziemian, S
Zito, GA
Konnaris, C
Faisal, AA
Type
Conference Paper
Abstract
The ability of robotic rehabilitation devices to support paralysed end-users is ultimately limited by the degree to which human-machine-interaction is designed to be effective and efficient in translating user intention into robotic action. Specifically, we evaluate the novel possibility of binocular eye-tracking technology to detect voluntary winks from involuntary blink commands, to establish winks as a novel low-latency control signal to trigger robotic action. By wearing binocular eye-tracking glasses we enable users to directly observe their environment or the actuator and trigger movement actions, without having to interact with a visual display unit or user interface. We compare our novel approach to two conventional approaches for controlling robotic devices based on electromyo-graphy (EMG) and speech-based human-computer interaction technology. We present an integrated software framework based on ROS that allows transparent integration of these multiple modalities with a robotic system. We use a soft-robotic SEM glove (Bioservo Technologies AB, Sweden) to evaluate how the 3 modalities support the performance and subjective experience of the end-user when movement assisted. All 3 modalities are evaluated in streaming, closed-loop control operation for grasping physical objects. We find that wink control shows the lowest error rate mean with lowest standard deviation of (0.23 ± 0.07, mean ± SEM) followed by speech control (0.35 ± 0. 13) and EMG gesture control (using the Myo armband by Thalamic Labs), with the highest mean and standard deviation (0.46 ± 0.16). We conclude that with our novel own developed eye-tracking based approach to control assistive technologies is a well suited alternative to conventional approaches, especially when combined with 3D eye-tracking based robotic end-point control.
Date Issued
2017-08-15
Date Acceptance
2017-05-15
Citation
IEEE Conference on Rehabilitation Robotics (ICORR), 2017, pp.1043-1048
Publisher
IEEE
Start Page
1043
End Page
1048
Journal / Book Title
IEEE Conference on Rehabilitation Robotics (ICORR)
Copyright Statement
© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
IEEE Conference on Rehabilitation Robotics (ICORR 2017)
Subjects
Science & Technology
Technology
Life Sciences & Biomedicine
Engineering, Electrical & Electronic
Robotics
Rehabilitation
Engineering
INTERFACE
REACH
Blinking
Hand Strength
Humans
Robotics
Self-Help Devices
User-Computer Interface
Humans
Hand Strength
Self-Help Devices
Blinking
Robotics
User-Computer Interface
Publication Status
Published
Start Date
2017-07-17
Finish Date
2017-07-20
Coverage Spatial
London, UK
Date Publish Online
2017-08-15