GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses
File(s)
Accepted version
Author(s)
Markovic, M
Karnal, H
Graimann, B
Dosen, S
Farina, D
Type
Journal Article
Abstract
Objective:
Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on
augmented reality.
Approach: We have developed the GLIMPSE, a Google Glass
application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and
contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed to
vary the difficulty of the task. The outcome measures were the number of
unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback.
Results: There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-colorclothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task.
Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated
the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies
to accomplish the task. Significance: The present study demonstrates
a novel self-contained, ready-to-deploy, wearable feedback interface
based on widely used and readily available technology. The interface was successfully tested and was proven to be feasible and functionally
beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.
Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on
augmented reality.
Approach: We have developed the GLIMPSE, a Google Glass
application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and
contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed to
vary the difficulty of the task. The outcome measures were the number of
unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback.
Results: There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-colorclothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task.
Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated
the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies
to accomplish the task. Significance: The present study demonstrates
a novel self-contained, ready-to-deploy, wearable feedback interface
based on widely used and readily available technology. The interface was successfully tested and was proven to be feasible and functionally
beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.
Date Acceptance
2017-02-22
Citation
Journal of Neural Engineering
ISSN
1741-2560
Publisher
IOP Publishing
Journal / Book Title
Journal of Neural Engineering
Subjects
Biomedical Engineering
0903 Biomedical Engineering
1103 Clinical Sciences
1109 Neurosciences
Publication Status
Accepted