Head-mounted augmented reality for explainable robotic wheelchair assistance
File(s)hololens_wheelchair_iros18_stamped.pdf (830.84 KB)
Accepted version
Author(s)
Zolotas, Mark
Elsdon, Joshua
Demiris, Yiannis
Type
Conference Paper
Abstract
Robotic wheelchairs with built-in assistive fea-
tures, such as shared control, are an emerging means of
providing independent mobility to severely disabled individuals.
However, patients often struggle to build a mental model of
their wheelchair’s behaviour under different environmental
conditions. Motivated by the desire to help users bridge this
gap in perception, we propose a novel augmented reality
system using a Microsoft Hololens as a head-mounted aid for
wheelchair navigation. The system displays visual feedback to
the wearer as a way of explaining the underlying dynamics
of the wheelchair’s shared controller and its predicted future
states. To investigate the influence of different interface design
options, a pilot study was also conducted. We evaluated the
acceptance rate and learning curve of an immersive wheelchair
training regime, revealing preliminary insights into the potential
beneficial and adverse nature of different augmented reality
cues for assistive navigation. In particular, we demonstrate that
care should be taken in the presentation of information, with
effort-reducing cues for augmented information acquisition (for
example, a rear-view display) being the most appreciated.
tures, such as shared control, are an emerging means of
providing independent mobility to severely disabled individuals.
However, patients often struggle to build a mental model of
their wheelchair’s behaviour under different environmental
conditions. Motivated by the desire to help users bridge this
gap in perception, we propose a novel augmented reality
system using a Microsoft Hololens as a head-mounted aid for
wheelchair navigation. The system displays visual feedback to
the wearer as a way of explaining the underlying dynamics
of the wheelchair’s shared controller and its predicted future
states. To investigate the influence of different interface design
options, a pilot study was also conducted. We evaluated the
acceptance rate and learning curve of an immersive wheelchair
training regime, revealing preliminary insights into the potential
beneficial and adverse nature of different augmented reality
cues for assistive navigation. In particular, we demonstrate that
care should be taken in the presentation of information, with
effort-reducing cues for augmented information acquisition (for
example, a rear-view display) being the most appreciated.
Date Issued
2019-01-07
Date Acceptance
2018-06-29
Citation
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019
ISBN
9781538680940
ISSN
2153-0866
Publisher
IEEE
Journal / Book Title
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Copyright Statement
©2018 IEEE.
Source
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Information Systems
Robotics
Computer Science
SMART WHEELCHAIRS
SHARED CONTROL
MOBILITY
Publication Status
Published
Start Date
2018-10-01
Finish Date
2018-10-05
Coverage Spatial
Madrid, Spain
Date Publish Online
2019-01-07