Intention recognition for gaze controlled robotic minimally invasive laser ablation
File(s)root.pdf (1.41 MB)
Accepted version
Author(s)
Gras, G
Yang, GZ
Type
Conference Paper
Abstract
Eye tracking technology has shown promising results for allowing hands-free control of robotically-mounted cameras and tools. However existing systems present only limited capabilities in allowing the full range of camera motions in a safe, intuitive manner. This paper introduces a framework for the recognition of surgeon intention, allowing activation and control of the camera through natural gaze behaviour. The system is resistant to noise such as blinking, while allowing the surgeon to look away safely at any time. Furthermore, this paper presents a novel approach to control the translation of the camera along its optical axis using a combination of eye tracking and stereo reconstruction. Combining eye tracking and stereo reconstruction allows the system to determine which point in 3D space the user is fixating, enabling a translation of the camera to achieve the optimal viewing distance. In addition, the eye tracking information is used to perform automatic laser targeting for laser ablation. The desired target point of the laser, mounted on a separate robotic arm, is determined with the eye tracking thus removing the need to manually adjust the laser's target point before starting each new ablation. The calibration methodology used to obtain millimetre precision for the laser targeting without the aid of visual servoing is described. Finally, a user study validating the system is presented, showing clear improvement with median task times under half of those of a manually controlled robotic system.
Date Issued
2016-12-01
Date Acceptance
2016-10-09
Citation
2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, 2016-November, pp.2431-2437
ISBN
9781509037629
ISSN
2153-0858
Publisher
IEEE
Start Page
2431
End Page
2437
Journal / Book Title
2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Volume
2016-November
Copyright Statement
© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Wellcome Trust
Grant Number
HICF-T4-299
Source
2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Publication Status
Published
Start Date
2016-10-09
Finish Date
2016-10-14