Real-Time 3D Tracking of Articulated Tools for Robotic Surgery
File(s)miccai.pdf (463.81 KB)
Accepted version
Author(s)
Ye, M
Zhang, L
Giannarou, S
Yang, G-Z
Type
Conference Paper
Abstract
In robotic surgery, tool tracking is important for providin
g
safe tool-tissue interaction and facilitating surgical sk
ills assessment. De-
spite recent advances in tool tracking, existing approache
s are faced with
major difficulties in real-time tracking of articulated tool
s. Most algo-
rithms are tailored for offline processing with pre-recorded
videos. In this
paper, we propose a real-time 3D tracking method for articul
ated tools
in robotic surgery. The proposed method is based on the CAD mo
del
of the tools as well as robot kinematics to generate online pa
rt-based
templates for efficient 2D matching and 3D pose estimation. A r
obust
verification approach is incorporated to reject outliers in
2D detections,
which is then followed by fusing inliers with robot kinemati
c readings
for 3D pose estimation of the tool. The proposed method has be
en val-
idated with phantom data, as well as
ex vivo
and
in vivo
experiments.
The results derived clearly demonstrate the performance ad
vantage of
the proposed method when compared to the state-of-the-art.
g
safe tool-tissue interaction and facilitating surgical sk
ills assessment. De-
spite recent advances in tool tracking, existing approache
s are faced with
major difficulties in real-time tracking of articulated tool
s. Most algo-
rithms are tailored for offline processing with pre-recorded
videos. In this
paper, we propose a real-time 3D tracking method for articul
ated tools
in robotic surgery. The proposed method is based on the CAD mo
del
of the tools as well as robot kinematics to generate online pa
rt-based
templates for efficient 2D matching and 3D pose estimation. A r
obust
verification approach is incorporated to reject outliers in
2D detections,
which is then followed by fusing inliers with robot kinemati
c readings
for 3D pose estimation of the tool. The proposed method has be
en val-
idated with phantom data, as well as
ex vivo
and
in vivo
experiments.
The results derived clearly demonstrate the performance ad
vantage of
the proposed method when compared to the state-of-the-art.
Date Issued
2016-10-02
Date Acceptance
2016-04-29
Citation
Lecture Notes in Computer Science, 2016, 9900, pp.386-394
ISBN
978-3-319-46720-7
ISSN
0302-9743
Publisher
Springer
Start Page
386
End Page
394
Journal / Book Title
Lecture Notes in Computer Science
Volume
9900
Copyright Statement
© Springer International Publishing AG 2016. The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-46720-7_45
Source
International Conference on Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016
Subjects
Artificial Intelligence & Image Processing
08 Information And Computing Sciences
Publication Status
Published
Start Date
2016-10-17
Coverage Spatial
Athens