Real-time surgical tool tracking and pose estimation using a hybrid cylindrical marker.
File(s)art%3A10.1007%2Fs11548-017-1558-9.pdf (2.01 MB)
Published version
OA Location
Author(s)
Zhang, L
Ye, M
Chan, PL
Yang, GZ
Type
Journal Article
Abstract
PURPOSE: To provide an integrated visualisation of intraoperative ultrasound and endoscopic images to facilitate intraoperative guidance, real-time tracking of the ultrasound probe is required. State-of-the-art methods are suitable for planar targets while most of the laparoscopic ultrasound probes are cylindrical objects. A tracking framework for cylindrical objects with a large work space will improve the usability of the intraoperative ultrasound guidance. METHODS: A hybrid marker design that combines circular dots and chessboard vertices is proposed for facilitating tracking cylindrical tools. The circular dots placed over the curved surface are used for pose estimation. The chessboard vertices are employed to provide additional information for resolving the ambiguous pose problem due to the use of planar model points under a monocular camera. Furthermore, temporal information between consecutive images is considered to minimise tracking failures with real-time computational performance. RESULTS: Detailed validation confirms that our hybrid marker provides a large working space for different tool sizes (6-14 mm in diameter). The tracking framework allows translational movements between 40 and 185 mm along the depth direction and rotational motion around three local orthogonal axes up to [Formula: see text]. Comparative studies with the current state of the art confirm that our approach outperforms existing methods by providing nearly 100% detection rates and accurate pose estimation with mean errors of 2.8 mm and 0.72[Formula: see text]. The tracking algorithm runs at 20 frames per second for [Formula: see text] image resolution videos. CONCLUSION: Experiments show that the proposed hybrid marker can be applied to a wide range of surgical tools with superior detection rates and pose estimation accuracies. Both the qualitative and quantitative results demonstrate that our framework can be used not only for assisting intraoperative ultrasound guidance but also for tracking general surgical tools in MIS.
Date Issued
2017-03-24
Date Acceptance
2017-03-08
Citation
International Journal of Computer Assisted Radiology and Surgery, 2017, 12 (6), pp.921-930
ISSN
1861-6410
Publisher
Springer Verlag (Germany)
Start Page
921
End Page
930
Journal / Book Title
International Journal of Computer Assisted Radiology and Surgery
Volume
12
Issue
6
Copyright Statement
© 2017 The Author(s). Open Access. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Identifier
http://www.ncbi.nlm.nih.gov/pubmed/28342105
PII: 10.1007/s11548-017-1558-9
Subjects
Cylindrical marker
Image guidance
Pose estimation
Surgical tool
Tracking
Nuclear Medicine & Medical Imaging
1103 Clinical Sciences
Publication Status
Published
Coverage Spatial
Germany