Visual guidance and automatic control for robotic personalized stent graft manufacturing
File(s)ICRA_revision_draft_BL.pdf (978.08 KB)
Accepted version
Author(s)
Guo, Yu
Sun, Miao
Lo, Frank Po Wen
Lo, Benny
Type
Conference Paper
Abstract
Personalized stent graft is designed to treat Abdominal Aortic Aneurysms (AAA). Due to the individual difference in arterial structures, stent graft has to be custom made for each AAA patient. Robotic platforms for autonomous personalized stent graft manufacturing have been proposed in recently which rely upon stereo vision systems for coordinating multiple robots for fabricating customized stent grafts. This paper proposes a novel hybrid vision system for real-time visual-sevoing for personalized stent-graft manufacturing. To coordinate the robotic arms, this system is based on projecting a dynamic stereo microscope coordinate system onto a static wide angle view stereo webcam coordinate system. The multiple stereo camera configuration enables accurate localization of the needle in 3D during the sewing process. The scale-invariant feature transform (SIFT) method and color filtering are implemented for stereo matching and feature identifications for object localization. To maintain the clear view of the sewing process, a visual-servoing system is developed for guiding the stereo microscopes for tracking the needle movements. The deep deterministic policy gradient (DDPG) reinforcement learning algorithm is developed for real-time intelligent robotic control. Experimental results have shown that the robotic arm can learn to reach the desired targets autonomously.
Date Issued
2019-08-12
Date Acceptance
2019-05-01
Citation
2019 International Conference on Robotics and Automation (ICRA), 2019, pp.8740-8746
Publisher
IEEE
Start Page
8740
End Page
8746
Journal / Book Title
2019 International Conference on Robotics and Automation (ICRA)
Copyright Statement
©2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Identifier
https://ieeexplore.ieee.org/document/8794123
Grant Number
EP/L020688/1
Source
2019 International Conference on Robotics and Automation (ICRA)
Publication Status
Published
Start Date
2019-05-20
Finish Date
2019-05-24
Coverage Spatial
Montreal, QC, Canada
Date Publish Online
2019-08-12