TeTrIS: template transformer networks for image segmentation with shape priors
File(s)08672808.pdf (9.23 MB)
Accepted version
Author(s)
Lee, M
Petersen, K
Pawlowski, N
Glocker, Ben
Schaap, M
Type
Journal Article
Abstract
In this paper we introduce and compare different approaches for incorporating shape prior information into neural network based image segmentation. Specifically, we introduce the concept of template transformer networks where a shape template is deformed to match the underlying structure of interest through an end-to-end trained spatial transformer network. This has the advantage of explicitly enforcing shape priors and is free of discretisation artefacts by providing a soft partial volume segmentation. We also introduce a simple yet effective way of incorporating priors in state-of-the-art pixel-wise binary classification methods such as fully convolutional networks and U-net. Here, the template shape is given as an additional input channel, incorporating this information significantly reduces false positives. We report results on synthetic data and sub-voxel segmentation of coronary lumen structures in cardiac computed tomography showing the benefit of incorporating priors in neural network based image segmentation.
Date Issued
2019-11-01
Date Acceptance
2019-03-12
Citation
IEEE Transactions on Medical Imaging, 2019, 38 (11), pp.2596-2606
ISSN
0278-0062
Publisher
Institute of Electrical and Electronics Engineers
Start Page
2596
End Page
2606
Journal / Book Title
IEEE Transactions on Medical Imaging
Volume
38
Issue
11
Copyright Statement
© 2019 IEEE. This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/
Sponsor
HeartFlow Inc
Grant Number
PO 1194
Subjects
Science & Technology
Technology
Life Sciences & Biomedicine
Computer Science, Interdisciplinary Applications
Engineering, Biomedical
Engineering, Electrical & Electronic
Imaging Science & Photographic Technology
Radiology, Nuclear Medicine & Medical Imaging
Computer Science
Engineering
Shape
Neural networks
Image segmentation
Strain
Deformable models
Training
Task analysis
shape priors
neural networks
template deformation
image registration
MULTI-ATLAS SEGMENTATION
REGISTRATION
MODEL
08 Information and Computing Sciences
09 Engineering
Nuclear Medicine & Medical Imaging
Publication Status
Published
Date Publish Online
2019-03-22