DeepCut: object segmentation from bounding box annotations using convolutional neural networks
File(s)1605.07866v2.pdf (2.33 MB)
Accepted version
Author(s)
Type
Journal Article
Abstract
In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled weak annotations, in our case bounding boxes. It extends the approach of the well-known GrabCut[1] method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naïve approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.
Date Issued
2016-11-09
Date Acceptance
2016-10-18
Citation
IEEE Transactions on Medical Imaging, 2016, 36 (2), pp.674-683
ISSN
0278-0062
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
674
End Page
683
Journal / Book Title
IEEE Transactions on Medical Imaging
Volume
36
Issue
2
Copyright Statement
© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
Wellcome Trust
Wellcome Trust/EPSRC
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000396115800030&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
RTJ5557761-1
PO :RTJ5557761-1
NS/A000025/1
Subjects
Science & Technology
Technology
Life Sciences & Biomedicine
Computer Science, Interdisciplinary Applications
Engineering, Biomedical
Engineering, Electrical & Electronic
Imaging Science & Photographic Technology
Radiology, Nuclear Medicine & Medical Imaging
Computer Science
Engineering
Bounding box
convolutional neural networks
DeepCut
image segmentation
machine learning
weak annotations
GRAPH-CUT SEGMENTATION
FLOW SEGMENTATION
MRI
OPTIMIZATION
GRABCUT
cs.CV
Nuclear Medicine & Medical Imaging
08 Information And Computing Sciences
09 Engineering
Publication Status
Published