Post-DAE: anatomically plausible segmentation via post-processing with
denoising autoencoders
denoising autoencoders
File(s)2006.13791v1.pdf (2.37 MB)
Accepted version
Author(s)
Larrazabal, Agostina J
Martínez, César
Glocker, Ben
Ferrante, Enzo
Type
Journal Article
Abstract
We introduce Post-DAE, a post-processing method based on denoising
autoencoders (DAE) to improve the anatomical plausibility of arbitrary
biomedical image segmentation algorithms. Some of the most popular segmentation
methods (e.g. based on convolutional neural networks or random forest
classifiers) incorporate additional post-processing steps to ensure that the
resulting masks fulfill expected connectivity constraints. These methods
operate under the hypothesis that contiguous pixels with similar aspect should
belong to the same class. Even if valid in general, this assumption does not
consider more complex priors like topological restrictions or convexity, which
cannot be easily incorporated into these methods. Post-DAE leverages the latest
developments in manifold learning via denoising autoencoders. First, we learn a
compact and non-linear embedding that represents the space of anatomically
plausible segmentations. Then, given a segmentation mask obtained with an
arbitrary method, we reconstruct its anatomically plausible version by
projecting it onto the learnt manifold. The proposed method is trained using
unpaired segmentation mask, what makes it independent of intensity information
and image modality. We performed experiments in binary and multi-label
segmentation of chest X-ray and cardiac magnetic resonance images. We show how
erroneous and noisy segmentation masks can be improved using Post-DAE. With
almost no additional computation cost, our method brings erroneous
segmentations back to a feasible space.
autoencoders (DAE) to improve the anatomical plausibility of arbitrary
biomedical image segmentation algorithms. Some of the most popular segmentation
methods (e.g. based on convolutional neural networks or random forest
classifiers) incorporate additional post-processing steps to ensure that the
resulting masks fulfill expected connectivity constraints. These methods
operate under the hypothesis that contiguous pixels with similar aspect should
belong to the same class. Even if valid in general, this assumption does not
consider more complex priors like topological restrictions or convexity, which
cannot be easily incorporated into these methods. Post-DAE leverages the latest
developments in manifold learning via denoising autoencoders. First, we learn a
compact and non-linear embedding that represents the space of anatomically
plausible segmentations. Then, given a segmentation mask obtained with an
arbitrary method, we reconstruct its anatomically plausible version by
projecting it onto the learnt manifold. The proposed method is trained using
unpaired segmentation mask, what makes it independent of intensity information
and image modality. We performed experiments in binary and multi-label
segmentation of chest X-ray and cardiac magnetic resonance images. We show how
erroneous and noisy segmentation masks can be improved using Post-DAE. With
almost no additional computation cost, our method brings erroneous
segmentations back to a feasible space.
Date Issued
2020-11-30
Date Acceptance
2020-06-22
Citation
IEEE Transactions on Medical Imaging, 2020, 39 (12), pp.3813-3820
ISSN
0278-0062
Publisher
Institute of Electrical and Electronics Engineers
Start Page
3813
End Page
3820
Journal / Book Title
IEEE Transactions on Medical Imaging
Volume
39
Issue
12
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://arxiv.org/abs/2006.13791v1
Subjects
cs.CV
cs.CV
cs.LG
eess.IV
Notes
Accepted for publication in IEEE Transactions on Medical Imaging (IEEE TMI)
Publication Status
Published
Date Publish Online
2020-06-26