Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images
File(s)1808.08114v1.pdf (5.41 MB)
Working paper
Author(s)
Type
Working Paper
Abstract
We propose a novel attention gate (AG) model for medical image analysis that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules when using convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN models such as VGG or U-Net architectures with minimal computational overhead while increasing the model sensitivity and prediction accuracy. The proposed AG models are evaluated on a variety of tasks, including medical image classification and segmentation. For classification, we demonstrate the use case of AGs in scan plane detection for fetal ultrasound screening. We show that the proposed attention mechanism can provide efficient object localisation while improving the overall prediction performance by reducing false positives. For segmentation, the proposed architecture is evaluated on two large 3D CT abdominal datasets with manual annotations for multiple organs. Experimental results show that AG models consistently improve the prediction performance of the base architectures across different datasets and training sizes while preserving computational efficiency. Moreover, AGs guide the model activations to be focused around salient regions, which provides better insights into how model predictions are made. The source code for the proposed AG models is publicly available.
Date Issued
2018-12-31
Copyright Statement
© 2018 The Author(s).
Sponsor
Engineering & Physical Science Research Council (E
Wellcome Trust
Wellcome Trust/EPSRC
Wellcome Trust
Engineering & Physical Science Research Council (E
Nvidia
Identifier
http://arxiv.org/abs/1808.08114v1
Grant Number
RTJ5557761-1
PO :RTJ5557761-1
NS/A000025/1
RTJ5557761
RTJ5557761-1
Nvidia Hardware donation
Subjects
cs.CV
Notes
Submitted to Medical Image Analysis (Special Issue on Medical Imaging with Deep Learning). arXiv admin note: substantial text overlap with arXiv:1804.03999, arXiv:1804.05338