Transductive image segmentation: Self-training and effect of uncertainty estimation
File(s)2107.08964v1.pdf (3.06 MB)
Accepted version
Author(s)
Kamnitsas, Konstantinos
Winzeck, Stefan
Kornaropoulos, Evgenios N
Whitehouse, Daniel
Englman, Cameron
Type
Conference Paper
Abstract
Semi-supervised learning (SSL) uses unlabeled data during training to learn
better models. Previous studies on SSL for medical image segmentation focused
mostly on improving model generalization to unseen data. In some applications,
however, our primary interest is not generalization but to obtain optimal
predictions on a specific unlabeled database that is fully available during
model development. Examples include population studies for extracting imaging
phenotypes. This work investigates an often overlooked aspect of SSL,
transduction. It focuses on the quality of predictions made on the unlabeled
data of interest when they are included for optimization during training,
rather than improving generalization. We focus on the self-training framework
and explore its potential for transduction. We analyze it through the lens of
Information Gain and reveal that learning benefits from the use of calibrated
or under-confident models. Our extensive experiments on a large MRI database
for multi-class segmentation of traumatic brain lesions shows promising results
when comparing transductive with inductive predictions. We believe this study
will inspire further research on transductive learning, a well-suited paradigm
for medical image analysis.
better models. Previous studies on SSL for medical image segmentation focused
mostly on improving model generalization to unseen data. In some applications,
however, our primary interest is not generalization but to obtain optimal
predictions on a specific unlabeled database that is fully available during
model development. Examples include population studies for extracting imaging
phenotypes. This work investigates an often overlooked aspect of SSL,
transduction. It focuses on the quality of predictions made on the unlabeled
data of interest when they are included for optimization during training,
rather than improving generalization. We focus on the self-training framework
and explore its potential for transduction. We analyze it through the lens of
Information Gain and reveal that learning benefits from the use of calibrated
or under-confident models. Our extensive experiments on a large MRI database
for multi-class segmentation of traumatic brain lesions shows promising results
when comparing transductive with inductive predictions. We believe this study
will inspire further research on transductive learning, a well-suited paradigm
for medical image analysis.
Date Issued
2021-09-21
Date Acceptance
2021-07-17
Citation
2021, pp.79-89
Publisher
Springer
Start Page
79
End Page
89
Copyright Statement
© 2021 Springer Nature Switzerland AG. The final publication is available at Springer via https://doi.org/10.1007/978-3-030-87722-4_8
Sponsor
Innovate UK
Identifier
http://arxiv.org/abs/2107.08964v1
Grant Number
104691
Source
MICCAI Workshop on Domain Adaptation and Representation Transfer
Subjects
cs.CV
cs.CV
Publication Status
Published
Start Date
2021-09-27
Finish Date
2021-10-01
Coverage Spatial
Strasbourg, France
Date Publish Online
2021-09-21