Adaptive hierarchical dual consistency for semi-supervised left atrium segmentation on cross-domain data
Author(s)
Type
Journal Article
Abstract
Semi-supervised learning provides great significance in left atrium (LA) segmentation model learning with insufficient labelled data. Generalising semi supervised learning to cross-domain data is of high importance to further improve model robustness. However, the widely existing distribution difference and sample mismatch between different data domains hinder the generalisation of semi-supervised learning. In this study, we alleviate these problems by proposing an Adaptive Hier10 archical Dual Consistency (AHDC) for the semi-supervised LA segmentation on cross-domain data. The AHDC mainly
consists of a Bidirectional Adversarial Inference module (BAI) and a Hierarchical Dual Consistency learning module (HDC). The BAI overcomes the difference of distributions and the sample mismatch between two different domains. It mainly learns two mapping networks adversarially to obtain two matched domains through mutual adaptation. The HDC investigates a hierarchical dual learning paradigm for cross-domain semi-supervised segmentation based on the obtained matched domains. It mainly builds two dual modelling networks for mining the complementary information in both intra-domain and inter-domain. For the intra domain learning, a consistency constraint is applied to the dual-modelling targets to exploit the complementary modelling information. For the inter-domain learning, a consistency constraint is applied to the LAs modelled by two dual modelling networks to exploit the complementary knowl28 edge among different data domains. We demonstrated the performance of our proposed AHDC on four 3D late gadolinium enhancement cardiac MR (LGE-CMR) datasets from
different centres and a 3D CT dataset. Compared to other
state-of-the-art methods, our proposed AHDC achieved
higher segmentation accuracy, which indicated its capability in the cross-domain semi-supervised LA segmentation.
consists of a Bidirectional Adversarial Inference module (BAI) and a Hierarchical Dual Consistency learning module (HDC). The BAI overcomes the difference of distributions and the sample mismatch between two different domains. It mainly learns two mapping networks adversarially to obtain two matched domains through mutual adaptation. The HDC investigates a hierarchical dual learning paradigm for cross-domain semi-supervised segmentation based on the obtained matched domains. It mainly builds two dual modelling networks for mining the complementary information in both intra-domain and inter-domain. For the intra domain learning, a consistency constraint is applied to the dual-modelling targets to exploit the complementary modelling information. For the inter-domain learning, a consistency constraint is applied to the LAs modelled by two dual modelling networks to exploit the complementary knowl28 edge among different data domains. We demonstrated the performance of our proposed AHDC on four 3D late gadolinium enhancement cardiac MR (LGE-CMR) datasets from
different centres and a 3D CT dataset. Compared to other
state-of-the-art methods, our proposed AHDC achieved
higher segmentation accuracy, which indicated its capability in the cross-domain semi-supervised LA segmentation.
Date Issued
2022-02
Date Acceptance
2021-09-15
Citation
IEEE Transactions on Medical Imaging, 2022, 41 (2), pp.420-433
ISSN
0278-0062
Publisher
Institute of Electrical and Electronics Engineers
Start Page
420
End Page
433
Journal / Book Title
IEEE Transactions on Medical Imaging
Volume
41
Issue
2
Copyright Statement
© 2021 The Author(s) This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/
Sponsor
British Heart Foundation
European Research Council Horizon 2020
Commission of the European Communities
Innovative Medicines Initiative
Medical Research Council (MRC)
Identifier
https://ieeexplore.ieee.org/document/9540830
Grant Number
PG/16/78/32402
H2020-SC1-FA-DTS-2019-1 952172
101005122
101005122
MR/V023799/1
Subjects
Science & Technology
Technology
Life Sciences & Biomedicine
Computer Science, Interdisciplinary Applications
Engineering, Biomedical
Engineering, Electrical & Electronic
Imaging Science & Photographic Technology
Radiology, Nuclear Medicine & Medical Imaging
Computer Science
Engineering
Semisupervised learning
Data models
Image segmentation
Predictive models
Generators
Generative adversarial networks
Adaptation models
Semi-supervised learning
cross-domain study
hierarchical dual consistency
bidirectional adversarial inference
WHOLE HEART SEGMENTATION
LATE GADOLINIUM ENHANCEMENT
MEDICAL IMAGE SEGMENTATION
FIBRILLATION
ADAPTATION
eess.IV
eess.IV
cs.CV
cs.LG
Nuclear Medicine & Medical Imaging
08 Information and Computing Sciences
09 Engineering
Publication Status
Published
Date Publish Online
2021-09-17