Swin Transformer for Fast MRI
File(s)1-s2.0-S0925231222004179-main.pdf (20.01 MB)
Published version
OA Location
Author(s)
Type
Journal Article
Abstract
Magnetic resonance imaging (MRI) is an important non-invasive clinical tool that can produce high-resolution and reproducible images. However, a long scanning time is required for high-quality MR images, which leads to exhaustion and discomfort of patients, inducing more artefacts due to voluntary movements of the patients and involuntary physiological movements. To accelerate the scanning process, methods by k-space undersampling and deep learning based reconstruction have been popularised. This work introduced SwinMR, a novel Swin transformer based method for fast MRI reconstruction. The whole network consisted of an input module (IM), a feature extraction module (FEM) and an output module (OM). The IM and OM were 2D convolutional layers and the FEM was composed of a cascaded of residual Swin transformer blocks (RSTBs) and 2D convolutional layers. The RSTB consisted of a series of Swin transformer layers (STLs). The shifted windows multi-head self-attention (W-MSA/SW-MSA) of STL was performed in shifted windows rather than the multi-head self-attention (MSA) of the original transformer in the whole image space. A novel multi-channel loss was proposed by using the sensitivity maps, which was proved to reserve more textures and details. We performed a series of comparative studies and ablation studies in the Calgary-Campinas public brain MR dataset and conducted a downstream segmentation experiment in the Multi-modal Brain Tumour Segmentation Challenge 2017 dataset. The results demonstrate our SwinMR achieved high-quality reconstruction compared with other benchmark methods, and it shows great robustness with different undersampling masks, under noise interruption and on different datasets. The code is publicly available at https://github.com/ayanglab/SwinMR.
Date Issued
2022-07-07
Date Acceptance
2022-04-08
Citation
Neurocomputing, 2022, 493, pp.281-304
ISSN
0925-2312
Publisher
Elsevier
Start Page
281
End Page
304
Journal / Book Title
Neurocomputing
Volume
493
Copyright Statement
© 2022 The Author(s). Published by Elsevier B.V.
This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
License URL
Sponsor
British Heart Foundation
Commission of the European Communities
European Research Council Horizon 2020
Commission of the European Communities
Innovative Medicines Initiative
Boehringer Ingelheim Ltd
Medical Research Council (MRC)
Medical Research Council (MRC)
Grant Number
PG/16/78/32402
952172
H2020-SC1-FA-DTS-2019-1 952172
101005122
101005122
PO:4700244755 Study:1199-0457
MR/V023799/1
MC_PC_21013
Subjects
eess.IV
eess.IV
cs.AI
cs.CV
cs.LG
08 Information and Computing Sciences
09 Engineering
17 Psychology and Cognitive Sciences
Artificial Intelligence & Image Processing
Publication Status
Published
Date Publish Online
2022-04-12