Deep joint source-channel coding for adaptive image transmission over MIMO channels
Author(s)
Wu, Haotian
Shao, Yulin
Bian, Chenghong
Mikolajczyk, Krystian
Gunduz, Deniz
Type
Journal Article
Abstract
We introduce a vision transformer (ViT)-based deep joint source and channel coding (DeepJSCC) scheme for wireless image transmission over multiple-input multiple-output (MIMO) channels, called DeepJSCC-MIMO. We employ DeepJSCC-MIMO in both open-loop and closed-loop MIMO systems. The novel DeepJSCC-MIMO architecture surpasses the classical separation-based benchmarks, while exhibiting robustness to channel estimation errors and flexibility in adapting to diverse channel conditions and antenna configurations without requiring retraining. Specifically, by harnessing the self-attention mechanism of the ViT, DeepJSCC-MIMO intelligently learns feature mapping and power allocation strategies tailored to the unique characteristics of the source image and prevailing channel conditions. Extensive numerical experiments validate the significant improvements in both distortion quality and perceptual quality achieved by DeepJSCC-MIMO for both open-loop and closed-loop MIMO systems across a wide range of scenarios. Moreover, DeepJSCC-MIMO exhibits robustness to varying channel conditions, channel estimation errors, and different antenna numbers, making it an appealing technology for emerging semantic communication systems.
Date Issued
2024-10-01
Date Acceptance
2024-06-18
Citation
IEEE Transactions on Wireless Communications, 2024, 23 (10), pp.15002-15017
ISSN
1536-1276
Publisher
Institute of Electrical and Electronics Engineers
Start Page
15002
End Page
15017
Journal / Book Title
IEEE Transactions on Wireless Communications
Volume
23
Issue
10
Copyright Statement
Copyright © 2024 IEEE. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Subjects
Adaptation models
attention mechanism
Channel estimation
CODES
Engineering
Engineering, Electrical & Electronic
Image communication
image transmission
Joint source-channel coding
MIMO
MIMO communication
Science & Technology
semantic communication
Semantics
Symbols
Technology
Telecommunications
Wireless communication
Publication Status
Published
Date Publish Online
2024-07-12