Transformer-aided wireless image transmission with channel feedback
File(s)
Author(s)
Wu, Haotian
Shao, Yulin
Ozfatura, Emre
Mikolajczyk, Krystian
Gunduz, Deniz
Type
Journal Article
Abstract
This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver’s estimation at each block. Specifically, the unified encoder of JSCCformer-f can leverage the semantic information from the source image, and acquire channel state information and the decoder’s current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our JSCCformer-f scheme achieves state-of-the-art performance with robustness to noise in the feedback link. Additionally, JSCCformer-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the JSCCformer-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.
Date Issued
2024-09-01
Date Acceptance
2024-03-23
Citation
IEEE Transactions on Wireless Communications, 2024, 23 (9), pp.11904-11919
ISSN
1536-1276
Publisher
Institute of Electrical and Electronics Engineers
Start Page
11904
End Page
11919
Journal / Book Title
IEEE Transactions on Wireless Communications
Volume
23
Issue
9
Copyright Statement
Copyright © 2024 IEEE. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Subjects
Channel feedback
Codes
COMMUNICATION
Decoding
Engineering
Engineering, Electrical & Electronic
image transmission
joint source-channel coding
Receivers
Science & Technology
semantic communication
Semantics
Technology
Telecommunications
Training
Transmitters
vision transformer
Wireless communication
Publication Status
Published
Date Publish Online
2024-04-15