Wireless image retrieval at the edge
File(s)JGM_JSAC21.pdf (1.85 MB)
Accepted version
Author(s)
Jankowski, Mikolaj
Gunduz, Deniz
Mikolajczyk, Krystian
Type
Journal Article
Abstract
We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
Date Issued
2021-01-01
Date Acceptance
2020-10-22
Citation
IEEE Journal on Selected Areas in Communications, 2021, 39 (1), pp.89-100
ISSN
0733-8716
Publisher
Institute of Electrical and Electronics Engineers
Start Page
89
End Page
100
Journal / Book Title
IEEE Journal on Selected Areas in Communications
Volume
39
Issue
1
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000599495400008&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Subjects
Science & Technology
Technology
Engineering, Electrical & Electronic
Telecommunications
Engineering
Image edge detection
Servers
Task analysis
Wireless communication
Performance evaluation
Image coding
Feature extraction
Deep learning
Internet of Things
image retrieval
joint source-channel coding
person re-identification
NETWORK
Publication Status
Published
Date Publish Online
2020-11-16