Average age of information with hybrid ARQ under a resource constraint

Title: Average age of information with hybrid ARQ under a resource constraint
Authors: Ceran, ET
Gunduz, D
Gyorgy, A
Item Type: Journal Article
Abstract: Scheduling the transmission of status updates over an error-prone communication channel is studied in order to minimize the long-term average age of information at the destination under a constraint on the average number of transmissions at the source node. After each transmission, the source receives an instantaneous ACK/NACK feedback, and decides on the next update without prior knowledge on the success of future transmissions. The optimal scheduling policy is first studied under different feedback mechanisms when the channel statistics are known; in particular, the standard automatic repeat request (ARQ) and hybrid ARQ (HARQ) protocols are considered. The structural results are derived for the optimal policy under HARQ, while the optimal policy is determined analytically for ARQ. For the case of unknown environments, an average-cost reinforcement learning algorithm is proposed that learns the system parameters and the transmission policy in real time. The effectiveness of the proposed methods is verified through the numerical results.
Issue Date: 1-Mar-2019
Date of Acceptance: 2-Feb-2019
URI: http://hdl.handle.net/10044/1/69322
DOI: https://doi.org/10.1109/twc.2019.2899303
ISSN: 1536-1276
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Start Page: 1900
End Page: 1913
Journal / Book Title: IEEE Transactions on Wireless Communications
Volume: 18
Issue: 3
Copyright Statement: © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor/Funder: Commission of the European Communities
Commission of the European Communities
Funder's Grant Number: 677854
Keywords: Science & Technology
Engineering, Electrical & Electronic
Age of information
hybrid automatic repeat request (HARQ)
constrained Markov decision process
reinforcement learning
0906 Electrical and Electronic Engineering
1005 Communications Technologies
0805 Distributed Computing
Networking & Telecommunications
Publication Status: Published
Online Publication Date: 2019-02-21
Appears in Collections:Faculty of Engineering
Electrical and Electronic Engineering

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons