Delayed feedback in generalised linear bandits revisited
Author(s)
Howson, Benjamin
Pike-Burke, Ciara
Filippi, Sarah
Type
Conference Paper
Abstract
The stochastic generalised linear bandit is a well-understood model for sequential decision-making problems, with many algorithms achieving near-optimal regret guarantees under immediate feedback. However, the stringent requirement for immediate rewards is unmet in many real-world applications where the reward is almost always delayed. We study the phenomenon of delayed rewards in generalised linear bandits in a theoretical manner. We show that a natural adaptation of an optimistic algorithm to the delayed feedback setting can achieve regret of ̃O(d√T + d3/2E[τ ] ), where E[τ ] denotes the expected delay, d is the dimension and T is the time horizon. This significantly improves upon existing approaches for this setting where the best known regret bound was ̃O(√dT √d + E[τ ] ). We verify our theoretical results through experiments on simulated data.
Date Issued
2023-06-04
Date Acceptance
2023-01-20
Citation
Proceedings of Machine Learning Research, 2023, pp.1-25
ISSN
2640-3498
Publisher
PMLR
Start Page
1
End Page
25
Journal / Book Title
Proceedings of Machine Learning Research
Copyright Statement
Copyright © 2023 by the author(s). This work is published under a CC BY licence.
License URL
Identifier
https://proceedings.mlr.press/v206/howson23b.html
Source
Artificial Intelligence and Statistics s (AISTATS 2023)
Publication Status
Accepted
Start Date
2023-04-25
Finish Date
2023-04-27
Coverage Spatial
Valencia, Spain
Date Publish Online
2023-06-04