Joint entropy search for multi-objective Bayesian optimization
File(s)2210.02905v1.pdf (7.23 MB)
Accepted version
Author(s)
Tu, B
Gandy, A
Kantas, N
Shafei, B
Type
Conference Paper
Abstract
Many real-world problems can be phrased as a multi-objective optimization problem, where the goal is to identify the best set of compromises between the competing objectives. Multi-objective Bayesian optimization (BO) is a sample efficient strategy that can be deployed to solve these vector-valued optimization problems where access is limited to a number of noisy objective function evaluations. In this paper, we propose a novel information-theoretic acquisition function for BO called Joint Entropy Search (JES), which considers the joint information gain for the optimal set of inputs and outputs. We present several analytical approximations to the JES acquisition function and also introduce an extension to the batch setting. We showcase the effectiveness of this new approach on a range of synthetic and real-world problems in terms of the hypervolume and its weighted variants.
Date Issued
2022-11-28
Date Acceptance
2022-09-16
Citation
Advances in Neural Information Processing Systems, 2022, 35, pp.9922-9938
ISBN
9781713871088
ISSN
1049-5258
Publisher
Neural Information Processing Systems Foundation, Inc.
Start Page
9922
End Page
9938
Journal / Book Title
NIPS'22: Proceedings of the 36th International Conference on Neural Information Processing System
Volume
35
Copyright Statement
© 2022 The Author(s)
Identifier
http://arxiv.org/abs/2210.02905v1
Source
NeurIPS 2022
Subjects
cs.LG
cs.LG
math.OC
stat.ML
Notes
NeurIPS 2022. 49 pages. Code available at https://github.com/benmltu/JES
Publication Status
Published
Start Date
2022-11-29
Finish Date
2022-12-01
Coverage Spatial
Virtual event