Bayesian approaches to distribution regression
File(s)Bayesian_Approaches_to_Distribution_Regression.pdf (2.09 MB)
Published version
OA Location
Author(s)
Law, Ho Chung Leon
Sutherland, Dougal
Sejdinovic, Dino
Flaxman, SR
Type
Conference Paper
Abstract
Distribution regression has recently attracted
much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not
propagate the uncertainty in observations due to
sampling variability in the groups. This effectively assumes that small and large groups are
estimated equally well, and should have equal
weight in the final regression. We account for
this uncertainty with a Bayesian distribution regression formalism, improving the robustness
and performance of the model when group sizes
vary. We frame our models in a neural network
style, allowing for simple MAP inference using
backpropagation to learn the parameters, as well
as MCMC-based inference which can fully propagate uncertainty. We demonstrate our approach
on illustrative toy datasets, as well as on a challenging problem of predicting age from images.
much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not
propagate the uncertainty in observations due to
sampling variability in the groups. This effectively assumes that small and large groups are
estimated equally well, and should have equal
weight in the final regression. We account for
this uncertainty with a Bayesian distribution regression formalism, improving the robustness
and performance of the model when group sizes
vary. We frame our models in a neural network
style, allowing for simple MAP inference using
backpropagation to learn the parameters, as well
as MCMC-based inference which can fully propagate uncertainty. We demonstrate our approach
on illustrative toy datasets, as well as on a challenging problem of predicting age from images.
Date Issued
2018-04-09
Date Acceptance
2017-12-22
Citation
Proceedings of the 21st International Conference on Artificial Intelligence and Statistics, 2018, 84
Publisher
AISTATS
Journal / Book Title
Proceedings of the 21st International Conference on Artificial Intelligence and Statistics
Volume
84
Copyright Statement
© 2018 The Authors
Identifier
http://proceedings.mlr.press/v84/
Source
The 21st International Conference on Artificial Intelligence and Statistics: AISTATS 2018
Publication Status
Accepted
Start Date
2018-04-09
Finish Date
2018-04-11
Coverage Spatial
Lanzarote, Canary Islands
Date Publish Online
2018-04-09