Meta reinforcement learning with latent variable Gaussian processes
File(s)1803.07551v2.pdf (870.93 KB)
Published version
Author(s)
Sæmundsson, Steindór
Hofmann, Katja
Deisenroth, Marc Peter
Type
Conference Paper
Abstract
Learning from small data sets is critical in
many practical applications where data col-
lection is time consuming or expensive, e.g.,
robotics, animal experiments or drug design.
Meta learning is one way to increase the data
efficiency of learning algorithms by general-
izing learned concepts from a set of training
tasks to unseen, but related, tasks. Often, this
relationship between tasks is hard coded or re-
lies in some other way on human expertise.
In this paper, we frame meta learning as a hi-
erarchical latent variable model and infer the
relationship between tasks automatically from
data. We apply our framework in a model-
based reinforcement learning setting and show
that our meta-learning model effectively gen-
eralizes to novel tasks by identifying how new
tasks relate to prior ones from minimal data.
This results in up to a
60%
reduction in the
average interaction time needed to solve tasks
compared to strong baselines.
many practical applications where data col-
lection is time consuming or expensive, e.g.,
robotics, animal experiments or drug design.
Meta learning is one way to increase the data
efficiency of learning algorithms by general-
izing learned concepts from a set of training
tasks to unseen, but related, tasks. Often, this
relationship between tasks is hard coded or re-
lies in some other way on human expertise.
In this paper, we frame meta learning as a hi-
erarchical latent variable model and infer the
relationship between tasks automatically from
data. We apply our framework in a model-
based reinforcement learning setting and show
that our meta-learning model effectively gen-
eralizes to novel tasks by identifying how new
tasks relate to prior ones from minimal data.
This results in up to a
60%
reduction in the
average interaction time needed to solve tasks
compared to strong baselines.
Date Issued
2018-08-06
Date Acceptance
2018-05-17
Citation
Proceedings of the Conference on Uncertainty in Artificial Intelligence, 2018, abs/1803.07551
Publisher
Association for Uncertainty in Artificial Intelligence (AUAI)
Journal / Book Title
Proceedings of the Conference on Uncertainty in Artificial Intelligence
Volume
abs/1803.07551
Copyright Statement
© 2048 The Author(s)
Source
Uncertainty in Artificial Intelligence (UAI) 2018
Subjects
stat.ML
cs.LG
Publication Status
Published
Start Date
2018-08-06
Finish Date
2018-08-10
Coverage Spatial
Monterey, CA, USA