Calculating principal eigen-functions of non-negative integral kernels:
particle approximations and applications
particle approximations and applications
File(s)1202.6678v2.pdf (538.99 KB)
Accepted version
OA Location
Author(s)
Whiteley, N
Kantas, N
Type
Journal Article
Abstract
Often in applications such as rare events estimation or optimal control it is
required that one calculates the principal eigen-function and eigen-value of a
non-negative integral kernel. Except in the finite-dimensional case, usually
neither the principal eigen-function nor the eigen-value can be computed
exactly. In this paper, we develop numerical approximations for these
quantities. We show how a generic interacting particle algorithm can be used to
deliver numerical approximations of the eigen-quantities and the associated
so-called "twisted" Markov kernel as well as how these approximations are
relevant to the aforementioned applications. In addition, we study a collection
of random integral operators underlying the algorithm, address some of their
mean and path-wise properties, and obtain $L_{r}$ error estimates. Finally,
numerical examples are provided in the context of importance sampling for
computing tail probabilities of Markov chains and computing value functions for
a class of stochastic optimal control problems.
required that one calculates the principal eigen-function and eigen-value of a
non-negative integral kernel. Except in the finite-dimensional case, usually
neither the principal eigen-function nor the eigen-value can be computed
exactly. In this paper, we develop numerical approximations for these
quantities. We show how a generic interacting particle algorithm can be used to
deliver numerical approximations of the eigen-quantities and the associated
so-called "twisted" Markov kernel as well as how these approximations are
relevant to the aforementioned applications. In addition, we study a collection
of random integral operators underlying the algorithm, address some of their
mean and path-wise properties, and obtain $L_{r}$ error estimates. Finally,
numerical examples are provided in the context of importance sampling for
computing tail probabilities of Markov chains and computing value functions for
a class of stochastic optimal control problems.
Date Issued
2017-03-24
Date Acceptance
2016-09-12
Citation
Mathematics of Operations Research, 2017, 42 (4), pp.1007-1034
ISSN
1526-5471
Publisher
INFORMS (Institute for Operations Research and Management Sciences)
Start Page
1007
End Page
1034
Journal / Book Title
Mathematics of Operations Research
Volume
42
Issue
4
Copyright Statement
Copyright © 2017, INFORMS
Subjects
stat.CO
stat.CO
Publication Status
Published