A lagged particle filter for stable filtering of certain high-dimensional state-space models
File(s)2110.00884v1.pdf (10.68 MB)
Working Paper
Author(s)
Type
Journal Article
Abstract
We consider the problem of high-dimensional filtering of state-space models
(SSMs) at discrete times. This problem is particularly challenging as
analytical solutions are typically not available and many numerical
approximation methods can have a cost that scales exponentially with the
dimension of the hidden state. Inspired by lag-approximation methods for the
smoothing problem, we introduce a lagged approximation of the smoothing
distribution that is necessarily biased. For certain classes of SSMs,
particularly those that forget the initial condition exponentially fast in
time, the bias of our approximation is shown to be uniformly controlled in the
dimension and exponentially small in time. We develop a sequential Monte Carlo
(SMC) method to recursively estimate expectations with respect to our biased
filtering distributions. Moreover, we prove for a class of class of SSMs that
can contain dependencies amongst coordinates that as the dimension
$d\rightarrow\infty$ the cost to achieve a stable mean square error in
estimation, for classes of expectations, is of $\mathcal{O}(Nd^2)$ per-unit
time, where $N$ is the number of simulated samples in the SMC algorithm. Our
methodology is implemented on several challenging high-dimensional examples
including the conservative shallow-water model.
(SSMs) at discrete times. This problem is particularly challenging as
analytical solutions are typically not available and many numerical
approximation methods can have a cost that scales exponentially with the
dimension of the hidden state. Inspired by lag-approximation methods for the
smoothing problem, we introduce a lagged approximation of the smoothing
distribution that is necessarily biased. For certain classes of SSMs,
particularly those that forget the initial condition exponentially fast in
time, the bias of our approximation is shown to be uniformly controlled in the
dimension and exponentially small in time. We develop a sequential Monte Carlo
(SMC) method to recursively estimate expectations with respect to our biased
filtering distributions. Moreover, we prove for a class of class of SSMs that
can contain dependencies amongst coordinates that as the dimension
$d\rightarrow\infty$ the cost to achieve a stable mean square error in
estimation, for classes of expectations, is of $\mathcal{O}(Nd^2)$ per-unit
time, where $N$ is the number of simulated samples in the SMC algorithm. Our
methodology is implemented on several challenging high-dimensional examples
including the conservative shallow-water model.
Date Issued
2021-12-23
Date Acceptance
2022-03-30
Citation
SIAM/ASA Journal on Uncertainty Quantification, 2021
ISSN
2166-2525
Publisher
Society for Industrial and Applied Mathematics
Journal / Book Title
SIAM/ASA Journal on Uncertainty Quantification
Copyright Statement
©2021 The Author(s)
Identifier
http://arxiv.org/abs/2110.00884v2
Subjects
62M20, 60G35, 60J20, 60J10, 94A12, 93E11
cs.NA
math.NA
math.PR
stat.CO
stat.CO
Notes
32 pages, 14 figures
Publication Status
Published