Measuring sample quality with diffusions
File(s)stein_diffusion.pdf (815.09 KB)
Accepted version
Author(s)
Gorham, Jackson
Duncan, Andrew
Vollmer, Sebastian
Mackey, Lester
Type
Journal Article
Abstract
Stein’s method for measuring convergence to a continuous targetdistribution relies on an operator characterizing the target andSteinfactorbounds on the solutions of an associated differential equation.While such operators and bounds are readily available for a diversityof univariate targets, few multivariate targets have been analyzed. Weintroduce a new class of characterizing operators based on Itˆo diffu-sions and develop explicit multivariate Stein factor bounds for anytarget with a fast-coupling Itˆo diffusion. As example applications, wedevelop computable and convergence-determiningdiffusion Stein dis-crepanciesfor log-concave, heavy-tailed, and multimodal targets anduse these quality measures to select the hyperparameters of biasedMarkov chain Monte Carlo (MCMC) samplers, compare random anddeterministic quadrature rules, and quantify bias-variance tradeoffsin approximate MCMC. Our results establish a near-linear relation-ship between diffusion Stein discrepancies and Wasserstein distances,improving upon past work even for strongly log-concave targets. Theexposed relationship between Stein factors and Markov process cou-pling may be of independent interest.
Date Issued
2019-10-01
Date Acceptance
2019-02-03
Citation
Annals of Applied Probability, 2019, 29 (5), pp.2884-2928
ISSN
1050-5164
Publisher
Institute of Mathematical Statistics
Start Page
2884
End Page
2928
Journal / Book Title
Annals of Applied Probability
Volume
29
Issue
5
Copyright Statement
This paper is embargoed until publication.
Identifier
https://projecteuclid.org/euclid.aoap/1571385625#info
Subjects
0102 Applied Mathematics
0104 Statistics
Statistics & Probability
Publication Status
Published
Date Publish Online
2019-10-18