Nonasymptotic estimates for stochastic gradient Langevin dynamics under local conditions in nonconvex optimization
OA Location
Author(s)
Zhang, Ying
Akyildiz, Ömer Deniz
Damoulas, Theodoros
Sabanis, Sotirios
Type
Journal Article
Abstract
In this paper, we are concerned with a non-asymptotic analysis of sampling algorithms used in nonconvex optimization. In particular, we obtain non-asymptotic estimates in Wasserstein-1 and Wasserstein-2 distances for a popular class of algorithms called Stochastic Gradient Langevin Dynamics (SGLD). In addition, the aforementioned Wasserstein-2 convergence result can be applied to establish a non-asymptotic error bound for the expected excess risk. Crucially, these results are obtained under a local Lipschitz condition and a local dissipativity condition where we remove the uniform dependence in the data stream. We illustrate the importance of this relaxation by presenting examples from variational inference and from index tracking optimization.
Date Issued
2023-04
Date Acceptance
2022-10-13
Citation
Applied Mathematics and Optimization, 2023, 87 (2), pp.1-41
ISSN
0095-4616
Publisher
Springer
Start Page
1
End Page
41
Journal / Book Title
Applied Mathematics and Optimization
Volume
87
Issue
2
Copyright Statement
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022
Identifier
https://link.springer.com/article/10.1007/s00245-022-09932-6
Subjects
Applied Mathematics
0102 Applied Mathematics
0103 Numerical and Computational Mathematics
Publication Status
Published
Article Number
25
Date Publish Online
2023-01-13