On the generalised Langevin equation for simulated annealing
File(s)2003.06448v2.pdf (3.1 MB)
Working paper
Author(s)
Chak, Martin
Kantas, Nikolas
Pavliotis, Grigorios A
Type
Working Paper
Abstract
In this paper, we consider the generalised (higher order) Langevin equation for the purpose of simulated annealing and optimisation of nonconvex functions. Our approach modifies the underdamped Langevin equation by replacing the Brownian noise with an appropriate Ornstein-Uhlenbeck process to account for memory in the system. Under reasonable conditions on the loss function and the annealing schedule, we establish convergence of the continuous time dynamics to a global minimum. In addition, we investigate the performance numerically and show better performance and higher exploration of the state space compared to the underdamped and overdamped Langevin dynamics with the same annealing schedule.
Date Issued
2020-03-28
Citation
2020
Publisher
arXiv
Copyright Statement
© 2020 The Author(s)
Identifier
http://arxiv.org/abs/2003.06448v2
Subjects
math.PR
math.PR
math.OC
60J25, 46N10, 60J60
Notes
32 pages, 4 figures
Publication Status
Published