A multilevel proximal gradient algorithm for a class of composite optimization problems
File(s)16m1082299.pdf (560.34 KB)
Published version
Author(s)
Parpas, P
Type
Journal Article
Abstract
Composite optimization models consist of the minimization of the sum
of a smooth (not necessarily convex) function and a non-smooth convex function.
Such models arise in many applications where, in addition to the composite nature
of the objective function, a hierarchy of models is readily available. It is common
to take advantage of this hierarchy of models by first solving a low fidelity model
and then using the solution as a starting point to a high fidelity model. We adopt
an optimization point of view and show how to take advantage of the availability of
a hierarchy of models in a consistent manner. We do not use the low fidelity model
just for the computation of promising starting points but also for the computa-
tion of search directions. We establish the convergence and convergence rate of
the proposed algorithm. Our numerical experiments on large scale image restora-
tion problems and the transition path problem suggest that, for certain classes of
problems, the proposed algorithm is significantly faster than the state of the art.
of a smooth (not necessarily convex) function and a non-smooth convex function.
Such models arise in many applications where, in addition to the composite nature
of the objective function, a hierarchy of models is readily available. It is common
to take advantage of this hierarchy of models by first solving a low fidelity model
and then using the solution as a starting point to a high fidelity model. We adopt
an optimization point of view and show how to take advantage of the availability of
a hierarchy of models in a consistent manner. We do not use the low fidelity model
just for the computation of promising starting points but also for the computa-
tion of search directions. We establish the convergence and convergence rate of
the proposed algorithm. Our numerical experiments on large scale image restora-
tion problems and the transition path problem suggest that, for certain classes of
problems, the proposed algorithm is significantly faster than the state of the art.
Date Issued
2017-10-26
Date Acceptance
2017-05-08
Citation
SIAM Journal on Scientific Computing, 2017, 39 (5), pp.S681-S701
ISSN
1095-7197
Publisher
Society for Industrial and Applied Mathematics
Start Page
S681
End Page
S701
Journal / Book Title
SIAM Journal on Scientific Computing
Volume
39
Issue
5
Copyright Statement
© 2017, Society for Industrial and Applied Mathematics under the terms of the Creative Commons 4.0 license
License URL
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Engineering & Physical Science Research Council (E
Grant Number
EP/K040723/1
EP/M028240/1
Subjects
Science & Technology
Physical Sciences
Mathematics, Applied
Mathematics
composite optimization
multigrid
nonsmooth optimization
TRUST-REGION METHOD
NONLINEAR OPTIMIZATION
MULTIGRID METHODS
FRAMEWORK
MODEL
0102 Applied Mathematics
0103 Numerical And Computational Mathematics
0802 Computation Theory And Mathematics
Numerical & Computational Mathematics
Publication Status
Published