Gradient projection newton pursuit for sparsity constrained optimization
File(s)2205.04580v1.pdf (1.65 MB)
Working Paper
Author(s)
Zhou, Shenglong
Type
Working Paper
Abstract
Hard-thresholding-based algorithms have seen various advantages for sparse optimization in controlling the sparsity and allowing for fast computation. Recent research shows that when techniques of the Newton-type methods are integrated, their numerical performance can be improved surprisingly. This paper develops a gradient projection Newton pursuit algorithm that mainly adopts the hard-thresholding operator and employs the Newton pursuit only when certain conditions are satisfied. The proposed algorithm is capable of converging globally and quadratically under the standard assumptions. When it comes to compressive sensing problems, the imposed assumptions are much weaker than those for many state-of-the-art algorithms. Moreover, extensive numerical experiments have demonstrated its high performance in comparison with the other leading solvers.
Date Issued
2022-05-22
Date Acceptance
2022-06-08
Citation
Applied and Computational Harmonic Analysis, 61, pp.75-100
Publisher
ArXiv
Start Page
75
End Page
100
Journal / Book Title
Applied and Computational Harmonic Analysis
Volume
61
Copyright Statement
©2022 The Author(s)
Identifier
http://arxiv.org/abs/2205.04580v3
Subjects
math.OC
math.OC
Publication Status
Published
Date Publish Online
2022-06-20