Gradient projection newton algorithm for sparse collaborative learning using synthetic and real datasets of applications
File(s)2108.06605v1.pdf (575.47 KB)
Working paper
Author(s)
Sun, Jun
Kong, Lingchen
Zhou, Shenglong
Type
Working Paper
Abstract
Exploring the relationship among multiple sets of data from one same group
enables practitioners to make better decisions in medical science and
engineering. In this paper, we propose a sparse collaborative learning (SCL)
model, an optimization with double-sparsity constraints, to process the problem
with two sets of data and a shared response variable. It is capable of dealing
with the classification problems or the regression problems dependent on the
discreteness of the response variable as well as exploring the relationship
between two datasets simultaneously. To solve SCL, we first present some
necessary and sufficient optimality conditions and then design a gradient
projection Newton algorithm which has proven to converge to a unique locally
optimal solution globally with at least a quadratic convergence rate. Finally,
the reported numerical experiments illustrate the efficiency of the proposed
method.
enables practitioners to make better decisions in medical science and
engineering. In this paper, we propose a sparse collaborative learning (SCL)
model, an optimization with double-sparsity constraints, to process the problem
with two sets of data and a shared response variable. It is capable of dealing
with the classification problems or the regression problems dependent on the
discreteness of the response variable as well as exploring the relationship
between two datasets simultaneously. To solve SCL, we first present some
necessary and sufficient optimality conditions and then design a gradient
projection Newton algorithm which has proven to converge to a unique locally
optimal solution globally with at least a quadratic convergence rate. Finally,
the reported numerical experiments illustrate the efficiency of the proposed
method.
Date Issued
2022-10-29
Date Acceptance
2022-10-29
Citation
Journal of Computational and Applied Mathematics, 2022, 422 (114872), pp.1-20
Publisher
Elsevier
Start Page
1
End Page
20
Journal / Book Title
Journal of Computational and Applied Mathematics
Volume
422
Issue
114872
Copyright Statement
© 2021 The Author(s).
Identifier
http://arxiv.org/abs/2108.06605v1
Subjects
math.OC
math.OC
Publication Status
Published