The brain strategy for online learning
File(s)globalsip_2016.pdf (768.74 KB)
Accepted version
Author(s)
Vlaski, Stefan
Ying, Bicheng
Sayed, Ali H
Type
Conference Paper
Abstract
Complexity is a double-edged sword for learning algorithms when the number of available samples for training in relation to the dimension of the feature space is small. This is because simple models do not sufficiently capture the nuances of the data set, while complex models overfit. While remedies such as regularization and dimensionality reduction exist, they themselves can suffer from overfitting or introduce bias. To address the issue of overfitting, the incorporation of prior structural knowledge is generally of paramount importance. In this work, we propose a BRAIN strategy for learning, which enhances the performance of traditional algorithms, such as logistic regression and SVM learners, by incorporating a graphical layer that tracks and learns in real-time the underlying correlation structure among feature subspaces. In this way, the algorithm is able to identify salient subspaces and their correlations, while simultaneously dampening the effect of irrelevant features. This effect is particularly useful for high-dimensional feature spaces.
Date Issued
2017-04-24
Date Acceptance
2016-12-01
Citation
2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2017, pp.1285-1289
ISSN
2376-4066
Publisher
IEEE
Start Page
1285
End Page
1289
Journal / Book Title
2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Copyright Statement
Copyright © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000672803000257&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Subjects
correlation
Engineering
Engineering, Electrical & Electronic
high-dimensional feature space
Online learning
Science & Technology
stochastic gradient learning
Technology
Publication Status
Published
Start Date
2016-12-07
Finish Date
2016-12-09
Coverage Spatial
Washington, DC, USA