Efficient binary classification through energy minimization of slack variables
File(s)Neurocomputing_2014_Margarita_Kotti.pdf (483.74 KB)
Accepted version
Author(s)
Kotti, M
Diamantaras, K
Type
Journal Article
Abstract
Slack variables are utilized in optimisation problems in order to build soft margin classifiers that allow for more flexibility during training. A robust binary classification algorithm that is based on the minimisation of the energy of slack variables, called the Mean Squared Slack (MSS), is proposed in this paper. Initially, the algorithm is analysed for the linear case, where the minimum mean squared slack is attained as a separating vector. Next, the kernel trick is exploited to facilitate computation of non-linear separating hyperplanes. For this paper, two kernels are tested, namely the radial basis function (RBF) and the polynomial kernel. In order to ensure a time and memory efficient system that converges in a few iterations four strategies are applied so as to withhold just a subset of feature vectors that are misclassified during training. Aiming to the automatic optimisation of the kernel parameters a modern combination of particle swarm optimisation (PSO) with artificial immune system (AIS) is tested. The aforementioned evolutionary methods are combined in a parallel architecture. Four datasets of diverse nature are exploited for performance evaluation, namely the iris, the SPECTheart, the vertebral column, and the wine quality datasets. Simulation experiments demonstrate high classification accuracy in a number of benchmark datasets.
Date Issued
2015-01-19
Date Acceptance
2014-07-06
Citation
Neurocomputing, 2015, 148, pp.498-511
ISSN
1872-8286
Publisher
Elsevier
Start Page
498
End Page
511
Journal / Book Title
Neurocomputing
Volume
148
Copyright Statement
© 2014 Elsevier B.V. All rights reserved. NOTICE: this is the author’s version of a work that was accepted for publication in Neurocomputing. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in NEUROCOMPUTING, Vol.: 148, (2015) DOI: 10.1016/j.neucom.2014.07.013
Description
28.10.14 KB. Ok to add accepted version to spiral, subject to 12 months embargo
Identifier
S0925-2312(14)00891-1
Source Volume Number
148
Publication Status
Published