Dimensional affect recognition from HRV: an approach based on supervised SOM and ELM
File(s)TAC17.pdf (2.37 MB)
Accepted version
Author(s)
Bugnon, Leandro A
Calvo, Rafael A
Milone, Diego H
Type
Journal Article
Abstract
Dimensional affect recognition is a challenging topic and current techniques do not yet provide the accuracy necessary for HCI applications. In this work we propose two new methods. The first is a novel self-organizing model that learns from similarity between features and affects. This method produces a graphical representation of the multidimensional data which may assist the expert analysis. The second method uses extreme learning machines, an emerging artificial neural network model. Aiming for minimum intrusiveness, we use only the heart rate variability, which can be recorded using a small set of sensors. The methods were validated with two datasets. The first is composed of 16 sessions with different participants and was used to evaluate the models in a classification task. The second one was the publicly available Remote Collaborative and Affective Interaction (RECOLA) dataset, which was used for dimensional affect estimation. The performance evaluation used the kappa score, unweighted average recall and the concordance correlation coefficient. The concordance coefficient on the RECOLA test partition was 0.421 in arousal and 0.321 in valence. Results show that our models outperform state-of-the-art models on the same data and provides new ways to analyze affective states.
Date Issued
2020-02-28
Date Acceptance
2017-10-13
Citation
IEEE Transactions on Affective Computing, 2020, 11 (1), pp.32-44
ISSN
1949-3045
Publisher
Institute of Electrical and Electronics Engineers
Start Page
32
End Page
44
Journal / Book Title
IEEE Transactions on Affective Computing
Volume
11
Issue
1
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://ieeexplore.ieee.org/document/8070380
Subjects
0801 Artificial Intelligence and Image Processing
0806 Information Systems
1702 Cognitive Sciences
Publication Status
Published
Date Publish Online
2017-10-17