Automatic recognition of multiple affective states in virtual rehabilitation by exploiting the dependency relationships
File(s)RivasJJ2019_ACII_CameraReady.pdf (4.72 MB)
Accepted version
Author(s)
Joel Rivas, J
Orihuela-Espina, F
Enrique Sucar, L
Williams, A
Bianchi-Berthouze, N
Type
Conference Paper
Abstract
The automatic recognition of multiple affective states can be enhanced if the underpinning computational models explicitly consider the interactions between the states. This work proposes a computational model that incorporates the dependencies between four states (tiredness, anxiety, pain, and engagement)known to appear in virtual rehabilitation sessions of post-stroke patients, to improve the automatic recognition of the patients' states. A dataset of five stroke patients which includes their fingers' pressure (PRE), hand movements (MOV)and facial expressions (FAE)during ten sessions of virtual rehabilitation was used. Our computational proposal uses the Semi-Naive Bayesian classifier (SNBC)as base classifier in a multiresolution approach to create a multimodal model with the three sensors (PRE, MOV, and FAE)with late fusion using SNBC (FSNB classifier). There is a FSNB classifier for each state, and they are linked in a circular classifier chain (CCC)to exploit the dependency relationships between the states. Results of CCC are over 90% of ROC AUC for the four states. Relationships of mutual exclusion between engagement and all the other states and some co-occurrences between pain and anxiety for the five patients were detected. Virtual rehabilitation platforms that incorporate the automatic recognition of multiple patient's states could leverage intelligent and empathic interactions to promote adherence to rehabilitation exercises.
Date Issued
2019-12-09
Date Acceptance
2019-12-01
ISSN
2156-8103
Publisher
IEEE
Start Page
655
End Page
661
Journal / Book Title
2019 8TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII)
Copyright Statement
© 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://ieeexplore.ieee.org/document/8925508
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000522220800106&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Source
8th International Conference on Affective Computing and Intelligent Interaction (ACII)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Information Systems
Engineering, Electrical & Electronic
Computer Science
Engineering
automatic affective states recognition
virtual rehabilitation
multi-label classification
classifier chains
stroke
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Information Systems
Engineering, Electrical & Electronic
Computer Science
Engineering
automatic affective states recognition
virtual rehabilitation
multi-label classification
classifier chains
stroke
Publication Status
Published
Start Date
2019-09-03
Finish Date
2019-09-06
Coverage Spatial
Cambridge, ENGLAND
Date Publish Online
2019-12-09