Unobtrusive inference of affective states in virtual rehabilitation from upper limb motions: a feasibility study
File(s)RivasJJ2018b_IEEE-TAC.pdf (6.17 MB)
Accepted version
Author(s)
Type
Journal Article
Abstract
Virtual rehabilitation environments may afford greater patient personalization if they could harness the patient's affective state. Four states: anxiety, pain, engagement and tiredness (either physical or psychological), were hypothesized to be inferable from observable metrics of hand location and gripping strength -relevant for rehabilitation-. Contributions are; (a) multiresolution classifier built from Semi-Naïve Bayesian classifiers, and (b) establishing predictive relations for the considered states from the motor proxies capitalizing on the proposed classifier with recognition levels sufficient for exploitation. 3D hand locations and gripping strength streams were recorded from 5 post-stroke patients whilst undergoing motor rehabilitation therapy administered through virtual rehabilitation along 10 sessions over 4 weeks. Features from the streams characterized the motor dynamics, while spontaneous manifestations of the states were labelled from concomitant videos by experts for supervised classification. The new classifier was compared against baseline support vector machine (SVM) and random forest (RF) with all three exhibiting comparable performances. Inference of the aforementioned states departing from chosen motor surrogates appears feasible, expediting increased personalization of virtual motor neurorehabilitation therapies.
Date Issued
2020-07-01
Date Acceptance
2018-02-01
Citation
IEEE Transactions on Affective Computing, 2020, 11 (3), pp.470-481
ISSN
1949-3045
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
470
End Page
481
Journal / Book Title
IEEE Transactions on Affective Computing
Volume
11
Issue
3
Copyright Statement
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://ieeexplore.ieee.org/document/8295248
Subjects
0801 Artificial Intelligence and Image Processing
0806 Information Systems
1702 Cognitive Sciences
Publication Status
Published
Date Publish Online
2018-02-20