Dealing with a missing sensor in a multilabel and multimodal automatic affective states recognition system
File(s)
Author(s)
Joel Rivas, Jesus
Orihuela-Espina, Felipe
Enrique Sucar, Luis
Bianchi-Berthouze, Nadia
Type
Conference Paper
Abstract
Data from multiple sensors can boost the automatic recognition of multiple affective states in a multilabel and multimodal recognition system. At any time, the streaming from any of the contributing sensors can be missing. This work proposes a method for dealing with a missing sensor in a multilabel and multimodal automatic affective states recognition system. The proposed method, called Hot Deck using Conditional Probability Tables (HD-CPT), is incorporated into a multimodal affective state recognition system for compensating the loss of a sensor using the recorded historical information of the sensor and its interaction with the other available sensors. In this work, we consider a multilabel classifier, named Circular Classifier Chain, for the automatic recognition of four states: tiredness, anxiety, pain, and engagement; combined with a multimodal classifier based on three sensors: fingers pressure, hand movements, and facial expressions; which was adapted for coping with the problem of a missing sensor in a virtual rehabilitation platform for post-stroke patients. A dataset of five post-stroke patients who attended ten longitudinal rehabilitation sessions was used for the evaluation. The inclusion of HD-CPT compensated for the loss of one sensor with results above those obtained with only the remaining sensors available. HD-CPT prevents the system from collapsing when a sensor fails, providing continuity of operation with results that attenuate the loss of the sensor. The proposed method HD-CPT can provide robustness for the naturalistic everyday use of an affective states recognition system.
Date Issued
2021-11-15
Date Acceptance
2021-09-01
Citation
2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII), 2021, pp.1-8
ISSN
2156-8103
Publisher
IEEE
Start Page
1
End Page
8
Journal / Book Title
2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII)
Copyright Statement
Copyright © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000794285700055&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
9th International Conference on Affective Computing and Intelligent Interaction (ACII)
Subjects
automatic affective states recognition
classifier chains
Computer Science
Computer Science, Artificial Intelligence
Computer Science, Cybernetics
Computer Science, Information Systems
Computer Science, Interdisciplinary Applications
facial expressions
fingers pressure
hand movements
missing sensor
multilabel classification
multimodal classification
Science & Technology
Technology
virtual rehabilitation
Publication Status
Published
Start Date
2021-09-28
Finish Date
2021-10-01
Coverage Spatial
Nara, Japan
Date Publish Online
2021-11-15