Assessing cognitive workload using cardiovascular measures and voice
File(s)sensors-22-06894.pdf (512.56 KB)
Published version
Author(s)
Magnusdottir, Eydis H
Johannsdottir, Kamilla R
Majumdar, Arnab
Gudnason, Jon
Type
Journal Article
Abstract
Monitoring cognitive workload has the potential to improve both the performance and fidelity of human decision making. However, previous efforts towards discriminating further than binary levels (e.g., low/high or neutral/high) in cognitive workload classification have not been successful. This lack of sensitivity in cognitive workload measurements might be due to individual differences as well as inadequate methodology used to analyse the measured signal. In this paper, a method that combines the speech signal with cardiovascular measurements for screen and heartbeat classification is introduced. For validation, speech and cardiovascular signals from 97 university participants and 20 airline pilot participants were collected while cognitive stimuli of varying difficulty level were induced with the Stroop colour/word test. For the trinary classification scheme (low, medium, high cognitive workload) the prominent result using classifiers trained on each participant achieved 15.17 ± 0.79% and 17.38 ± 1.85% average misclassification rates indicating good discrimination at three levels of cognitive workload. Combining cardiovascular and speech measures synchronized to each heartbeat and consolidated with short-term dynamic measures might therefore provide enhanced sensitivity in cognitive workload monitoring. The results show that the influence of individual differences is a limiting factor for a generic classification and highlights the need for research to focus on methods that incorporate individual differences to achieve even better results. This method can potentially be used to measure and monitor workload in real time in operational environments.
Date Issued
2022-09-13
Date Acceptance
2022-09-05
Citation
Sensors, 2022, 22 (18), pp.1-17
ISSN
1424-8220
Publisher
MDPI AG
Start Page
1
End Page
17
Journal / Book Title
Sensors
Volume
22
Issue
18
Copyright Statement
© 2022 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
License URL
Identifier
https://www.mdpi.com/1424-8220/22/18/6894
Subjects
0301 Analytical Chemistry
0805 Distributed Computing
0906 Electrical and Electronic Engineering
0502 Environmental Science and Management
0602 Ecology
Analytical Chemistry
Publication Status
Published
Date Publish Online
2022-09-13