Spontaneous vs. posed facial behavior: automatic analysis of brow actions
File(s)
Accepted version
Author(s)
Valstar, M
Pantic, M
Ambadar, Z
Cohn, J
Type
Conference Paper
Abstract
Past research on automatic facial expression analysis has focused mostly on the recognition of prototypic expressions of discrete emotions rather than on the analysis of dynamic changes over time, although the importance of temporal dynamics of facial expressions for interpretation of the observed facial behavior has been acknowledged for over 20 years. For instance, it has been shown that the temporal dynamics of spontaneous and volitional smiles are fundamentally different from each other. In this work,we argue that the same holds for the temporal dynamics of brow actions and show that velocity, duration, and order of occurrence of brow actions are highly relevant parameters for distinguishing posed from spontaneous brow actions. The proposed system for discrimination between volitional and spontaneous brow actions is based on automatic detection of Action Units (AUs) and their temporal segments (onset, apex, offset) produced by movements of the eyebrows. For each temporal segment of an activated AU, we compute a number of mid-level feature parameters including the maximal intensity, duration, and order of occurrence. We use Gentle Boost to select the most important of these parameters. The selected parameters are used further to train Relevance Vector Machines to determine per temporal segment of an activated AU whether the action was displayed spontaneously or volitionally. Finally, a probabilistic decision function determines the class (spontaneous or posed) for the entire brow action. When tested on 189 samples taken from three different sets of spontaneous and volitional facial data, we attain a 90.7% correct recognition rate.
Date Issued
2006-11
Citation
8th International Conference Proceedings on Multimodal interfaces, 2006, pp.162-170
ISBN
1-59593-541-X
Publisher
ACM
Source Title
ACM International conference on Multimodal Interfaces
Conference
8th International Conference Proceedings on Multimodal interfaces
Start Page
162
End Page
170
Journal / Book Title
8th International Conference Proceedings on Multimodal interfaces
Copyright Statement
© ACM, 2006. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES, (2006) http://doi.acm.org/10.1145/1180995.1181031
Identifier
http://www.acm.org/icmi/2006/
Source
ACM International conference on Multimodal Interfaces
Source Place
Alberto, Canada
Start Date
2006-11-02
Finish Date
2006-11-04
Coverage Spatial
Alberto, Canada