MimicME: a large scale diverse 4D database for facial expression analysis
File(s)136680457.pdf (8.24 MB)
Accepted version
Author(s)
Type
Conference Paper
Abstract
Recently, Deep Neural Networks (DNNs) have been shown to outperform traditional methods in many disciplines such as computer vision, speech recognition and natural language processing. A prerequisite for the successful application of DNNs is the big number of data. Even though various facial datasets exist for the case of 2D images, there is a remarkable absence of datasets when we have to deal with 3D faces. The available facial datasets are limited either in terms of expressions or in the number of subjects. This lack of large datasets hinders the exploitation of the great advances that DNNs can provide. In this paper, we overcome these limitations by introducing MimicMe, a novel large-scale database of dynamic high-resolution 3D faces. MimicMe contains recordings of 4, 700 subjects with a great diversity on age, gender and ethnicity. The recordings are in the form of 4D videos of subjects displaying a multitude of facial behaviours, resulting to over 280, 000 3D meshes in total. We have also manually annotated a big portion of these meshes with 3D facial landmarks and they have been categorized in the corresponding expressions. We have also built very powerful blendshapes for parameterising facial behaviour. MimicMe will be made publicly available upon publication and we envision that it will be extremely valuable to researchers working in many problems of face modelling and analysis, including 3D/4D face and facial expression recognition. We conduct several experiments and demonstrate the usefulness of the database for various applications. (https://github.com/apapaion/mimicme)
Editor(s)
Avidan, S
Brostow, G
Cisse, M
Farinella, GM
Hassner, T
Date Issued
2022-11-12
Date Acceptance
2022-10-23
Citation
Computer Vision – ECCV 2022, 2022, 13668, pp.467-484
ISBN
978-3-031-20073-1
ISSN
0302-9743
Publisher
Springer International Publishing AG
Start Page
467
End Page
484
Journal / Book Title
Computer Vision – ECCV 2022
Volume
13668
Copyright Statement
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG. This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://dx.doi.org/10.1007/978-3-031-20074-8_27
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000897111300027&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
17th European Conference on Computer Vision (ECCV)
Subjects
3D
Computer Science
Computer Science, Artificial Intelligence
FACES
Imaging Science & Photographic Technology
Science & Technology
Technology
Publication Status
Published
Start Date
2022-10-23
Finish Date
2022-10-27
Coverage Spatial
Tel Aviv, Israel
Date Publish Online
2022-11-12