Dense 3D face decoding over 2500FPS: joint texture and shape convolutional mesh decoders
File(s)0332_(9).pdf (7.73 MB)
Accepted version
Author(s)
Deng, Jiankang
Zhou, Yuxiang
Kotsia, Irene
Zafeiriou, Stefanos
Type
Conference Paper
Abstract
3D Morphable Models (3DMMs) are statistical modelsthat represent facial texture and shape variations using a setof linear bases and more particular Principal ComponentAnalysis (PCA). 3DMMs were used as statistical priors forreconstructing 3D faces from images by solving non-linearleast square optimization problems. Recently, 3DMMs wereused as generative models for training non-linear mappings(i.e., regressors) from image to the parameters of the modelsvia Deep Convolutional Neural Networks (DCNNs). Nev-ertheless, all of the above methods use either fully con-nected layers or 2D convolutions on parametric unwrappedUV spaces leading to large networks with many parame-ters. In this paper, we present the first, to the best of ourknowledge, non-linear 3DMMs by learning joint textureand shape auto-encoders using direct mesh convolutions.We demonstrate how these auto-encoders can be used totrain very light-weight models that perform Coloured MeshDecoding (CMD) in-the-wild at a speed of over 2500 FPS.
Date Acceptance
2019-03-11
Publisher
IEEE
Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/S010203/1
Source
CVPR 2019
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Theory & Methods
Computer Science
Publication Status
Accepted
Coverage Spatial
California, CA, USA