Combining 3D morphable models: a large-scale face-and-head model
File(s)1903.03785.pdf (8.36 MB)
Accepted version
Author(s)
Ploumpis, Stylianos
Wang, Haoyang
Pears, Nick
Smith, Will
Zafeiriou, Stefanos
Type
Conference Paper
Abstract
Three-dimensional Morphable Models (3DMMs) are
powerful statistical tools for representing the 3D surfaces
of an object class. In this context, we identify an interesting
question that has previously not received research attention:
is it possible to combine two or more 3DMMs that (a) are
built using different templates that perhaps only partly overlap,
(b) have different representation capabilities and (c)
are built from different datasets that may not be publiclyavailable?
In answering this question, we make two contributions.
First, we propose two methods for solving this
problem: i. use a regressor to complete missing parts of
one model using the other, ii. use the Gaussian Process
framework to blend covariance matrices from multiple models.
Second, as an example application of our approach,
we build a new face-and-head shape model that combines
the variability and facial detail of the LSFM with the full
head modelling of the LYHM. The resulting combined shape
model achieves state-of-the-art performance and outperforms
existing head models by a large margin. Finally, as an
application experiment, we reconstruct full head representations
from single, unconstrained images by utilizing our
proposed large-scale model in conjunction with the Face-
Warehouse blendshapes for handling expressions.
powerful statistical tools for representing the 3D surfaces
of an object class. In this context, we identify an interesting
question that has previously not received research attention:
is it possible to combine two or more 3DMMs that (a) are
built using different templates that perhaps only partly overlap,
(b) have different representation capabilities and (c)
are built from different datasets that may not be publiclyavailable?
In answering this question, we make two contributions.
First, we propose two methods for solving this
problem: i. use a regressor to complete missing parts of
one model using the other, ii. use the Gaussian Process
framework to blend covariance matrices from multiple models.
Second, as an example application of our approach,
we build a new face-and-head shape model that combines
the variability and facial detail of the LSFM with the full
head modelling of the LYHM. The resulting combined shape
model achieves state-of-the-art performance and outperforms
existing head models by a large margin. Finally, as an
application experiment, we reconstruct full head representations
from single, unconstrained images by utilizing our
proposed large-scale model in conjunction with the Face-
Warehouse blendshapes for handling expressions.
Date Acceptance
2019-03-11
Publisher
IEEE
Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/N007743/1
EP/S010203/1
Source
CVPR 2019
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Theory & Methods
Computer Science
cs.CV
cs.CV
Publication Status
Accepted
Start Date
2019-06-16
Finish Date
2019-06-20
Coverage Spatial
California, CA, USA