Face flow
File(s)0012.pdf (1.87 MB)
Accepted version
Author(s)
Snape, P
Roussos, A
Panagakis, Y
Zafeiriou, S
Type
Conference Paper
Abstract
In this paper, we propose a method for the robust and efficient computation of multi-frame optical flow in an expressive sequence of facial images. We formulate a novel energy minimisation problem for establishing dense correspondences between a neutral template and every frame of a sequence. We exploit the highly correlated nature of human expressions by representing dense facial motion using a deformation basis. Furthermore, we exploit the even higher correlation between deformations in a given input sequence by imposing a low-rank prior on the coefficients of the deformation basis, yielding temporally consistent optical flow. Our proposed model-based formulation, in conjunction with the inverse compositional strategy and low-rank matrix optimisation that we adopt, leads to a highly efficient algorithm for calculating facial flow. As experimental evaluation, we show quantitative experiments on a challenging novel benchmark of face sequences, with dense ground truth optical flow provided by motion capture data. We also provide qualitative results on a real sequence displaying fast motion and occlusions. Extensive quantitative and qualitative comparisons demonstrate that the proposed method outperforms state-of-the-art optical flow and dense non-rigid registration techniques, whilst running an order of magnitude faster.
Date Issued
2015-12-07
Date Acceptance
2015-12-01
Citation
Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), 2015, pp.2993-3001
ISBN
9781467383912
ISSN
1550-5499
Publisher
IEEE
Start Page
2993
End Page
3001
Journal / Book Title
Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV)
Copyright Statement
© 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/J017787/1
EP/L026813/1
Source
2015 IEEE International Conference on Computer Vision (ICCV)
Publication Status
Published
Start Date
2015-12-07
Finish Date
2015-12-13
Coverage Spatial
Santiago, Chile