Robust statistical frontalization of human and animal faces
File(s)sagonas2016rsf.pdf (6.43 MB)
Published version
Author(s)
Sagonas, C
Panagakis, Y
Zafeiriou, S
Pantic, M
Type
Journal Article
Abstract
The unconstrained acquisition of facial data in real-world conditions may result in face images with significant pose variations, illumination changes, and occlusions, affecting the performance of facial landmark localization and recognition methods. In this paper, a novel method, robust to pose, illumination variations, and occlusions is proposed for joint face frontalization and landmark localization. Unlike the state-of-the-art methods for landmark localization and pose correction, where large amount of manually annotated images or 3D facial models are required, the proposed method relies on a small set of frontal images only. By observing that the frontal facial image of both humans and animals, is the one having the minimum rank of all different poses, a model which is able to jointly recover the frontalized version of the face as well as the facial landmarks is devised. To this end, a suitable optimization problem is solved, concerning minimization of the nuclear norm (convex surrogate of the rank function) and the matrix (Formula presented.) norm accounting for occlusions. The proposed method is assessed in frontal view reconstruction of human and animal faces, landmark localization, pose-invariant face recognition, face verification in unconstrained conditions, and video inpainting by conducting experiment on 9 databases. The experimental results demonstrate the effectiveness of the proposed method in comparison to the state-of-the-art methods for the target problems.
Date Issued
2016-07-20
Date Acceptance
2016-05-26
Citation
International Journal of Computer Vision, 2016, 122 (2), pp.270-291
ISSN
0920-5691
Publisher
Springer Verlag
Start Page
270
End Page
291
Journal / Book Title
International Journal of Computer Vision
Volume
122
Issue
2
Copyright Statement
© The Author(s) 2016. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
License URL
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/J017787/1
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science
Pose normalization
Landmark localization
Face recognition
Low rank
Sparsity
COMPONENT ANALYSIS
RECOGNITION
ALIGNMENT
WILD
VERIFICATION
SYSTEMS
0801 Artificial Intelligence And Image Processing
Artificial Intelligence & Image Processing
Publication Status
Published