Repository logo
  • Log In
    Log in via Symplectic to deposit your publication(s).
Repository logo
  • Communities & Collections
  • Research Outputs
  • Statistics
  • Log In
    Log in via Symplectic to deposit your publication(s).
  1. Home
  2. Faculty of Engineering
  3. Computing
  4. Computing
  5. UV-GAN: Adversarial facial UV map completion for pose-invariant face recognition
 
  • Details
UV-GAN: Adversarial facial UV map completion for pose-invariant face recognition
File(s)
Deng_UV-GAN_Adversarial_Facial_CVPR_2018_paper.pdf (1.72 MB)
Accepted version
Author(s)
Deng, Jiankang
Cheng, Shiyang
Xue, Niannan
Zhou, Yuxiang
Zafeiriou, Stefanos
Type
Conference Paper
Abstract
Recently proposed robust 3D face alignment methods establish either dense or sparse correspondence between a 3D face model and a 2D facial image. The use of these methods presents new challenges as well as opportunities for facial texture analysis. In particular, by sampling the image using the fitted model, a facial UV can be created. Unfortunately, due to self-occlusion, such a UV map is always incomplete. In this paper, we propose a framework for training Deep Convolutional Neural Network (DCNN) to complete the facial UV map extracted from in-the-wild images. To this end, we first gather complete UV maps by fitting a 3D Morphable Model (3DMM) to various multiview image and video datasets, as well as leveraging on a new 3D dataset with over 3,000 identities. Second, we devise a meticulously designed architecture that combines local and global adversarial DCNNs to learn an identity-preserving facial UV completion model. We demonstrate that by attaching the completed UV to the fitted mesh and generating instances of arbitrary poses, we can increase pose variations for training deep face recognition/verification models, and minimise pose discrepancy during testing, which lead to better performance. Experiments on both controlled and in-the-wild UV datasets prove the effectiveness of our adversarial UV completion model. We achieve state-of-the-art verification accuracy, 94.05%, under the CFP frontal-profile protocol only by combining pose augmentation during training and pose discrepancy reduction during testing. We will release the first in-the-wild UV dataset (we refer as WildUV) that comprises of complete facial UV maps from 1,892 identities for research purposes.
Date Issued
2018-12-17
Date Acceptance
2018-03-04
Citation
2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2018, pp.7093-7102
URI
http://hdl.handle.net/10044/1/71260
DOI
https://www.dx.doi.org/10.1109/CVPR.2018.00741
ISBN
9781538664209
ISSN
1063-6919
Publisher
IEEE
Start Page
7093
End Page
7102
Journal / Book Title
2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR)
Copyright Statement
© 2018 IEEE.
Sponsor
Engineering & Physical Science Research Council (E
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000457843607026&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
EP/N007743/1
Source
31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science
Publication Status
Published
Start Date
2018-06-18
Finish Date
2018-06-23
Coverage Spatial
Salt Lake City, UT, United States
Date Publish Online
2018-12-17
About
Spiral Depositing with Spiral Publishing with Spiral Symplectic
Contact us
Open access team Report an issue
Other Services
Scholarly Communications Library Services
logo

Imperial College London

South Kensington Campus

London SW7 2AZ, UK

tel: +44 (0)20 7589 5111

Accessibility Modern slavery statement Cookie Policy

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback