RetinaFace: Single-shot multi-level face localisation in the wild
Author(s)
Deng, Jiankang
Guo, Jia
Ververas, Evangelos
Kotsia, Irene
Zafeiriou, Stefanos
Type
Conference Paper
Abstract
Though tremendous strides have been made in uncontrolled face detection, accurate and efficient 2D face alignment and 3D face reconstruction in-the-wild remain an open challenge. In this paper, we present a novel single-shot, multi-level face localisation method, named RetinaFace, which unifies face box prediction, 2D facial landmark localisation and 3D vertices regression under one common target: point regression on the image plane. To fill the data gap, we manually annotated five facial landmarks on the WIDER FACE dataset and employed a semi-automatic annotation pipeline to generate 3D vertices for face images from the WIDER FACE, AFLW and FDDB datasets. Based on extra annotations, we propose a mutually beneficial regression target for 3D face reconstruction, that is predicting 3D vertices projected on the image plane constrained by a common 3D topology. The proposed 3D face reconstruction branch can be easily incorporated, without any optimisation difficulty, in parallel with the existing box and 2D landmark regression branches during joint training. Extensive experimental results show that RetinaFace can simultaneously achieve stable face detection, accurate 2D face alignment and robust 3D face reconstruction while being efficient through single-shot inference.
Date Issued
2020-08-05
Date Acceptance
2020-06-14
Citation
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp.5202-5211
ISSN
1063-6919
Publisher
IEEE
Start Page
5202
End Page
5211
Journal / Book Title
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Copyright Statement
© 2020 IEEE. This ICCV workshop paper is the Open Access version, provided by the Computer Vision Foundation. Except for the watermark, it is identical to the accepted version; the final published version of the proceedings is available on IEEE Xplore..
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000620679505048&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Subjects
Computer Science
Computer Science, Artificial Intelligence
Science & Technology
Technology
Publication Status
Published
Start Date
2020-06-14
Finish Date
2020-06-19
Coverage Spatial
Seattle, WA, USA (Virtual)