GAGAN: geometry-aware generative adversarial networks
File(s)1712.00684v3.pdf (4.64 MB)
Accepted version
Author(s)
Kossaifi, Jean
Linh, Tran
Panagakis, Yannis
Pantic, Maja
Type
Journal Article
Abstract
Deep generative models learned through adversarial training have become increasingly popular for their ability to generate naturalistic image textures. However, aside from their texture, the visual appearance of objects is significantly influenced by their shape geometry; information which is not taken into account by existing generative models. This paper introduces the Geometry-Aware Generative Adversarial Networks (GAGAN) for incorporating geometric information into the image generation process. Specifically, in GAGAN the generator samples latent variables from the probability space of a statistical shape model. By mapping the output of the generator to a canonical coordinate frame through a differentiable geometric transformation, we enforce the geometry of the objects and add an implicit connection from the prior to the generated object. Experimental results on face generation indicate that the GAGAN can generate realistic images of faces with arbitrary facial attributes such as facial expression, pose, and morphology, that are of better quality than current GAN-based methods. Our method can be used to augment any existing GAN architecture and improve the quality of the images generated.
Date Issued
2018-12-17
Date Acceptance
2018-06-18
Citation
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp.878-887
ISSN
1063-6919
Publisher
IEEE
Start Page
878
End Page
887
Journal / Book Title
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Copyright Statement
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Commission of the European Communities
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000457843601001&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
688835
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science
ACTIVE APPEARANCE MODELS
SCALE
Publication Status
Published
Coverage Spatial
Salt Lake City, UT
Date Publish Online
2018-12-17