Denoising adversarial autoencoders
File(s)DAAE-As-Accepted-NoHL.pdf (1.8 MB)
Accepted version
Author(s)
Creswell, Antonia
Bharath, Anil Anthony
Type
Journal Article
Abstract
Unsupervised learning is of growing interest because it unlocks the potential held in vast amounts of unlabeled data to learn useful representations for inference. Autoencoders, a form of generative model, may be trained by learning to reconstruct unlabeled input data from a latent representation space. More robust representations may be produced by an autoencoder if it learns to recover clean input samples from corrupted ones. Representations may be further improved by introducing regularization during training to shape the distribution of the encoded data in the latent space. We suggest denoising adversarial autoencoders (AAEs), which combine denoising and regularization, shaping the distribution of latent space using adversarial training. We introduce a novel analysis that shows how denoising may be incorporated into the training and sampling of AAEs. Experiments are performed to assess the contributions that denoising makes to the learning of representations for classification and sample synthesis. Our results suggest that autoencoders trained using a denoising criterion achieve higher classification performance and can synthesize samples that are more consistent with the input data than those trained without a corruption process.
Date Issued
2019-04-01
Date Acceptance
2018-06-25
Citation
IEEE Transactions on Neural Networks and Learning Systems, 2019, 30 (4), pp.968-984
ISSN
2162-2388
Publisher
Institute of Electrical and Electronics Engineers
Start Page
968
End Page
984
Journal / Book Title
IEEE Transactions on Neural Networks and Learning Systems
Volume
30
Issue
4
Copyright Statement
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://arxiv.org/abs/1703.01220v4
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Hardware & Architecture
Computer Science, Theory & Methods
Engineering, Electrical & Electronic
Computer Science
Engineering
Image analysis
pattern recognition
semisupervised learning
unsupervised learning
cs.CV
cs.CV
cs.LG
stat.ML
Artificial Intelligence & Image Processing
Publication Status
Published
Date Publish Online
2018-08-16