Annealing genetic GAN for imbalanced web data learning
File(s)FINAL_VERSION.pdf (6.75 MB)
Accepted version
Author(s)
Type
Journal Article
Abstract
Class imbalance is one of the most basic and important problems of web data. The key to overcoming the class imbalance problems is to increase the effective instances of the minority, that is, data augmentation. Generative Adversarial Networks (GANs), which have recently been successfully applied in the field of image generation, can be used for data augmentation because they can learn the data distribution given ample training data instances and generate more data. However, learning the distributions from the imbalanced data can make GANs easily get stuck in a local optimum. In this work, we propose a new training strategy called Annealing Genetic GAN (AGGAN), which incorporates simulated annealing genetic algorithm into the training process of GANs. And this can help GANs avoid the local optimum trapping problem, which easily occurs when the training set is imbalanced. Unlike existing GANs, which use a fixed adversarial learning objective alternately training a generator, we use multiple adversarial learning objectives to train a set of generators and use the Metropolis criterion in simulated annealing to decide whether the generator should update. More specifically, the Metropolis criterion accepts worse solutions with a certain probability, so it can make our AGGAN escape from the local optimum and find a better solution. Theory and mathematical analysis provide strong theoretical support for the proposed training strategy. And experiments on several datasets demonstrate that AGGAN achieves convincing ability to solve the class imbalanced problem and reduces the training problems inherent in existing GANs.
Date Issued
2022-01-01
Date Acceptance
2021-10-15
Citation
IEEE Transactions on Multimedia, 2022, 24, pp.1164-1174
ISSN
1520-9210
Publisher
Institute of Electrical and Electronics Engineers
Start Page
1164
End Page
1174
Journal / Book Title
IEEE Transactions on Multimedia
Volume
24
Copyright Statement
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
British Heart Foundation
European Research Council Horizon 2020
Commission of the European Communities
Innovative Medicines Initiative
Boehringer Ingelheim Ltd
Medical Research Council (MRC)
Identifier
https://ieeexplore.ieee.org/document/9576579
Grant Number
PG/16/78/32402
H2020-SC1-FA-DTS-2019-1 952172
101005122
101005122
PO:4700244755 Study:1199-0457
MR/V023799/1
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Computer Science, Software Engineering
Telecommunications
Computer Science
Training
Generators
Genetic algorithms
Annealing
Simulated annealing
Generative adversarial networks
Optimization
Class imbalance problem
evolutionary computation
data augmentation
CLASSIFICATION
ALGORITHMS
SMOTE
Artificial Intelligence & Image Processing
08 Information and Computing Sciences
09 Engineering
Publication Status
Published
Date Publish Online
2021-10-15