Image synthesis with a convolutional capsule generative adversarial network
File(s)46_image_synthesis_with_a_convolu.pdf (17.17 MB)
Published version
Author(s)
Type
Conference Paper
Abstract
Machine learning for biomedical imaging often suffers from a lack of labelled training data. One solution is to use generative models to synthesise more data. To this end, we introduce CapsPix2Pix, which combines convolutional capsules with the pix2pix framework, to synthesise images conditioned on class segmentation labels. We apply our approach to a new biomedical dataset of cortical axons imaged by two-photon microscopy, as a method of data augmentation for small datasets. We evaluate performance both qualitatively and quantitatively. Quantitative evaluation is performed by using image data generated by either CapsPix2Pix or pix2pix to train a U-net on a segmentation task, then testing on real microscopy data. Our method quantitatively performs as well as pix2pix, with an order of magnitude fewer parameters. Additionally, CapsPix2Pix is far more capable at synthesising images of different appearance, but the same underlying geometry. Finally, qualitative analysis of the features learned by CapsPix2Pix suggests that individual capsules capture diverse and often semantically meaningful groups of features, covering structures such as synapses, axons and noise.
Date Issued
2019-02-28
Date Acceptance
2019-02-01
Citation
Proceedings of Machine Learning Research, 2019, 102, pp.39-62
Start Page
39
End Page
62
Journal / Book Title
Proceedings of Machine Learning Research
Volume
102
Copyright Statement
© 2019 The Author(s). Creative Commons Attribution license (CC BY 4.0).
License URL
Identifier
https://openreview.net/forum?id=rJen0zC1lE&utm_campaign=piqcy&utm_medium=email&utm_source=Revue%20newsletter
Source
Medical Imaging with Deep Learning
Publication Status
Published
Start Date
2019-07-08
Finish Date
2019-07-10
Coverage Spatial
London, UK
Date Publish Online
2019-02-28