Morpho-MNIST: Quantitative Assessment and Diagnostics for Representation Learning

File Description SizeFormat 
1809.10780v1.pdfWorking paper3.75 MBAdobe PDFView/Open
Title: Morpho-MNIST: Quantitative Assessment and Diagnostics for Representation Learning
Authors: Castro, DC
Tan, J
Kainz, B
Konukoglu, E
Glocker, B
Item Type: Working Paper
Abstract: Revealing latent structure in data is an active field of research, having brought exciting new models such as variational autoencoders and generative adversarial networks, and is essential to push machine learning towards unsupervised knowledge discovery. However, a major challenge is the lack of suitable benchmarks for an objective and quantitative evaluation of learned representations. To address this issue we introduce Morpho-MNIST. We extend the popular MNIST dataset by adding a morphometric analysis enabling quantitative comparison of different models, identification of the roles of latent variables, and characterisation of sample diversity. We further propose a set of quantifiable perturbations to assess the performance of unsupervised and supervised methods on challenging tasks such as outlier detection and domain adaptation.
Issue Date: 31-Dec-2018
Copyright Statement: © 2018 The Author(s).
Sponsor/Funder: Commission of the European Communities
Funder's Grant Number: H2020 - 757173
Keywords: cs.LG
Appears in Collections:Faculty of Engineering

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx