Learning the multilinear structure of visual data
File(s)1914 (2).pdf (1.22 MB)
Accepted version
Author(s)
Wang, M
Panagakis, Y
Snape, P
Zafeiriou, S
Type
Conference Paper
Abstract
Statistical decomposition methods are of paramount im-
portance in discovering the modes of variations of visual
data. Probably the most prominent linear decomposition
method is the Principal Component Analysis (PCA), which
discovers a single mode of variation in the data. However,
in practice, visual data exhibit several modes of variations.
For instance, the appearance of faces varies in identity, ex-
pression, pose etc. To extract these modes of variations from
visual data, several supervised methods, such as the Ten-
sorFaces, that rely on multilinear (tensor) decomposition
(e.g., Higher Order SVD) have been developed. The main
drawbacks of such methods is that they require both labels
regarding the modes of variations and the same number of
samples under all modes of variations (e.g., the same face
under different expressions, poses etc.). Therefore, their ap-
plicability is limited to well-organised data, usually cap-
tured in well-controlled conditions. In this paper, we pro-
pose the first general multilinear method, to the best of our
knowledge, that discovers the multilinear structure of visual
data in unsupervised setting. That is, without the presence
of labels. We demonstrate the applicability of the proposed
method in two applications, namely Shape from Shading
(SfS) and expression transfer.
portance in discovering the modes of variations of visual
data. Probably the most prominent linear decomposition
method is the Principal Component Analysis (PCA), which
discovers a single mode of variation in the data. However,
in practice, visual data exhibit several modes of variations.
For instance, the appearance of faces varies in identity, ex-
pression, pose etc. To extract these modes of variations from
visual data, several supervised methods, such as the Ten-
sorFaces, that rely on multilinear (tensor) decomposition
(e.g., Higher Order SVD) have been developed. The main
drawbacks of such methods is that they require both labels
regarding the modes of variations and the same number of
samples under all modes of variations (e.g., the same face
under different expressions, poses etc.). Therefore, their ap-
plicability is limited to well-organised data, usually cap-
tured in well-controlled conditions. In this paper, we pro-
pose the first general multilinear method, to the best of our
knowledge, that discovers the multilinear structure of visual
data in unsupervised setting. That is, without the presence
of labels. We demonstrate the applicability of the proposed
method in two applications, namely Shape from Shading
(SfS) and expression transfer.
Date Issued
2017-11-09
Date Acceptance
2017-03-03
Citation
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp.6053-6061
Publisher
IEEE
Start Page
6053
End Page
6061
Journal / Book Title
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Copyright Statement
© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
Grant Number
EP/N007743/1
Source
2017 IEEE International Conference on Computer Vision and Pattern Recognition
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Theory & Methods
Engineering, Electrical & Electronic
Computer Science
Engineering
EXPRESSION DATABASE
PHOTOMETRIC STEREO
ALGORITHMS
SHAPE
Publication Status
Published
Start Date
2017-07-21
Finish Date
2017-07-26
Coverage Spatial
Hawaii, USA
Date Publish Online
2017-11-09