Quantifying the alignment of graph and features in deep learning
File(s)GCN_Yifan_TNNLS_Final_with_SI.pdf (9.44 MB)
Accepted version
Author(s)
Qian, Yifan
Expert, Paul
Rieu, Tom
Panzarasa, Pietro
Barahona, Mauricio
Type
Journal Article
Abstract
We show that the classification performance of graph convolutional networks (GCNs) is related to the alignment between features, graph, and ground truth, which we quantify using a subspace alignment measure (SAM) corresponding to the Frobenius norm of the matrix of pairwise chordal distances between three subspaces associated with features, graph, and ground truth. The proposed measure is based on the principal angles between subspaces and has both spectral and geometrical interpretations. We showcase the relationship between the SAM and the classification performance through the study of limiting cases of GCNs and systematic randomizations of both features and graph structure applied to a constructive example and several examples of citation networks of different origins. The analysis also reveals the relative importance of the graph and features for classification purposes.
Date Issued
2022-04-01
Date Acceptance
2020-11-25
Citation
IEEE Transactions on Neural Networks and Learning Systems, 2022, 33 (4), pp.1663-1672
ISSN
1045-9227
Publisher
Institute of Electrical and Electronics Engineers
Start Page
1663
End Page
1672
Journal / Book Title
IEEE Transactions on Neural Networks and Learning Systems
Volume
33
Issue
4
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/N014529/1
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science, Hardware & Architecture
Computer Science, Theory & Methods
Engineering, Electrical & Electronic
Computer Science
Engineering
Symmetric matrices
Deep learning
Task analysis
Convolution
Training
Nonhomogeneous media
Learning systems
Data alignment
deep learning
graph convolutional networks (GCNs)
graph subspaces
principal angles
SCIENCE
Deep Learning
Neural Networks, Computer
Deep Learning
Neural Networks, Computer
cs.LG
cs.LG
cs.NE
cs.SI
physics.soc-ph
stat.ML
Artificial Intelligence & Image Processing
Publication Status
Published
Date Publish Online
2021-01-11