Towards efficient SimRank computation on large networks
File(s)icde13.pdf (347.24 KB)
Accepted version
Author(s)
Yu, W
Lin, X
Zhang, W
Type
Conference Paper
Abstract
SimRank has been a powerful model for assessing the similarity of pairs of vertices in a graph. It is based on the concept that two vertices are similar if they are referenced by similar vertices. Due to its self-referentiality, fast SimRank computation on large graphs poses significant challenges. The state-of-the-art work [17] exploits partial sums memorization for computing SimRank in O(Kmn) time on a graph with n vertices and m edges, where K is the number of iterations. Partial sums memorizing can reduce repeated calculations by caching part of similarity summations for later reuse. However, we observe that computations among different partial sums may have duplicate redundancy. Besides, for a desired accuracy ϵ, the existing SimRank model requires K = [logC ϵ] iterations [17], where C is a damping factor. Nevertheless, such a geometric rate of convergence is slow in practice if a high accuracy is desirable. In this paper, we address these gaps. (1) We propose an adaptive clustering strategy to eliminate partial sums redundancy (i.e., duplicate computations occurring in partial sums), and devise an efficient algorithm for speeding up the computation of SimRank to 0(Kd'n2) time, where d' is typically much smaller than the average in-degree of a graph. (2) We also present a new notion of SimRank that is based on a differential equation and can be represented as an exponential sum of transition matrices, as opposed to the geometric sum of the conventional counterpart. This leads to a further speedup in the convergence rate of SimRank iterations. (3) Using real and synthetic data, we empirically verify that our approach of partial sums sharing outperforms the best known algorithm by up to one order of magnitude, and that our revised notion of SimRank further achieves a 5X speedup on large graphs while also fairly preserving the relative order of original SimRank scores.
Date Issued
2013-04-08
Date Acceptance
2013-04-08
Citation
2013 IEEE 29th International Conference on Data Engineering (ICDE), 2013, pp.601-612
ISBN
978-1-4673-4909-3
ISSN
1063-6382
Publisher
IEEE
Start Page
601
End Page
612
Journal / Book Title
2013 IEEE 29th International Conference on Data Engineering (ICDE)
Copyright Statement
© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
IEEE 29th International Conference on Data Engineering (ICDE)
Notes
bibsource: DBLP, http://dblp.uni-trier.de ee: http://doi.ieeecomputersociety.org/10.1109/ICDE.2013.6544859 owner: ywr0708 timestamp: 2013.11.05
Publication Status
Published
Start Date
2013-04-08
Finish Date
2013-04-12
Coverage Spatial
Brisbane, QLD