Fast All-Pairs SimRank Assessment on Large Graphs and Bipartite Domains
File(s)All-Pairs-SimRank.pdf (1.35 MB)
Accepted version
Author(s)
Yu, W
Lin, X
Zhang, W
McCann, J
Type
Journal Article
Abstract
SimRank is a powerful model for assessing vertex-pair similarities in a graph. It follows the concept that two vertices are similar if they are referenced by similar vertices. The prior work [18] exploits partial sums memoization to compute SimRank
in O(Kmn) time on a graph of n vertices and m edges, for K iterations. However, the computations among different partial sums may have duplicate redundancy. Besides, to guarantee a given accuracy ϵ, the existing SimRank needs K = ⌈logC ϵ⌉
iterations, where C is a damping factor, but the geometric rate of convergence is slow if a high accuracy is expected. In this paper, (1) a novel clustering strategy is proposed to eliminate duplicate computations occurring in partial sums, and an efficient algorithm is then devised to accelerate SimRank computation to O(Kd′n
2) time, where d′ is typically much smaller than m n . (2) A new differential SimRank equation is proposed, which can represent the SimRank matrix as an exponential sum of transition matrices, as opposed to the geometric sum of the conventional counterpart. This leads to a further speedup in the convergence rate of SimRank iterations. (3) In bipartite domains, a novel finer-grained partial max clustering method is developed to speed up the computation of the Minimax SimRank variation from O(Kmn) to O(Km′n) time, where m′ (≤ m) is the number of edges in
a reduced graph after edge clustering, which can be typically much smaller than m. Using real and synthetic data, we empirically verify that (1) our approach of partial sums sharing outperforms the best known algorithm by up to one order of magnitude; (2) the revised notion of SimRank further achieves a 5X speedup on large graphs while also fairly preserving the relative order of original SimRank scores; (3) our finer-grained partial max memoization for the Minimax SimRank variation in bipartite domains is 0.5–1.2 orders of magnitude faster than the baselines.
in O(Kmn) time on a graph of n vertices and m edges, for K iterations. However, the computations among different partial sums may have duplicate redundancy. Besides, to guarantee a given accuracy ϵ, the existing SimRank needs K = ⌈logC ϵ⌉
iterations, where C is a damping factor, but the geometric rate of convergence is slow if a high accuracy is expected. In this paper, (1) a novel clustering strategy is proposed to eliminate duplicate computations occurring in partial sums, and an efficient algorithm is then devised to accelerate SimRank computation to O(Kd′n
2) time, where d′ is typically much smaller than m n . (2) A new differential SimRank equation is proposed, which can represent the SimRank matrix as an exponential sum of transition matrices, as opposed to the geometric sum of the conventional counterpart. This leads to a further speedup in the convergence rate of SimRank iterations. (3) In bipartite domains, a novel finer-grained partial max clustering method is developed to speed up the computation of the Minimax SimRank variation from O(Kmn) to O(Km′n) time, where m′ (≤ m) is the number of edges in
a reduced graph after edge clustering, which can be typically much smaller than m. Using real and synthetic data, we empirically verify that (1) our approach of partial sums sharing outperforms the best known algorithm by up to one order of magnitude; (2) the revised notion of SimRank further achieves a 5X speedup on large graphs while also fairly preserving the relative order of original SimRank scores; (3) our finer-grained partial max memoization for the Minimax SimRank variation in bipartite domains is 0.5–1.2 orders of magnitude faster than the baselines.
Date Issued
2015-06-02
Date Acceptance
2014-07-16
Citation
IEEE Transactions on Knowledge and Data Engineering, 2015, 27 (7), pp.1810-1823
ISSN
1041-4347
Publisher
IEEE
Start Page
1810
End Page
1823
Journal / Book Title
IEEE Transactions on Knowledge and Data Engineering
Volume
27
Issue
7
Copyright Statement
© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Publication Status
Published