A Parallel Approach for Frequent Subgraph Mining in a Single Large Graph Using Spark
AbstractFrequent subgraph mining (FSM) plays an important role in graph mining, attracting a great deal of attention in many areas, such as bioinformatics, web data mining and social networks. In this paper, we propose SSiGraM (Spark based Single Graph Mining), a Spark based parallel frequent subgraph mining algorithm in a single large graph. Aiming to approach the two computational challenges of FSM, we conduct the subgraph extension and support evaluation parallel across all the distributed cluster worker nodes. In addition, we also employ a heuristic search strategy and three novel optimizations: load balancing, pre-search pruning and top-down pruning in the support evaluation process, which significantly improve the performance. Extensive experiments with four different real-world datasets demonstrate that the proposed algorithm outperforms the existing GraMi (Graph Mining) algorithm by an order of magnitude for all datasets and can work with a lower support threshold. View Full-Text
Share & Cite This Article
Qiao, F.; Zhang, X.; Li, P.; Ding, Z.; Jia, S.; Wang, H. A Parallel Approach for Frequent Subgraph Mining in a Single Large Graph Using Spark. Appl. Sci. 2018, 8, 230.
Qiao F, Zhang X, Li P, Ding Z, Jia S, Wang H. A Parallel Approach for Frequent Subgraph Mining in a Single Large Graph Using Spark. Applied Sciences. 2018; 8(2):230.Chicago/Turabian Style
Qiao, Fengcai; Zhang, Xin; Li, Pei; Ding, Zhaoyun; Jia, Shanshan; Wang, Hui. 2018. "A Parallel Approach for Frequent Subgraph Mining in a Single Large Graph Using Spark." Appl. Sci. 8, no. 2: 230.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.