Files in this item

FilesDescriptionFormat

application/pdf

application/pdfVERMA-THESIS-2017.pdf (1MB)Restricted to U of Illinois
(no description provided)PDF

Description

Title:An experimental comparison of partitioning strategies in distributed graph processing
Author(s):Verma, Shiv
Advisor(s):Gupta, Indranil
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Degree:M.S.
Genre:Thesis
Subject(s):Distributed
Graph
Processing
Partitioning
Abstract:In this thesis, we study the problem of choosing among partitioning strategies in distributed graph processing systems. To this end, we evaluate and characterize both the performance and resource usage of different partitioning strategies under various popular distributed graph processing systems, applications, input graphs, and execution environments. Through our experiments, we found that no single partitioning strategy is the best fit for all situations, and that the choice of partitioning strategy has a significant effect on resource usage and application run-time. Our experiments demonstrate that the choice of partitioning strategy depends on (1) the degree distribution of input graph, (2) the type and duration of the application, and (3) the cluster size. Based on our results, we present rules of thumb to help users pick the best partitioning strategy for their particular use cases. We present results from each system, as well as from all partitioning strategies implemented in two common systems (PowerLyra and GraphX).
Issue Date:2017-04-24
Type:Thesis
URI:http://hdl.handle.net/2142/97724
Rights Information:Copyright 2017 Shiv Verma
Date Available in IDEALS:2017-08-10
Date Deposited:2017-05


This item appears in the following Collection(s)

Item Statistics