2026-09-19T06:47:26Z https://www.ideals.illinois.edu/oai-pmh

oai:www.ideals.illinois.edu:2142/101213 2023-07-11 col_2142_5131 col_2142_10761 com_2142_5130 com_2142_10755 com_2142_234

Gupta, Indranil Bhatt, Mayank 2018-09-04T20:36:52Z 2018-09-04T20:36:52Z 2020-09-05T09:15:32Z 2018-04-24 2018-05 Cloud applications have burgeoned over the last few years, but they are typically written for loosely-coupled clusters such as datacenters. In this thesis we investigate how one can run cloud applications in tightly-coupled clusters and network topologies, namely super-computers. Specifically, we look at a class of distributed machine learning systems called distributed graph processing systems, and run them on NCSA Blue Waters. Partitioning the graph is key to achieving performance in distributed graph processing systems. We present new topology-aware partitioning techniques that better exploit the structure of the network topologies in supercomputers. Compared to existing work, our new Restricted Oblivious and Grid Centroid partitioning approaches produce 25-33% improvement in makespan, along with a sizable reduction in network traffic. We also discuss optimizations such as smart network buffers that further amplify the improvement. To help operators select the best graph partitioning technique, we culminate our experimental results into a decision tree. Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2020-05-01 The student, Mayank Bhatt, accepted the attached license on 2018-04-23 at 17:13. The student, Mayank Bhatt, submitted this Thesis for approval on 2018-04-23 at 17:20. This Thesis was approved for publication on 2018-04-24 at 15:21. DSpace SAF Submission Ingestion Package generated from Vireo submission #12435 on 2018-08-31 at 17:21:19 Made available in DSpace on 2018-09-04T20:36:52Z (GMT). No. of bitstreams: 2 BHATT-THESIS-2018.pdf: 1415794 bytes, checksum: e08311d8168967b2e47baf1ef67f7fdc (MD5) LICENSE.txt: 4209 bytes, checksum: b810a770b0873fc45062dd7e9ce83fde (MD5) Previous issue date: 2018-04-24 Embargo set by: Seth Robbins for item 107297 Lift date: 2020-09-04T20:37:00Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system Embargo set by: Seth Robbins for item 107297 Lift date: 2020-09-04T20:42:08Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system U of I Only Restriction Lifted for Item 107297 on 2020-09-05T09:15:32Z. application/pdf http://hdl.handle.net/2142/101213 en Copyright 2018 Mayank Bhatt graph processing supercomputers topology Topology-aware distributed graph processing for tightly-coupled clusters text text Computer Science Computer Science University of Illinois at Urbana-Champaign Thesis M.S.