Files in this item

FilesDescriptionFormat

application/pdf

application/pdfLIU-THESIS-2019.pdf (305kB)
(no description provided)PDF

Description

Title:Machine learning workflow optimization via automatic discovery of resource reuse opportunities
Author(s):Liu, Jialin
Advisor(s):Parameswaran, Aditya
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Degree:M.S.
Genre:Thesis
Subject(s):Machine Learning
Deep Learning
System
Abstract:Many state-of-the-art deep learning models rely on dynamic computation logic, making them difficult to optimize. In this thesis, we present a hashing based algorithm that is able to detect and optimize computation logic common to different computation graphs. We show that our algorithm can be integrated seamlessly into popular deep learning frameworks such as TensorFlow, with nearly zero code changes required on the part of users in order to adapt our optimizations to their programs. Experiments show that our algorithm achieves 1.35× speedup on a sentiment classification task trained with the popular Tree-LSTM model.
Issue Date:2019-04-22
Type:Thesis
URI:http://hdl.handle.net/2142/104894
Rights Information:Copyright 2019 Jialin Liu
Date Available in IDEALS:2019-08-23
Date Deposited:2019-05


This item appears in the following Collection(s)

Item Statistics