Files in this item

FilesDescriptionFormat

application/pdf

application/pdfQU-THESIS-2018.pdf (797kB)
(no description provided)PDF

Description

Title:Curriculum learning for heterogeneous star network embedding via deep reinforcement learning
Author(s):Qu, Meng
Advisor(s):Han, Jiawei
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Degree:M.S.
Genre:Thesis
Subject(s):Curriculum Learning Network Embedding Reinforcement Learning
Abstract:Learning node representations for networks has attracted much attention recently due to its effectiveness in a variety of applications. This paper focuses on learning node representations for heterogeneous star networks, which have a center node type linked with multiple attribute node types through different types of edges. In heterogeneous star networks, we observe that the training order of different types of edges affects the learning performance significantly. Therefore we study learning curricula for node representation learning in heterogeneous star networks, i.e., learning an optimal sequence of edges of different types for the node representation learning process. We formulate the problem as a Markov decision process, with the action as selecting a specific type of edges for learning or terminating the training process, and the state as the sequence of edge types selected so far. The reward is calculated as the performance on external tasks with node representations as features, and the goal is to take a series of actions to maximize the cumulative rewards. We propose an approach based on deep reinforcement learning for this problem. Our approach leverages LSTM models to encode states and further estimate the expected cumulative reward of each state-action pair, which essentially measures the long-term performance of different actions at each state. Experimental results on real-world heterogeneous star networks demonstrate the effectiveness and efficiency of our approach over competitive baseline approaches.
Issue Date:2018-05-01
Type:Text
URI:http://hdl.handle.net/2142/101634
Rights Information:Copyright 2018 Meng Qu
Date Available in IDEALS:2018-09-27
2020-09-28
Date Deposited:2018-08


This item appears in the following Collection(s)

Item Statistics