Files in this item



application/pdfSHEN-THESIS-2017.pdf (588kB)
(no description provided)PDF


Title:Segment backup: datacenter-disaster tolerance for stream processing systems
Author(s):Shen, Juanli
Advisor(s):Winslett, Marianne Southall
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Stream processing systems
Fault tolerance
Abstract:We design a datacenter-disaster tolerance solution called segment backup for stream processing systems. During regular running, segment backup inserts barriers into the normal tuple stream to indicate the backup versions and ensure node-level synchronization of multiple input streams. Additionally, segment backup materializes the partial results at some intermediate nodes to reduce reprocessing work after failures. The simple restarting logic can construct global consistency by connecting the segment consistency with the help of the materialized partial results. This method gives each segment flexibility to roll back to its latest version. We implement a prototype stream processing system with segment backup. Our experimental results show that segment backup can shorten the recovery delay with acceptable overhead during normal execution.
Issue Date:2017-04-24
Rights Information:Copyright 2017 Juanli Shen
Date Available in IDEALS:2017-08-10
Date Deposited:2017-05

This item appears in the following Collection(s)

Item Statistics