University of Illinois Urbana-Champaign

Efficient On-Demand Operations in Large-Scale Infrastructures

Ko, Steven Y.

Content Files
thesis.pdf

Permalink

https://hdl.handle.net/2142/13386

Description

Title
Efficient On-Demand Operations in Large-Scale Infrastructures
Author(s)
Ko, Steven Y.
Issue Date
2009-08-04
Doctoral Committee Chair(s)
Gupta, Indranil
Committee Member(s)
  • Nahrstedt, Klara
  • Abdelzaher, Tarek F.
  • Milojicic, Dejan
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Date of Ingest
2009-08-05T01:17:36Z
Keyword(s)
Distributed Systems
Language
en
Abstract
In large-scale distributed infrastructures such as clouds, Grids, peer-to-peer systems, and wide-area testbeds, users and administrators typically desire to perform on-demand operations that deal with the most up-to-date state of the infrastructure. However, the scale and dynamism present in the operating environment make it challenging to support on-demand operations efficiently, i.e., in a bandwidth- and response-efficient manner. This dissertation discusses several on-demand operations, challenges associated with them, and system designs that meet these challenges. Specifically, we design and implement techniques for 1) on-demand group monitoring that allows users and administrators of an infrastructure to query and aggregate the up-to-date state of the machines (e.g., CPU utilization) in one or multiple groups, 2) on-demand storage for intermediate data generated by dataflow programming paradigms running in clouds, 3) on-demand Grid scheduling that makes worker-centric scheduling decisions based on the current availability of compute nodes, and 4) on-demand key/value pair lookup that is overlay-independent and perturbation-resistant. We evaluate these on-demand operations using large-scale simulations with traces gathered from real systems, as well as via deployments over real testbeds such as Emulab and PlanetLab.
Type of Resource
text
Permalink
http://hdl.handle.net/2142/13386
Copyright and License Information
Copyright 2009 Steven Y. Ko

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Computer Science
Dissertations and Theses from the Siebel School of Computer Science