IDEALS Home University of Illinois at Urbana-Champaign logo The Alma Mater The Main Quad

Breaking the MapReduce Stage Barrier

Show full item record

Bookmark or cite this item: http://hdl.handle.net/2142/14819

Files in this item

File Description Format
PDF breaking.pdf (256KB) (no description provided) PDF
Title: Breaking the MapReduce Stage Barrier
Author(s): Verma, Abhishek; Zea, Nicolas; Cho, Brian; Gupta, Indranil; Campbell, Roy H.
Subject(s): MapReduce Cloud Computing
Abstract: The MapReduce model uses a barrier between the Map and Reduce stages. This provides simplicity in both programming and implementation. However, in many situations, this barrier hurts performance because it is overly restrictive. Thus, we develop a method to break the barrier in MapReduce in a way that improves efficiency. Careful design of our barrier-less MapReduce framework results in equivalent generality and retains ease of programming. We motivate our case with, and experimentally study our barrier-less techniques in, a wide variety of MapReduce applications divided into seven classes. Our experiments show that our approach can achieve better performance times than a traditional MapReduce framework. We achieve a reduction in job completion times that is 25% on average and 87% in the best case.
Issue Date: 2010-01-19
Genre: Technical Report
Type: Text
Language: English
URI: http://hdl.handle.net/2142/14819
Publication Status: published or submitted for publication
Date Available in IDEALS: 2010-01-19
 

This item appears in the following Collection(s)

Show full item record

Item Statistics

  • Total Downloads: 2361
  • Downloads this Month: 24
  • Downloads Today: 0

Browse

My Account

Information

Access Key