University of Illinois Urbana-Champaign

Breaking the MapReduce Stage Barrier

Verma, Abhishek; Zea, Nicolas; Cho, Brian; Gupta, Indranil; Campbell, Roy H.

Content Files
breaking.pdf

Permalink

https://hdl.handle.net/2142/14819

Description

Title
Breaking the MapReduce Stage Barrier
Author(s)
  • Verma, Abhishek
  • Zea, Nicolas
  • Cho, Brian
  • Gupta, Indranil
  • Campbell, Roy H.
Issue Date
2010-01-19
Keyword(s)
  • MapReduce
  • Cloud Computing
Date of Ingest
2010-01-19T15:49:02Z
Abstract
The MapReduce model uses a barrier between the Map and Reduce stages. This provides simplicity in both programming and implementation. However, in many situations, this barrier hurts performance because it is overly restrictive. Thus, we develop a method to break the barrier in MapReduce in a way that improves efficiency. Careful design of our barrier-less MapReduce framework results in equivalent generality and retains ease of programming. We motivate our case with, and experimentally study our barrier-less techniques in, a wide variety of MapReduce applications divided into seven classes. Our experiments show that our approach can achieve better performance times than a traditional MapReduce framework. We achieve a reduction in job completion times that is 25% on average and 87% in the best case.
Type of Resource
text
Genre of Resource
Technical Report
Language
en
Permalink
http://hdl.handle.net/2142/14819

Owning Collections

Research and Tech Reports - Computer Science PRIMARY