Files in this item



application/pdf138_ready.pdf (1MB)
(no description provided)PDF


Title:Beyond AMT: An Analysis of Crowd Work Platforms
Author(s):Vakharia, Donna; Lease, Matthew
Subject(s):information technology and work
distributed work
Abstract:While many competitor platforms to Amazon’s Mechanical Turk (AMT) now exist, little research has considered them. Such near-exclusive focus on AMT risks its particular vagaries and limitations overly shaping our understanding of crowd work and our field’s research questions and directions. To address this, we present a qualitative content analysis of seven alternative platforms. After organizing prior AMT studies around a set of key problem types encountered, we define our process for inducing categories for qualitative assessment of platforms. We then contrast the key problem types with AMT vs. platform features from content analysis, informing both methodology of use and directions for future research. Our cross-platform analysis represents the only such study by researchers for researchers, intended to enrich diversity of research on crowd work and accelerate progress.
Issue Date:2015-03-15
Series/Report:iConference 2015 Proceedings
Genre:Conference Paper/Presentation
Peer Reviewed:yes
Rights Information:Copyright 2015 is held by the authors. Copyright permissions, when appropriate, must be obtained directly from the authors.
Date Available in IDEALS:2015-03-24

This item appears in the following Collection(s)

Item Statistics