Files in this item



application/pdfJeffrey-Monique_20180417_V01.pdf (240kB)
(no description provided)PDF


Title:Tasker: Safely Serving Verifiable Micro-tasks for Researchers
Author(s):Jeffrey, Monique; Whiting, Mark; Kozolan, Abrere S.; Motorin, Imauri; Samuel, Osei-Afriyie
Amazon Mechanical Turk
research tools
Abstract:Paid crowdsourcing removes many traditional boundaries in conducting participant based research, however with this new tool, new instrumentation challenges have arisen for researchers. Three common challenges include: the difficulty in creating large numbers of high quality and novel tasks, verifying results of the tasks without relying on manual cheat mitigation techniques, and ensuring that the tasks adhere to the latest visual and instructional design to get high quality results. These circumstances endanger current and future research on Amazon Mechanical Turk and can result in compromised data. We introduce Tasker, a secure system architecture for serving unique tasks supported by usability principles to workers, and providing verification information concerning their completion and accuracy to researchers. This poster discusses insights from our pilot study and explorations toward methods that demonstrate a marked improvement for speed, security and robustness in developing tasks for research leveraging Amazon Mechanical Turk.
Issue Date:2018
Series/Report:iConference 2018 Proceedings
Genre:Conference Poster
Rights Information:Copyright 2018 is held by Monique Jeffrey, Mark Whiting, Abrere Sophie Kozolan, Imauri Motorin, Osei-Afriyie Samuel. Copyright permissions, when appropriate, must be obtained directly from the authors.
Date Available in IDEALS:2018-07-12

This item appears in the following Collection(s)

Item Statistics