IDEALS Home University of Illinois at Urbana-Champaign logo The Alma Mater The Main Quad

Evaluating microblogging sentiments with online workers

Show full item record

Bookmark or cite this item: http://hdl.handle.net/2142/29988

Files in this item

File Description Format
mp3 audio organisciak.mp3 (11MB) Audio file mp3 audio
Microsoft PowerPoint organisciak.ppt (927KB) PowerPoint Presentation/Slides Microsoft PowerPoint
Title: Evaluating microblogging sentiments with online workers
Author(s): Organisciak, Peter
Subject(s): sentiment, microblogging
Abstract: The classification of sentiment is a unique challenge for text analysis. Study in the area returns weaker results than in other classification tasks. A reason for this is the complexity of interlinked intra-document sentiments, a problem for not only the effectiveness of mining techniques but also for the annotation of training data. This study explored a correction to this problem by generating a much less complex corpus for sentiment analysis from collected and annotated microblogging messages. The goal of this study was to find the best text mining approach for determining the tone of a sentence-length political sentiment, through the study of a corpus of tweets with a subset classified by humans. This presentation will focus on the results of the first step of the study, the generation of a training corpus. Messages were classified according to sentiment multiple times, independently by anonymous online workers. An iterative ranking algorithm was developed to determine confidence in individual ratings and the workers making them. This showed encouraging improvement in reconciling inter-coder variance over a baseline measure of selection by majority rating. This presentation will also briefly describe the efficacy of classification methods run on the corpus and early findings of a follow-up study measuring the equivalence of ranked online workers to trusted traditional workers.
Issue Date: 2011
Publisher: Graduate School of Library and Information Science. University of Illinois at Urbana-Champaign.
Genre: Presentation / Lecture / SpeechVideo
Type: OtherAudio
Language: English
URI: http://hdl.handle.net/2142/29988
Date Available in IDEALS: 2012-03-12
 

This item appears in the following Collection(s)

Show full item record

Item Statistics

  • Total Downloads: 18
  • Downloads this Month: 0
  • Downloads Today: 0

Browse

My Account

Information

Access Key