University of Illinois Urbana-Champaign

Gamesourcing Mismatched Transcription

Chang, Yu Yao

Content Files
ECE499-Fa2015-chang.pdf

Permalink

https://hdl.handle.net/2142/88902

Description

Title
Gamesourcing Mismatched Transcription
Author(s)
Chang, Yu Yao
Issue Date
2015-12
Keyword(s)
  • Gamesourcing
  • mismatched transcription
  • transcribed speech
  • transcribed speech from non-native speakers
Date of Ingest
2016-02-18T19:08:18Z
Abstract
Transcribed speech is an essential resource to develop speech technologies for different languages of the world. However, native speakers of most languages of the world may not be readily available online to acquire transcribed speech. The goal of this research is to explore the possibility of acquiring transcriptions for speech data from non-native speakers of a language, referred to as mismatched transcriptions. The two main problems tackled in this work are: 1) How do we motivate non-native speakers to provide transcriptions? 2) How do we refine the mismatched transcriptions? Firstly, we design a novel game that facilitates the collection of mismatched transcriptions from non-native speakers. In this game, players are prompted to listen to sound clips in a foreign language and asked to transcribe the sounds they hear to the best of their abilities using English text. The misperceptions by the non-native speakers are modeled as a finite memory process and implemented using finite state machines. The mismatched transcriptions are further refined using a series of finite-state operations. The main contributions of this thesis are as follows: 1) Creation of a streamlined game for crowdsourcing transcriptions for speech data from non-native speakers. 2) Algorithms that process the resulting mismatched transcriptions and provide the closest sounding English words. 3) Experiments describing various modifications to the above-mentioned algorithms and results showing their effect on the accuracy of the English words that are produced as output.
Type of Resource
text
Genre of Resource
Other
Language
en
Permalink
http://hdl.handle.net/2142/88902

Owning Collections

Senior Theses - Electrical and Computer Engineering PRIMARY
The best of ECE undergraduate research