Files in this item



application/pdf8502266.pdf (6MB)Restricted to U of Illinois
(no description provided)PDF


Title:Automatic Lipreading to Enhance Speech Recognition (Speech Reading)
Author(s):Petajan, Eric David
Department / Program:Electrical Engineering
Discipline:Electrical Engineering
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Engineering, Electronics and Electrical
Abstract:Automatic recognition of the acoustic speech signal alone is inaccurate and computationally expensive. Additional sources of speech information, such as lipreading (or speechreading), should enhance automatic speech recognition, just as lipreading is used by humans to enhance speech recognition when the acoustic signal is degraded. This paper describes an automatic lipreading system which has been developed. A commercial device performs the acoustic speech recognition independently of the lipreading system.
The recognition domain is restricted to isolated utterances and speaker dependent recognition. The speaker faces a solid state camera which sends digitized video to a minicomputer system with custom video processing hardware. The video data is sampled during an utterance and then reduced to a template consisting of visual speech parameter time sequences. The distances between the incoming template and all of the trained templates for each utterance in the vocabulary are computed and a visual recognition candidate is obtained. The combination of the acoustic and visual recognition candidates is shown to yield a final recognition accuracy which greatly exceeds the acoustic recognition accuracy alone. Practical considerations and the possible enhancement of speaker independent and continuous speech recognition systems are also discussed.
Issue Date:1984
Description:261 p.
Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 1984.
Other Identifier(s):(UMI)AAI8502266
Date Available in IDEALS:2014-12-15
Date Deposited:1984

This item appears in the following Collection(s)

Item Statistics