Files in this item
|(no description provided)|
|Title:||Perceptual interpretation and the transformation of events into language|
|Author(s):||Maddox, Anthony Bernard|
|Doctoral Committee Chair(s):||Waltz, David L.|
|Department / Program:||Electrical and Computer Engineering|
|Degree Granting Institution:||University of Illinois at Urbana-Champaign|
|Subject(s):||Engineering, Electronics and Electrical
|Abstract:||This thesis describes the principles underlying PIXEL (for Perceptual Interpretation and the Trans(X)formation of Events into Language), a system that uses focus of attention in generating and learning natural language descriptions of event perceptions. PIXEL identifies the salient features of events through cooperation between processes that are perceptually bottom-up and linguistically top-down. As events are perceived, data-driven attention guides event schemata generation, prediction, and selection. Through interaction with a human informant, goal-driven attention abstracts perceptual semantics and lexicalizes selected event schemata to generate an interpretation space for verbalization.
PIXEL characterizes three aspects of visuolinguistic conceptualization. First, it demonstrates how attention during observation selects perceptual features for event conceptualization. Second, PIXEL suggests how perceptual meaning may be derived through dialogue to guide the mapping of linguistic representations of events into generalized event concepts. Finally, it illustrates that data-driven and goal-driven attention can combine to facilitate learning under perceptual or linguistic control.
The domain of this research is a space station in low-earth orbit. In particular, the problem of real-time communication between astronauts and teleoperated robotic servicing systems that assist in assembly, maintenance, and inspection tasks is addressed.
|Rights Information:||Copyright 1989 Maddox, Anthony Bernard|
|Date Available in IDEALS:||2011-05-07|
|Identifier in Online Catalog:||AAI8924890|
This item appears in the following Collection(s)
Graduate Dissertations and Theses at Illinois
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Electrical and Computer Engineering
Dissertations and Theses in Electrical and Computer Engineering