Files in this item



application/pdf8924890.pdf (6MB)Restricted to U of Illinois
(no description provided)PDF


Title:Perceptual interpretation and the transformation of events into language
Author(s):Maddox, Anthony Bernard
Doctoral Committee Chair(s):Waltz, David L.
Department / Program:Electrical and Computer Engineering
Discipline:Electrical Engineering
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Engineering, Electronics and Electrical
Computer Science
Abstract:This thesis describes the principles underlying PIXEL (for Perceptual Interpretation and the Trans(X)formation of Events into Language), a system that uses focus of attention in generating and learning natural language descriptions of event perceptions. PIXEL identifies the salient features of events through cooperation between processes that are perceptually bottom-up and linguistically top-down. As events are perceived, data-driven attention guides event schemata generation, prediction, and selection. Through interaction with a human informant, goal-driven attention abstracts perceptual semantics and lexicalizes selected event schemata to generate an interpretation space for verbalization.
PIXEL characterizes three aspects of visuolinguistic conceptualization. First, it demonstrates how attention during observation selects perceptual features for event conceptualization. Second, PIXEL suggests how perceptual meaning may be derived through dialogue to guide the mapping of linguistic representations of events into generalized event concepts. Finally, it illustrates that data-driven and goal-driven attention can combine to facilitate learning under perceptual or linguistic control.
The domain of this research is a space station in low-earth orbit. In particular, the problem of real-time communication between astronauts and teleoperated robotic servicing systems that assist in assembly, maintenance, and inspection tasks is addressed.
Issue Date:1989
Rights Information:Copyright 1989 Maddox, Anthony Bernard
Date Available in IDEALS:2011-05-07
Identifier in Online Catalog:AAI8924890
OCLC Identifier:(UMI)AAI8924890

This item appears in the following Collection(s)

Item Statistics