Files in this item



application/pdf9512536.pdf (6MB)Restricted to U of Illinois
(no description provided)PDF


Title:Modelling functions from sample data with classification applications
Author(s):Saarinen, Sirpa Helena
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Artificial Intelligence
Computer Science
Abstract:In this thesis we investigate various aspects of the pattern recognition problem solving process. Pattern recognition can be viewed as a decision making process where the underlying density functions or discriminant functions of the application have to be estimated often in a high dimensional space. We consider two main types of estimators: the feed-forward neural network and the nearest neighbor method.
In the first part of the thesis we investigate the optimization problem that is solved when using feed-forward neural networks for function approximation. We find that the feed-forward neural network optimization problem is very ill-conditioned and can influence the solution process severely. We also show how the feed-forward neural network function and its gradient can be implemented using automatic differentiation techniques.
The second part of the thesis is concerned with the nearest neighbor method. We present two new continuous, supervised learning methods: a novel memory-based learning technique and an approximate nearest neighbor method, both approximating the convergence properties of the nearest neighbor method. These methods can be used in continuous learning areas such as speech, hand-writing and financial applications. We also present a fast approximate search method for high dimensional spaces that is based on the k-d-tree. A lower bound on the performance of the method is derived and some results are shown for a uniform distribution. An application of this method to a speech data set shows very promising results.
Issue Date:1994
Rights Information:Copyright 1994 Saarinen, Sirpa Helena
Date Available in IDEALS:2011-05-07
Identifier in Online Catalog:AAI9512536
OCLC Identifier:(UMI)AAI9512536

This item appears in the following Collection(s)

Item Statistics