Learning to Segment Images into Material and Object Classes

McHenry, Kenton Guadron

Permalink

https://hdl.handle.net/2142/11436 Copy

Description

Title

Learning to Segment Images into Material and Object Classes

Author(s)

McHenry, Kenton Guadron

Issue Date

2008-04

Keyword(s)

computer science

Abstract

This dissertation addresses the task of learning to segment images into meaningful material and object categories. With regards to materials we consider the difficult task of segmenting objects made of transparent materials such as glass. To do this we consider information in the form binary features. Unlike more traditional unary features which consider information contained within a single location, binary features which consider information between pairs of locations are used to capture the notion of transparency (i.e. being able to see through something). We begin by using this in an edge based approach to locate the edges of glass objects. Segmenting transparent regions, which is desirable in order to locate objects, is ambiguous with this binary information alone. We deal with this by treating this information as a measure of discrepancy, relating how different two regions are from one another. We then combine this with a complimentary affinity measure which relates how well two regions belong together. These two measures are then combined within a single energy function which can be optimized to segment regions of transparent material. With regards to opaque objects an initial segmentation can be constructed using local features within regions produced from an over segmentation of the image. Our interest here is in improving these local segmentations by incorporating global information. Using global features (i.e. features that consider all regions simultaneously) and synthetically generated contrastive data an energy based model is constructed to estimate the quality of a given segmentation. Based on these segmentation quality estimates we attempt to improve a given segmentation.

Type of Resource

text

Permalink

http://hdl.handle.net/2142/11436

Copyright and License Information

You are granted permission for the non-commercial reproduction, distribution, display, and performance of this technical report in any format, BUT this permission is only for a period of 45 (forty-five) days from the most recent time that you verified that this technical report is still available from the University of Illinois at Urbana-Champaign Computer Science Department under terms that include this permission. All other rights are reserved by the author(s).

Owning Collections