University of Illinois Urbana-Champaign

Conceptual Search and Text Categorization

Ratinov, Lev; Roth, Dan; Srikumar, Vivek

Content Files
Conceptual Search and Text Categorization.pdf

Permalink

https://hdl.handle.net/2142/11422

Description

Title
Conceptual Search and Text Categorization
Author(s)
  • Ratinov, Lev
  • Roth, Dan
  • Srikumar, Vivek
Issue Date
2008-01
Keyword(s)
  • machine learning
  • natural language processing
Date of Ingest
2009-04-22T20:55:12Z
Abstract
The most fundamental problem in information retrieval is that of interpreting information needs of users, typically expressed in a short query. Using the surface level representation of the query is especially unsatisfactory when the information needs are topic specific such as ``US politics'' or ``Space Science'', that seem to require understanding of what the query mean rather than what it is. We suggest that a newly proposed semantic representation of Words (GabrilovichMa2007) can be used to support Conceptual Search. Namely, it allows retrieving documents on a given topic even when existing keyword-based search approaches fail. The method we develop allows us to categorize and retrieve documents topically on-the-fly, without looking at the data collection ahead of time, without knowing a-priori the topics of interest and without training topic categorization classifiers. We compare our approach experimentally to state-of-the-art IR techniques and to machine learning based text categorization techniques and demonstrate significant improvement in performance. Moreover, as we show, our method is intrinsically adaptable to new text collections and domains.
Type of Resource
text
Genre of Resource
Technical Report
Permalink
http://hdl.handle.net/2142/11422
Copyright and License Information
You are granted permission for the non-commercial reproduction, distribution, display, and performance of this technical report in any format, BUT this permission is only for a period of 45 (forty-five) days from the most recent time that you verified that this technical report is still available from the University of Illinois at Urbana-Champaign Computer Science Department under terms that include this permission. All other rights are reserved by the author(s).

Owning Collections

Research and Tech Reports - Computer Science PRIMARY