IDEALS Home University of Illinois at Urbana-Champaign logo The Alma Mater The Main Quad

User-centered evaluation of information retrieval

Show full item record

Bookmark or cite this item: http://hdl.handle.net/2142/608

Files in this item

File Description Format
PDF Dalrymple_UserCentered.pdf (1MB) (no description provided) PDF
Title: User-centered evaluation of information retrieval
Author(s): Dalrymple, Prudence W.
Subject(s): Reference services (Libraries) Evaluation Information retrieval
Abstract: This paper briefly summarizes the history of evaluation in information retrieval and describes both the strengths and limitations of traditional criteria for retrieval effectiveness such as precision, recall, cost, novelty, and satisfaction. It presents a continuum of approaches to studying the user in information retrieval, and suggests that because the situations in which information is sought and used are social situations, objective measures such as retrieval sets and transaction log data may have limited usefulness in determining retrieval effectiveness. Information retrieval evaluation has been locked into a rationalistic, empirical framework which is no longer adequate. A different framework of analysis, design, and evaluation that is contextual in nature is needed. User-centered criteria employing affective measures such as user satisfaction and situational information retrieval must be incorporated into evaluation and design of new information retrieval systems. Qualitative methods such as case studies, focus groups, or in-depth interviews can be combined with objective measures to produce more effective information retrieval research and evaluation.
Issue Date: 1991
Publisher: Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign
Citation Info: In B. Allen (ed) Evaluation of Public Services and Public Services Personnel (Papers presented at the Allerton Park Institute held October 28-30, 1990): 85-102.
Series/Report: Allerton Park Institute (32nd : 1990)
Genre: Conference Paper / Presentation
Type: Text
Language: English
URI: http://hdl.handle.net/2142/608
ISBN: 0878450866
ISSN: 0536-4604
Publication Status: published or submitted for publication
Date Available in IDEALS: 2007-04-12
 

This item appears in the following Collection(s)

Show full item record

Item Statistics

  • Total Downloads: 899
  • Downloads this Month: 51
  • Downloads Today: 0

Browse

My Account

Information

Access Key