University of Illinois Urbana-Champaign

User-centered evaluation of information retrieval

Dalrymple, Prudence W.

Content Files
Dalrymple_UserCentered.pdf

Permalink

https://hdl.handle.net/2142/608

Description

Title
User-centered evaluation of information retrieval
Author(s)
Dalrymple, Prudence W.
Issue Date
1991
Keyword(s)
  • Reference services (Libraries)
  • Evaluation
  • Information retrieval
Date of Ingest
2007-04-12T18:35:25Z
Abstract
This paper briefly summarizes the history of evaluation in information retrieval and describes both the strengths and limitations of traditional criteria for retrieval effectiveness such as precision, recall, cost, novelty, and satisfaction. It presents a continuum of approaches to studying the user in information retrieval, and suggests that because the situations in which information is sought and used are social situations, objective measures such as retrieval sets and transaction log data may have limited usefulness in determining retrieval effectiveness. Information retrieval evaluation has been locked into a rationalistic, empirical framework which is no longer adequate. A different framework of analysis, design, and evaluation that is contextual in nature is needed. User-centered criteria employing affective measures such as user satisfaction and situational information retrieval must be incorporated into evaluation and design of new information retrieval systems. Qualitative methods such as case studies, focus groups, or in-depth interviews can be combined with objective measures to produce more effective information retrieval research and evaluation.
Publisher
Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign
Series/Report Name or Number
Allerton Park Institute (32nd : 1990)
ISSN
0536-4604
Type of Resource
text
Genre of Resource
Conference Paper / Presentation
Language
en
Permalink
http://hdl.handle.net/2142/608

Owning Collections

1990: Evaluation of Public Services and Public Services Personnel PRIMARY
Allerton Park Institute Proceedings (no. 32, 1990); Edited by Bryce Allen