User-centered evaluation of information retrieval

Dalrymple, Prudence W.

Permalink

https://hdl.handle.net/2142/608 Copy

Description

Title

User-centered evaluation of information retrieval

Author(s)

Dalrymple, Prudence W.

Issue Date

1991

Keyword(s)

• Reference services (Libraries)
• Evaluation
• Information retrieval

Abstract

This paper briefly summarizes the history of evaluation in information retrieval and describes both the strengths and limitations of traditional criteria for retrieval effectiveness such as precision, recall, cost, novelty, and satisfaction. It presents a continuum of approaches to studying the user in information retrieval, and suggests that because the situations in which information is sought and used are social situations, objective measures such as retrieval sets and transaction log data may have limited usefulness in determining retrieval effectiveness. Information retrieval evaluation has been locked into a rationalistic, empirical framework which is no longer adequate. A different framework of analysis, design, and evaluation that is contextual in nature is needed. User-centered criteria employing affective measures such as user satisfaction and situational information retrieval must be incorporated into evaluation and design of new information retrieval systems. Qualitative methods such as case studies, focus groups, or in-depth interviews can be combined with objective measures to produce more effective information retrieval research and evaluation.

Publisher

Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign

Series/Report Name or Number

Allerton Park Institute (32nd : 1990)

ISSN

0536-4604

Type of Resource

text

Language

en

Permalink

http://hdl.handle.net/2142/608

Owning Collections