Files in this item



application/pdfDalrymple_UserCentered.pdf (1MB)
(no description provided)PDF


Title:User-centered evaluation of information retrieval
Author(s):Dalrymple, Prudence W.
Subject(s):Reference services (Libraries)
Information retrieval
Abstract:This paper briefly summarizes the history of evaluation in information retrieval and describes both the strengths and limitations of traditional criteria for retrieval effectiveness such as precision, recall, cost, novelty, and satisfaction. It presents a continuum of approaches to studying the user in information retrieval, and suggests that because the situations in which information is sought and used are social situations, objective measures such as retrieval sets and transaction log data may have limited usefulness in determining retrieval effectiveness. Information retrieval evaluation has been locked into a rationalistic, empirical framework which is no longer adequate. A different framework of analysis, design, and evaluation that is contextual in nature is needed. User-centered criteria employing affective measures such as user satisfaction and situational information retrieval must be incorporated into evaluation and design of new information retrieval systems. Qualitative methods such as case studies, focus groups, or in-depth interviews can be combined with objective measures to produce more effective information retrieval research and evaluation.
Issue Date:1991
Publisher:Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign
Citation Info:In B. Allen (ed) Evaluation of Public Services and Public Services Personnel (Papers presented at the Allerton Park Institute held October 28-30, 1990): 85-102.
Series/Report:Allerton Park Institute (32nd : 1990)
Genre:Conference Paper / Presentation
Publication Status:published or submitted for publication
Date Available in IDEALS:2007-04-12

This item appears in the following Collection(s)

Item Statistics