| File | Description | Format |
|---|---|---|
Dalrymple_UserCentered.pdf
(1MB)
|
(no description provided) |
| Title: | User-centered evaluation of information retrieval |
| Author(s): | Dalrymple, Prudence W. |
| Subject(s): |
Reference services (Libraries)
Evaluation Information retrieval |
| Abstract: | This paper briefly summarizes the history of evaluation in information retrieval and describes both the strengths and limitations of traditional criteria for retrieval effectiveness such as precision, recall, cost, novelty, and satisfaction. It presents a continuum of approaches to studying the user in information retrieval, and suggests that because the situations in which information is sought and used are social situations, objective measures such as retrieval sets and transaction log data may have limited usefulness in determining retrieval effectiveness. Information retrieval evaluation has been locked into a rationalistic, empirical framework which is no longer adequate. A different framework of analysis, design, and evaluation that is contextual in nature is needed. User-centered criteria employing affective measures such as user satisfaction and situational information retrieval must be incorporated into evaluation and design of new information retrieval systems. Qualitative methods such as case studies, focus groups, or in-depth interviews can be combined with objective measures to produce more effective information retrieval research and evaluation. |
| Issue Date: | 1991 |
| Publisher: | Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign |
| Citation Info: | In B. Allen (ed) Evaluation of Public Services and Public Services Personnel (Papers presented at the Allerton Park Institute held October 28-30, 1990): 85-102. |
| Series/Report: | Allerton Park Institute (32nd : 1990) |
| Genre: | Conference Paper / Presentation |
| Type: | Text |
| Language: | English |
| URI: | http://hdl.handle.net/2142/608 |
| ISBN: | 0878450866 |
| ISSN: | 0536-4604 |
| Publication Status: | published or submitted for publication |
| Date Available in IDEALS: | 2007-04-12 |