A participatory framework for evaluation design

Abstract

Users and the information systems designed to support their needs and behaviors are becoming increasingly complex. Evaluators are tasked with designing evaluation methods that address the evaluation challenges of systems conceived through newer design principles, while also identifying issues and user perceptions in an efficient and effective manner. We argue that user involvement through structured formative evaluation design can fill the conceptual and procedural gaps between system design and system evaluation. This poster proposes a participatory framework for designing evaluation methods that can help designers and evaluators develop holistic approaches to design and evaluation by bringing greater detail, structure, and clarity to evaluation design. To determine the feasibility of this participatory evaluation design framework, we will integrate the system evaluation and evaluation design process into the system design process of information displays that support team situation awareness during trauma resuscitation.