Files in this item



application/pdfDEJONG-THESIS-2017.pdf (2MB)
(no description provided)PDF


Title:Comparing text and visual annotation tools for design feedback
Author(s):DeJong, Antoine Jean
Advisor(s):Bailey, Brian P.
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Abstract:Designers rely on critiques to develop their skills and iterate toward effective designs. Designers are increasingly turning to online tools and communities to collect affordable, scalable feedback. There are many tools available but little empirical evidence to guide the decision to select one over another. We conducted a study on Amazon Mechanical Turk (N=360) to contrast two popular classes of feedback collection interfaces: text and spatial. The text interface has one text box for providers to submit their feedback, whereas the spatial interface allows the providers to annotate the design. We also manipulated the presence and content of history of feedback visible to providers. The three history conditions were aesthetic, goal-related, and ‘no-history’ if they did not have to option to view feedback. We found that the presence of sample feedback induces a fixation effect in design reviews, causing feedback to be more similar to the feedback that the providers reviewed. We found that both the Interface and History conditions have statistically significant effects on the content of feedback provided. However, neither resulted in greater perceived quality of feedback. Our study found that feedback in the text condition was 27% longer than in the spatial condition. We also found that providers who reviewed goal-oriented sample feedback rated the task as being easier than providers who did not receive sample feedback. These results indicate that the more important decision for designers is not which class of interface to use but whether to include history or sample feedback.
Issue Date:2017-06-26
Rights Information:Copyright 2017 Antoine DeJong
Date Available in IDEALS:2017-09-29
Date Deposited:2017-08

This item appears in the following Collection(s)

Item Statistics