Files in this item



application/pdfWANG-THESIS-2020.pdf (750kB)Restricted Access
(no description provided)PDF


Title:Supporting students’ peer assessment using chatbots
Author(s):Wang, Dennis
Advisor(s):Huang, Yun
Department / Program:Computer Science
Discipline:Computer Science
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):Peer Assessment
Conversational Agent
Abstract:Peer assessment is found to be an effective approach for instructors to evaluate students’ learning performance in large classes, and it provides great learning opportunities for stu- dents. However, conducting successful peer assessment remains challenging as peer graders often do not have sufficient guidance to make fair assessment and to provide useful feedback. In this thesis, we explore the potential of using a chatbot to facilitate the execution of peer assessment. We conducted two studies in two university courses. The first one was a within- subject study, which focused on understanding the effect of chatbot use for peer assessment over time. The second was a between-subject study, which addressed the differences between providing guidance by a chatbot and giving suggestions through a regular form. Our results show that, using a chatbot for several times, students improved the performance of conducting peer assessment by providing more accurate scores that were closer to the TAs’ scores. Also, when the chatbot provided guidance, high-performing peer graders were more likely to give positive comments with constructive suggestions than low-performing peer graders did. Our results provide insights into designing interaction technologies to improve both the quality of peer assessment and students’ learning.
Issue Date:2020-05-15
Rights Information:Copyright 2020 Dennis Wang
Date Available in IDEALS:2020-08-27
Date Deposited:2020-05

This item appears in the following Collection(s)

Item Statistics