Towards personalized communication between humans and their assistant systems

Hasan, Aamir

Permalink

https://hdl.handle.net/2142/127231 Copy

Description

Title

Towards personalized communication between humans and their assistant systems

Author(s)

Hasan, Aamir

Issue Date

2024-12-02

Director of Research (if dissertation) or Advisor (if thesis)

Driggs-Campbell, Katherine Rose

Doctoral Committee Chair(s)

Driggs-Campbell, Katherine Rose

Committee Member(s)

• Dong, Roy
• Karahalios, Karrie
• Varshney, Lav

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

Applied Machine Learning, Human Assistant Systems, Human Robot Interactions, Adaptive Communication, Human-in-the-loop evaluation

Abstract

Communication informs various facets of human-autonomy collaboration such as task efficiency, trust, and safety. Particularly so in use cases where humans interact with assistant systems (e.g. navigation assistants, guide robots, collaborative manufacturing). The current communication paradigms between humans and their assistant systems are direct and static, leading to robotic experiences. Learning-based techniques can be used to improve the aforementioned facets by exploiting dynamic, implicit communication cues and enhancing direct communication strategies. To this end, we aim to use learning-based techniques to improve human-autonomy communication. We enhance human modeling in collaborative tasks to inform unsupervised inference and evaluate our methods with human-in-the-loop validation. Specifically, we model human-autonomy interaction as Markov Decision Processes (MDP) and build assistant policies using Reinforcement Learning. The MDP formulation is then used to train models such as generative Variational Autoencoders and graph neural networks that capture and predict human traits and preferences among other human-behavior. These predictive models enable (semi-)autonomous assistant systems to adapt and cooperate with their human counterparts. We evaluate our proof-of-concept systems using user trials, with particular emphasis on in-car driving scenarios. Our experiments provide important insights into interactions between humans and their assistant systems. We show how implicit cues provided by humans during interactions can be capitalized on to improve learning-based assistants. User interactions with our proof- of-concept systems aid us in providing recommendations for the design of future assistant systems, particularly in the case of real-time speed advisors. We also provide recommendations for direct communication strategies and showcase their effects on user experiences. Overall, the work presented in this dissertation shows that learning-based techniques for human behavior modeling that lead to robust human-behavior prediction are beneficial in aiding user experiences while also leading to improved performance of the human-assistant team.

Graduation Semester

2024-12

Type of Resource

Thesis

Handle URL

https://hdl.handle.net/2142/127231

Copyright and License Information

Copyright 2024 Aamir Hasan

Owning Collections