Opening cabinets and drawers in the real world using a commodity mobile manipulator

Zhang, Michelle

Permalink

https://hdl.handle.net/2142/124390 Copy

Description

Title

Opening cabinets and drawers in the real world using a commodity mobile manipulator

Author(s)

Zhang, Michelle

Issue Date

2024-04-29

Director of Research (if dissertation) or Advisor (if thesis)

Gupta, Saurabh

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

• articulated manipulation
• mobile manipulation

Abstract

Pulling open cabinets and drawers presents many difficult technical challenges in perception (inferring articulation parameters for objects from onboard sensors), planning (producing motion plans that conform to tight task constraints), and control (making and maintaining contact while applying forces on the environment). In this work, we build an end-to-end system that enables a commodity mobile manipulator (Stretch RE2) to pull open cabinets and drawers in diverse previously unseen real world environments. We conduct four days of real world testing of this system spanning 31 different objects from across 13 different real world environments. Our system achieves a success rate of 61% on opening novel cabinets and drawers in unseen environments zero-shot. An analysis of the failure modes suggests that errors in perception are the most significant challenge for our system. We will open source code and models for others to replicate and build upon our system.

Graduation Semester

2024-05

Type of Resource

Thesis

Handle URL

https://hdl.handle.net/2142/124390

Copyright and License Information

Copyright 2024 Michelle Zhang

Owning Collections