Real-world autonomy in uncertain and unknown environments

Thangeda, Pranay

Permalink

https://hdl.handle.net/2142/129472 Copy

Description

Title

Real-world autonomy in uncertain and unknown environments

Author(s)

Thangeda, Pranay

Issue Date

2025-05-01

Director of Research (if dissertation) or Advisor (if thesis)

Ornik, Melkior

Doctoral Committee Chair(s)

Ornik, Melkior

Committee Member(s)

• Tran, Huy T.
• Allison, James
• Hauser, Kris K.

Department of Study

Aerospace Engineering

Discipline

Aerospace Engineering

Degree Granting Institution

University of Illinois Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Autonomous Systems
• Robotics
• Space Robotics
• Mars Rover Navigation
• Planetary Rovers
• Unmanned Systems
• Artificial Intelligence (AI)
• Machine Learning
• Reinforcement Learning
• Efficient Learning
• Accelerated Learning
• Planning under Uncertainty
• Decision-Theoretic Planning
• Markov Decision Processes (MDPs)
• Stochastic Control
• Unknown Environments
• Stochastic Environments
• Unknown Dynamics
• Side Information Integration
• Indirect Sampling
• Sample Efficiency
• Exploration-Exploitation
• Bayesian Exploration
• Value of Information
• Agent Safety
• Safety Guarantees
• Safe Reinforcement Learning
• Optimal Routing
• Stochastic Travel Times
• Spatial Correlations
• Multiobjective Optimization
• Onboard Sensors
• Real-time Data

Abstract

Real-world autonomy in uncertain and unknown environments presents fundamental challenges that go beyond the controlled settings where most robotic systems are developed and tested. This dissertation develops a comprehensive framework for achieving robust autonomy by strategically leveraging the structure of different domains---from completely unknown environments requiring rapid online adaptation to partially known systems amenable to proactive planning under uncertainty. The first part of my research tackles the challenge of learning for deployment-time adaptation in completely unknown environments. I introduce a novel meta-learning approach that enables robots to adapt to drastically different granular materials with minimal online data by explicitly training for large domain shifts. Building on this foundation, I develop a closed-loop control system that fuses visual motion field with force feedback to enable dynamic adaptation during individual scooping actions. For extraterrestrial exploration, I present an adaptive sampling strategy that balances information gathering with operational constraints and risk of failure. Finally, I address continual learning in unknown environments through an adaptation strategy that enables both rapid adaptation to new domains and retention of knowledge about previously encountered scenarios. The second part explores learning and planning for uncertain deployment-time configurations, where some prior knowledge exists but specific conditions remain unknown until deployment. For crop management, I develop a constrained reinforcement learning approach that explicitly incorporates operational restrictions while handling environmental uncertainty. I scale these concepts to large agricultural order fulfillment through a hybrid tree search algorithm that combines domain knowledge with online planning. Finally, I introduce InfraLib, a comprehensive framework for modeling and managing large-scale infrastructure systems, demonstrating how appropriate computational tools can enable learning-based approaches for practical deployment challenges at massive scale. My research demonstrates that effective real-world autonomy requires carefully balancing between simulation, problem structure exploitation, and online adaptation based on the specific characteristics of the domain. The methods are validated through extensive experiments in physical testbeds and real-world case studies across domains ranging from robotic manipulation to infrastructure management. This dissertation advances our understanding of how to develop autonomous systems that can operate reliably in real-world settings by appropriately leveraging available knowledge while maintaining the ability to adapt to unknown conditions.

Graduation Semester

2025-05

Type of Resource

Thesis

Handle URL

https://hdl.handle.net/2142/129472

Copyright and License Information

Copyright 2025 Pranay Thangeda

Owning Collections