Reinforcement learning and optimization methods in sensor networks

Muthuveeru-Subramaniam, Adarsh

Permalink

https://hdl.handle.net/2142/129955 Copy

Description

Title

Reinforcement learning and optimization methods in sensor networks

Author(s)

Muthuveeru-Subramaniam, Adarsh

Issue Date

2025-07-18

Director of Research (if dissertation) or Advisor (if thesis)

Veeravalli, Venugopal V

Doctoral Committee Chair(s)

Veeravalli, Venugopal V

Committee Member(s)

• Moulin, Pierre
• Varshney, Lav R
• Chatterjee, Sabyasachi
• Zachary Hare, James

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Reinforcement learning
• Optimization
• Sensor networks

Abstract

Distributed Sensor Networks (DSNs) [1] are ubiquitous in civilian and military applications, with a wide range of uses including motion detection, healthcare, remote sensing, surveillance, and imaging. The deployment of DSNs involves various constraints on the sensor nodes and the network, such as i) bandwidth-limited communication ii) power consumption iii) response time of sensor nodes iv) compute limitations and many others. For instance, a DSN deployed in a battlefield must exhibit low power consumption and fast sensor response time to external stimuli within a bandwidth-limited communication network. In recent years, computing power has undergone significant advancements, largely propelled by improvements in System-on-Chip (SoC) technologies. These improvements have paved the way for the integration of Machine Learning (ML) capabilities into sensor nodes. Machine learning algorithms often leverage neural networks, which demand substantial memory, bandwidth, and computational resources. Consequently, this imposes heightened bandwidth and power requisites on DSNs to support ML implementation in sensor nodes. Thus, there arises a pressing need for innovative algorithms aimed at resource optimization within DSNs, a challenge that we address in this thesis. Resource optimization algorithms for DSNs vary based on their topology. In this thesis, we focus on DSNs characterized by a centralized structure, comprising a central controller/central node and numerous sensor nodes. Notably, the sensors can communicate only with the central node. Within the scope of this thesis, we refer to this topology as the central topology. Within central topology DSNs, we tackle two distinct problems; i) energy efficient model-free approach to tracking an object moving through a sensing grid ii) bandwidth-efficient methods for learning a machine learning model at the central controller using data gathered from the sensor nodes. We address the problem of energy efficient model-free tracking though the lens of RL (Reinforcement Learning) and the problem of bandwidth efficient learning through compressed distributed Stochastic Gradient Descent (SGD).

Graduation Semester

2025-08

Type of Resource

Thesis

Handle URL

https://hdl.handle.net/2142/129955

Copyright and License Information

Copyright 2025 Adarsh Muthuveeru-Subramaniam

Owning Collections