University of Illinois Urbana-Champaign

Topics on statistical inference with model uncertainty

Deshmukh, Aditya Omprakash

Content Files
DESHMUKH-DISSERTATION-2024.pdf

Permalink

https://hdl.handle.net/2142/124309

Description

Title
Topics on statistical inference with model uncertainty
Author(s)
Deshmukh, Aditya Omprakash
Issue Date
2024-04-17
Director of Research (if dissertation) or Advisor (if thesis)
Veeravalli, Venugopal V
Doctoral Committee Chair(s)
Veeravalli, Venugopal V
Committee Member(s)
  • Moulin, Pierre
  • Raginsky, Maxim
  • Fellouris, Georgios
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
  • Statistical Inference
  • Model Uncertainty
  • Information Theory
Abstract
Statistical inference is a method of data analysis used for drawing conclusions about underlying probability distributions in a statistical model and making decisions based on inferred knowledge. Classically, the theory of statistical inference was developed for the purposes of hypothesis testing and estimation of model parameters. With the advent of machine learning, several new challenging data-driven inference problems have been emerging, in which knowledge of underlying models available to the decision-maker is incomplete or ambiguous. In this dissertation, we explore and study broadly three problems in the area of statistical inference under model uncertainty. In these problems, the uncertainty arises due to the fact that either partial or no knowledge of ground truth data distributions is assumed. We approach these problems using techniques from statistics, optimization, and information theory, to understand their fundamental limits and develop theory-based algorithms with guarantees. These three problems lie in diverse sub-fields, namely, sequential controlled sensing for composite multi-hypothesis testing, robust mean estimation, and distributed feature compression. In the problems of controlled sensing and robust mean estimation, our main contributions are optimal algorithms based on statistical analysis, which are guaranteed to achieve information-theoretic limits, and exhibit competitive empirical performance. In the problem of distributed feature compression, our main contribution is a distributed compression scheme for pretrained learning models, which is based on the form of optimal quantizers derived for pretrained linear regressors assuming knowledge of underlying data distribution. In all problems discussed, we demonstrate effectiveness of proposed algorithms through experiments.
Graduation Semester
2024-05
Type of Resource
Thesis
Handle URL
https://hdl.handle.net/2142/124309
Copyright and License Information
Copyright 2024 Aditya Deshmukh

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois