Bayesian high dimensional modeling with group structures

Yang, Xinming

Permalink

https://hdl.handle.net/2142/108158 Copy

Description

Title

Bayesian high dimensional modeling with group structures

Author(s)

Yang, Xinming

Issue Date

2020-05-06

Director of Research (if dissertation) or Advisor (if thesis)

Narisetty, Naveen Naidu

Doctoral Committee Chair(s)

Narisetty, Naveen Naidu

Committee Member(s)

• Chen, Yuguo
• Koyejo, Oluwasanmi
• Liang, Feng

Department of Study

Statistics

Discipline

Statistics

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• group variable selection
• graphical models
• sequential logistic regressions
• spike and slab priors
• Bayesian regularization

Abstract

Group structures arise naturally in a variety of modern data applications and statistical problems in the high-dimensional data setting where the number of variables can greatly exceed the number of observations. The group structures are usually very informative as they express the inherent similarities among the variables and observations and it is thus desirable to take the prior group information into consideration in the construction of statistical models in pursuit of efficient statistical inference. In this dissertation, we propose methods for three statistical problems: linear regression, graphical model, and sequential logistic regressions when group structures are present at either the variable level or the observation level. We adopt the Bayesian framework and extend the spike-and-slab priors in the group setting to incorporate the group information. Our proposed hierarchical Bayesian models are well suited for sharing of similar sparsity patterns within the groups. For posterior computation, we propose EM algorithms and shotgun stochastic search algorithm which are more efficient than standard Markov chain Monte Carlo sampling algorithms. Compared to methods that simply ignore the grouping structure, our proposed methods that involve the group information can lead to better statistical inference results and the fitted models are more interpretable and provide more insights into the data. Further, we show that our methods are also advantageous theoretically or empirically in comparison with other group selection competitors due to the nonconvex regularization induced from our Bayesian modeling.

Graduation Semester

2020-05

Type of Resource

Thesis

Permalink

http://hdl.handle.net/2142/108158

Copyright and License Information

Copyright 2020 Xinming Yang

Owning Collections