Files in this item
Files | Description | Format |
---|---|---|
application/pdf ![]() ![]() | (no description provided) |
Description
Title: | Bayesian high dimensional modeling with group structures |
Author(s): | Yang, Xinming |
Director of Research: | Narisetty, Naveen Naidu |
Doctoral Committee Chair(s): | Narisetty, Naveen Naidu |
Doctoral Committee Member(s): | Chen, Yuguo; Koyejo, Oluwasanmi; Liang, Feng |
Department / Program: | Statistics |
Discipline: | Statistics |
Degree Granting Institution: | University of Illinois at Urbana-Champaign |
Degree: | Ph.D. |
Genre: | Dissertation |
Subject(s): | group variable selection
graphical models sequential logistic regressions spike and slab priors Bayesian regularization |
Abstract: | Group structures arise naturally in a variety of modern data applications and statistical problems in the high-dimensional data setting where the number of variables can greatly exceed the number of observations. The group structures are usually very informative as they express the inherent similarities among the variables and observations and it is thus desirable to take the prior group information into consideration in the construction of statistical models in pursuit of efficient statistical inference. In this dissertation, we propose methods for three statistical problems: linear regression, graphical model, and sequential logistic regressions when group structures are present at either the variable level or the observation level. We adopt the Bayesian framework and extend the spike-and-slab priors in the group setting to incorporate the group information. Our proposed hierarchical Bayesian models are well suited for sharing of similar sparsity patterns within the groups. For posterior computation, we propose EM algorithms and shotgun stochastic search algorithm which are more efficient than standard Markov chain Monte Carlo sampling algorithms. Compared to methods that simply ignore the grouping structure, our proposed methods that involve the group information can lead to better statistical inference results and the fitted models are more interpretable and provide more insights into the data. Further, we show that our methods are also advantageous theoretically or empirically in comparison with other group selection competitors due to the nonconvex regularization induced from our Bayesian modeling. |
Issue Date: | 2020-05-06 |
Type: | Thesis |
URI: | http://hdl.handle.net/2142/108158 |
Rights Information: | Copyright 2020 Xinming Yang |
Date Available in IDEALS: | 2020-08-26 |
Date Deposited: | 2020-05 |
This item appears in the following Collection(s)
-
Dissertations and Theses - Statistics
-
Graduate Dissertations and Theses at Illinois
Graduate Theses and Dissertations at Illinois