University of Illinois Urbana-Champaign

Generative models and robustness in deep learning for inverse problems

Raj, Ankit

Content Files
RAJ-THESIS-2020.pdf

Permalink

https://hdl.handle.net/2142/108005

Description

Title
Generative models and robustness in deep learning for inverse problems
Author(s)
Raj, Ankit
Issue Date
2020-05-11
Director of Research (if dissertation) or Advisor (if thesis)
Bresler, Yoram
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2020-08-26T21:54:56Z
Keyword(s)
  • Image Reconstruction
  • Adversarial Training
Abstract
Image reconstruction comprises several real-life applications such as super-resolution and in painting as well as critical medical imaging problems like CT and MRI. Deep learning based methods have recently been demonstrated to achieve state-of-the-art results on such tasks. In this thesis, we address two important aspects related to deep-learning-based image reconstruction – (i) architecture design and guarantees, and (ii) robustness and stability. To address the first aspect, we propose (joint work with Yuqi Li) a new method of deploying a GAN-based prior to solve linear inverse problems using projected gradient descent (PGD). Experiments show that our approach provides a speed-up of 60-80× over earlier GAN-based recovery methods along with better accuracy. Our main theoretical result is that if the measurement matrix is moderately conditioned on the manifold range R(G) and the projector is δ-approximate, then the algorithm is guaranteed to reach O(δ) recovery error in O(log(1/δ)) steps in low noise regime. Secondly, we argue that for inverse problem solvers, one should analyze and study the effect of adversaries and robustness in the measurement-space, instead of formulating in the signal-space as in previous work. We propose to introduce an auxiliary network to generate adversarial examples, which is used in a min-max formulation to build robust image reconstruction networks. Theoretically, we show for a linear reconstruction scheme the min-max formulation results in a singular-value(s) filter regularized solution, which suppresses the effect of adversarial examples occurring because of ill-conditioning in the measurement matrix. Furthermore, we propose to use the idea of interval-bound propagation to minimize an upper bound on the reconstruction loss, given the perturbation. We show that it is computationally more efficient and gives slightly better performance in terms of robustness than the adversarial training based method that we proposed.
Graduation Semester
2020-05
Type of Resource
Thesis
Permalink
http://hdl.handle.net/2142/108005
Copyright and License Information
Copyright 2020 Ankit Raj

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Electrical and Computer Engineering
Dissertations and Theses in Electrical and Computer Engineering