Files in this item
Files | Description | Format |
---|---|---|
application/pdf ![]() | (no description provided) |
Description
Title: | Gaussian Smoothing and Asymptotic Convexity |
Author(s): | Mobahi, Hossein; Ma, Yi |
Subject(s): | Asymptotic convexity
Gaussian smoothing |
Abstract: | Smoothing (say by a Guassian kernel) has been a very popular technique for optimizing a nonconvex objective function. The rationale behind smoothing is that the smoothed function has less spurious local minima than the original one. This technique has seen tremendous success in many real world tasks such as those arising in machine learning and computer vision. Despite its empirical success, there has been little theoretical understanding about the effect of smoothing in optimization. This work rigorously studies some of the fundamental properties of the smoothing technique. In particular, we present a formal definition for the functions that can eventually become convex by smoothing. We clarify the related necessary and sufficient conditions and present a closed-form expression for the minimizer of the resulted smoothed function, when it satisfies certain decay conditions. |
Issue Date: | 2012-03 |
Publisher: | Coordinated Science Laboratory, University of Illinois at Urbana-Champaign |
Series/Report: | Coordinated Science Laboratory Report no. UILU-ENG-12-2201, DC-254 |
Genre: | Report (Grant or Annual) |
Type: | Text |
Language: | English |
Description: | Coordinated Science Laboratory was formerly known as Control Systems Laboratory |
URI: | http://hdl.handle.net/2142/74360 |
Sponsor: | National Science Foundation / NSF IIS 11-16012 |
Date Available in IDEALS: | 2015-04-06 2017-07-14 |