Proximal Stochastic Methods for Nonsmooth Nonconvex Finite-Sum OptimizationEI
NIPS, pp. 1145-1153, 2016.
We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem is very limited. For example, it is not known whether the proximal stochastic gradient method with constant minibatch converges to a s...More