homotopy continuation

An adaptive accelerated proximal gradient method and its homotopy continuation for sparse optimization

  • Qihang Lin
  • Lin Xiao
    • Categories Convex and Nonsmooth Optimization Tags , , ,

    We consider optimization problems with an objective function that is the sum of two convex terms: one is smooth and given by a black-box oracle, and the other is general but with a simple, known structure. We first present an accelerated proximal gradient (APG) method for problems where the smooth part of the objective function … Read more

    A Proximal-Gradient Homotopy Method for the Sparse Least-Squares Problem

  • Lin Xiao
  • Tong Zhang
    • Categories Convex and Nonsmooth Optimization Tags , , ,

    We consider solving the $\ell_1$-regularized least-squares ($\ell_1$-LS) problem in the context of sparse recovery, for applications such as compressed sensing. The standard proximal gradient method, also known as iterative soft-thresholding when applied to this problem, has low computational cost per iteration but a rather slow convergence rate. Nevertheless, when the solution is sparse, it often … Read more