accelerated algorithm

Accelerated projected gradient algorithms for sparsity constrained optimization problems

  • Jan Harold Alcantara
  • Ching-pei Lee
    • Categories Constrained Nonlinear Optimization, Nonlinear Optimization Tags , ,

    \(\) We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an \(\ell_0\)-norm constraint. Through decomposing the feasible set of the given sparsity constraint as a finite union of linear subspaces, we present two acceleration schemes with global convergence guarantees, one by same-space extrapolation … Read more

    Smoothing fast iterative hard thresholding algorithm for $\ell_0$ regularized nonsmooth convex regression problem

  • Wei Bian
  • Fan Wu
  • Xiaoping Xue
    • Categories Nonlinear Optimization Tags , , , , ,

    We investigate a class of constrained sparse regression problem with cardinality penalty, where the feasible set is defined by box constraint, and the loss function is convex, but not necessarily smooth. First, we put forward a smoothing fast iterative hard thresholding (SFIHT) algorithm for solving such optimization problems, which combines smoothing approximations, extrapolation techniques and … Read more