abs-smooth functions

On a Frank-Wolfe Approach for Abs-smooth Functions

  • Timo Kreimeier
  • Sebastian Pokutta
  • Andrea Walther
  • Zev Woodstock
    • Categories Constrained Nonlinear Optimization, Nonsmooth Optimization, Other Topics Tags , , , ,

    We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our nonsmooth nonconvex problem setting is motivated by machine learning, since the broad class of abs-smooth functions includes, for instance, the squared $l_2$-error of a neural network with ReLU or hinge loss activation. To … Read more