Yifan Sun

Accelerating Frank-Wolfe via Averaging Step Directions

  • Zhaoyue Chen
  • Yifan Sun
    • Categories Convex Optimization Tags ,

    The Frank-Wolfe method is a popular method in sparse constrained optimization, due to its fast per-iteration complexity. However, the tradeoff is that its worst case global convergence is comparatively slow, and importantly, is fundamentally slower than its flow rate–that is to say, the convergence rate is throttled by discretization error. In this work, we consider … Read more

    Are we there yet? Manifold identification of gradient-related proximal methods

  • Halyun Jeong
  • Mark Schmidt
  • Julie Nutini
  • Yifan Sun
    • Categories Convex Optimization

    In machine learning, models that generalize better often generate outputs that lie on a low-dimensional manifold. Recently, several works have separately shown finite-time manifold identification by some proximal methods. In this work we provide a unified view by giving a simple condition under which any proximal method using a constant step size can achieve finite-iteration … Read more