Stepsize Hedging: An Alternative Mechanism for Accelerating Gradient Descent

  • Jason M. Altschuler
  • Pablo A. Parrilo
    • Categories Other Topics Short URL: https://optimization-online.org/?p=34993

    Can gradient descent be accelerated by just choosing better stepsizes? Surprisingly, the answer is yes. This short expository article provides an accessible introduction to this phenomenon of stepsize hedging.

    Article

    Download

    View PDF