steepest descent

On the convergence rate of the Cauchy algorithm in the l2 norm

  • Elizabeth Wegner Karas
  • Ademir A. Ribeiro
  • Alessandra M. Mota
    • Categories Nonlinear Optimization, Unconstrained Optimization Tags , ,

    This paper presents a convergence rate for the sequence generated by the Cauchy algorithm. The method is applied to a convex quadratic function with exact line search. Instead of using the norm induced by the hessian matrix, the q-linear convergence is shown for the l2 (or Euclidean) norm. CitationTecnhical Report, Dep. Mathematics, Federal University of … Read more

    Convergence rate estimates for the gradient differential inclusion

  • Osman Guler
    • Categories Convex Optimization, Nonsmooth Optimization Tags , , ,

    Let f be a lower semi-continuous convex function in a Euclidean space, finite or infinite dimensional. The gradient differential inclusion is a generalized differential equation which requires that -x'(t) be in the subgradient of f at x. It is the continuous versions of the gradient descent method for minimizing f in case f is differentiable, … Read more