Nonlinear Optimization

Quadratic regularization with cubic descent for unconstrained optimization

  • Ernesto G. Birgin
  • José Mario Martínez
    • Categories Unconstrained Optimization Tags , , , ,

    Cubic-regularization and trust-region methods with worst case first-order complexity $O(\varepsilon^{-3/2})$ and worst-case second-order complexity $O(\varepsilon^{-3})$ have been developed in the last few years. In this paper it is proved that the same complexities are achieved by means of a quadratic regularization method with a cubic sufficient-descent condition instead of the more usual predicted-reduction based descent. … Read more

    On the local convergence analysis of the Gradient Sampling method

  • Elias Salomão Helou
  • Sandra Augusta Santos
  • Lucas E. A. Simões
    • Categories Convex and Nonsmooth Optimization, Nonlinear Optimization

    The Gradient Sampling method is a recently developed tool for solving unconstrained nonsmooth optimization problems. Using just first order information about the objective function, it generalizes the steepest descent method, one of the most classical methods to minimize a smooth function. This manuscript aims at determining under which circumstances one can expect the same local … Read more

    Error bounds for nonlinear semidefinite optimization

  • Hiroshi Yamashita
    • Categories Nonlinear Optimization Tags ,

    In this paper, error bounds for nonlinear semidefinite optimization problem is considered. We assume the second order sufficient condition, the strict complementarity condition and the MFCQ condition at the KKT point. The nondegeneracy condition is not assumed in this paper. Therefore the Jacobian operator of the equality part of the KKT conditions is not assumed … Read more

    Complete mixed integer linear programming formulations for modularity density based clustering

  • Alberto Costa
  • Lin Xuan Foo
  • Tsan Sheng Ng
    • Categories (Mixed) Integer Linear Programming, Network Optimization, Nonlinear Optimization

    Modularity density maximization is a clustering method that improves some issues of the commonly-used modularity maximization approach. Recently, some Mixed-Integer Linear Programming (MILP) reformulations have been proposed in the literature for the modularity density maximization problem, but they require as input the solution of a set of auxiliary binary Non-Linear Programs (NLPs). These can become … Read more

    Analysis and Implementation of an Asynchronous Optimization Algorithm for the Parameter Server

  • Arda Aytekin
  • Hamid Reza Feyzmahdavian
  • Mikael Johansson
    • Categories Convex and Nonsmooth Optimization, Nonlinear Optimization, Parallel Algorithms Tags , , , ,

    This paper presents an asynchronous incremental aggregated gradient algorithm and its implementation in a parameter server framework for solving regularized optimization problems. The algorithm can handle both general convex (possibly non-smooth) regularizers and general convex constraints. When the empirical data loss is strongly convex, we establish linear convergence rate, give explicit expressions for step-size choices … Read more

    R-Linear Convergence of Limited Memory Steepest Descent

  • Frank E. Curtis
  • Wei Guo
    • Categories Nonlinear Optimization, Unconstrained Optimization

    The limited memory steepest descent method (LMSD) proposed by Fletcher is an extension of the Barzilai-Borwein “two-point step size” strategy for steepest descent methods for solving unconstrained optimization problems. It is known that the Barzilai-Borwein strategy yields a method with an R-linear rate of convergence when it is employed to minimize a strongly convex quadratic. … Read more

    Optimized choice of parameters in interior-point methods for linear programming

  • Aurelio Ribeiro Leite Oliveira
  • Luiz-Rafael Santos
  • Clovis Perin
  • Fernando Villas-Bôas
    • Categories Linear Programming, Quadratic Programming Tags , ,

    In this work, we propose a predictor-corrector interior point method for linear programming in a primal-dual context, where the next iterate is chosen by the minimization of a polynomial merit function of three variables: the first is the steplength, the second defines the central path and the third models the weight of a corrector direction. … Read more

    Can linear superiorization be useful for linear optimization problems?

  • Yair Censor
    • Categories Constrained Nonlinear Optimization, Linear Programming, Problem Solving Environments Tags , , , , , , , , ,

    Linear superiorization considers linear programming problems but instead of attempting to solve them with linear optimization methods it employs perturbation resilient feasibility-seeking algorithms and steers them toward reduced (not necessarily minimal) target function values. The two questions that we set out to explore experimentally are (i) Does linear superiorization provide a feasible point whose linear … Read more

    Linear superiorization for infeasible linear programming

  • Yair Censor
  • Yehuda Zur
    • Categories Constrained Nonlinear Optimization, Linear Programming

    Linear superiorization (abbreviated: LinSup) considers linear programming (LP) problems wherein the constraints as well as the objective function are linear. It allows to steer the iterates of a feasibility-seeking iterative process toward feasible points that have lower (not necessarily minimal) values of the objective function than points that would have been reached by the same … Read more

    An Augmented Lagrangian Filter Method for Real-Time Embedded Optimization

  • Nai-Yuan Chiang
  • Victor M. Zavala
  • Rui Huang
    • Categories Applications - Science and Engineering, Nonlinear Optimization, Optimization Software and Modeling Systems Tags , , , ,

    We present a filter line-search algorithm for nonconvex continuous optimization that combines an augmented Lagrangian function and a constraint violation metric to accept and reject steps. The approach is motivated by real-time optimization applications that need to be executed on embedded computing platforms with limited memory and processor speeds. In particular, the proposed method enables … Read more