augmented lagrangian method

Optimality conditions for nonlinear second-order cone programming and symmetric cone programming

  • Roberto Andreani
  • Ellen H. Fukuda
  • Gabriel Haeser
  • Daiana O. Santos
  • Leonardo D. Secchin
    • Categories Linear, Cone and Semidefinite Programming, Nonlinear Optimization, Second-Order Cone Programming Tags , , , ,

    Nonlinear symmetric cone programming (NSCP) generalizes important optimization problems such as nonlinear programming, nonlinear semidefinite programming and nonlinear second-order cone programming (NSOCP). In this work, we present two new optimality conditions for NSCP without constraint qualifications, which implies the Karush-Kuhn-Tucker conditions under a condition weaker than Robinson’s constraint qualification. In addition, we show the relationship … Read more

    A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

  • Dunbiao Niu
  • Enbin Song
  • Peipei Tang
  • Qingsong Wang
  • Chengjing Wang
    • Categories Convex and Nonsmooth Optimization, Data-Mining Tags , ,

    Support vector machines (SVMs) are successful modeling and prediction tools with a variety of applications. Previous work has demonstrated the superiority of the SVMs in dealing with the high dimensional, low sample size problems. However, the numerical difficulties of the SVMs will become severe with the increase of the sample size. Although there exist many … Read more

    A New Sequential Updating Scheme of the Lagrange Multiplier for Multi-Block Linearly Constrained Separable Convex Optimization with Relaxed Step Sizes

  • Yuan Shen
  • Xiayang Zhang
  • Yannian Zuo
    • Categories Convex Optimization Tags , , ,

    In various applications such as signal/image processing, data mining, statistical learning and etc., the multi-block linearly constrained separable convex optimization is frequently used, where the objective function is the sum of multiple individual convex functions, and the major constraints are linear. A classical method for solving such kind of optimization problem could be the alternating … Read more

    Complexity and performance of an Augmented Lagrangian algorithm

  • Ernesto G. Birgin
  • José Mario Martínez
    • Categories Constrained Nonlinear Optimization Tags , , ,

    Algencan is a well established safeguarded Augmented Lagrangian algorithm introduced in [R. Andreani, E. G. Birgin, J. M. Martínez and M. L. Schuverdt, On Augmented Lagrangian methods with general lower-level constraints, SIAM Journal on Optimization 18, pp. 1286-1309, 2008]. Complexity results that report its worst-case behavior in terms of iterations and evaluations of functions and … Read more

    On the Complexity of an Augmented Lagrangian Method for Nonconvex Optimization

  • Geovani Nunes Grapiglia
  • Ya-xiang Yuan
    • Categories Nonlinear Optimization Tags , , ,

    In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$ outer iterations for the referred algorithm to generate an $\epsilon$-approximate KKT point, for $\epsilon\in (0,1)$. When the penalty parameters are unbounded, we prove … Read more

    Indefinite linearized augmented Lagrangian method for convex programming with linear inequality constraints

  • Bingsheng He
  • Shengjie Xu
  • Jing Yuan
    • Categories Convex and Nonsmooth Optimization, Convex Optimization Tags , , , ,

    The augmented Lagrangian method (ALM) is a benchmark for tackling the convex optimization problem with linear constraints; ALM and its variants for linearly equality-constrained convex minimization models have been well studied in the literatures. However, much less attention has been paid to ALM for efficiently solving the linearly inequality-constrained convex minimization model. In this paper, … Read more

    An Augmented Lagrangian algorithm for nonlinear semidefinite programming applied to the covering problem

  • Ernesto G. Birgin
  • Walter Gómez
  • Gabriel Haeser
  • Leonardo M. Mito
  • Daiana O. Santos
    • Categories Constrained Nonlinear Optimization, Convex Optimization, Semi-definite Programming Tags , , ,

    In this work we present an Augmented Lagrangian algorithm for nonlinear semidefinite problems (NLSDPs), which is a natural extension of its consolidated counterpart in nonlinear programming. This method works with two levels of constraints; one that is penalized and other that is kept within the subproblems. This is done in order to allow exploiting the … Read more

    A two-level distributed algorithm for nonconvex constrained optimization

  • Xu Andy Sun
  • Kaizhao Sun
    • Categories Network Optimization, Nonlinear Optimization, Parallel Algorithms Tags , ,

    This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are nonlinear power flow equations, or an abstract one that represents constraint couplings between decision variables of different agents. Despite the … Read more

    Towards an efficient Augmented Lagrangian method for convex quadratic programming

  • Luís Felipe Bueno
  • Gabriel Haeser
  • Luiz-Rafael Santos
    • Categories Constrained Nonlinear Optimization, Linear Programming, Quadratic Programming Tags , , , ,

    Interior point methods have attracted most of the attention in the recent decades for solving large scale convex quadratic programming problems. In this paper we take a different route as we present an augmented Lagrangian method for convex quadratic programming based on recent developments for nonlinear programming. In our approach, box constraints are penalized while … Read more

    A Partial PPA block-wise ADMM for Multi-Block Constrained Separable Convex Optimization

  • Yuan Shen
    • Categories Applications - OR and Management Sciences, Unconstrained Optimization Tags , , ,

    The alternating direction method of multipliers(ADMM) has been proved to be effective for solving two-block separable convex optimization subject to linear constraints. However, it is not necessarily convergent when it is extended to multiple-block case directly. One remedy could be regrouping multiple-block variables into two groups firstly and then adopting the classic ADMM to the … Read more