Constrained Nonlinear Optimization

A Framework of Inertial Alternating Direction Method of Multipliers for Non-Convex Non-Smooth Optimization

  • Nicolas Gillis
  • Le Thi Khanh Hien
  • Duy Nhat Phan
    • Categories Constrained Nonlinear Optimization Tags , , ,

    In this paper, we propose an algorithmic framework dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our framework employs the general minimization-majorization (MM) principle to update each block of variables so as to not only unify the convergence analysis of previous … Read more

    A General Framework for Optimal Control of Fractional Nonlinear Delay Systems by Wavelets

  • Malmir Iman
    • Categories Applications - Science and Engineering, Constrained Nonlinear Optimization, Nonlinear Optimization Tags , , , , ,

    An iterative procedure to find the optimal solutions of general fractional nonlinear delay systems with quadraticperformance indices is introduced. The derivatives of state equations are understood in the Caputo sense. By presenting and applying a general framework, we use the Chebyshev wavelet method developed for fractional linear optimal control to convert fractional nonlinear optimal control … Read more

    Beyond local optimality conditions: the case of maximizing a convex function

  • Aharon Ben-Tal
  • Ernst Roos
    • Categories Constrained Nonlinear Optimization, Global Optimization Tags , ,

    In this paper, we design an algorithm for maximizing a convex function over a convex feasible set. The algorithm consists of two phases: in phase 1 a feasible solution is obtained that is used as an initial starting point in phase 2. In the latter, a biconvex problem equivalent to the original problem is solved … Read more

    How do exponential size solutions arise in semidefinite programming?

  • Gabor Pataki
  • Aleksandr Touzov
    • Categories Constrained Nonlinear Optimization, Convex Optimization, Semi-definite Programming

    Semidefinite programs (SDPs) are some of the most popular and broadly applicable optimization problems to emerge in the last thirty years. A curious pathology of SDPs, illustrated by a classical example of Khachiyan, is that their solutions may need exponential space to even write down. Exponential size solutions are the main obstacle to solve a … Read more

    A Matrix-Free Trust-Region Newton Algorithm for Convex-Constrained Optimization

  • Drew P. Kouri
    • Categories Constrained Nonlinear Optimization, Infinite Dimensional Optimization, Nonlinear Optimization Tags , , , ,

    We describe a matrix-free trust-region algorithm for solving convex-constrained optimization problems that uses the spectral projected gradient method to compute trial steps. To project onto the intersection of the feasible set and the trust region, we reformulate and solve the dual projection problem as a one-dimensional root finding problem. We demonstrate our algorithm’s performance on … Read more

    ALESQP: An augmented Lagrangian equality-constrained SQP method for optimization with general constraints

  • Harbir Antil
  • Drew P. Kouri
  • Denis Ridzal
    • Categories Constrained Nonlinear Optimization, Infinite Dimensional Optimization, Nonlinear Optimization

    We present a new algorithm for infinite-dimensional optimization with general constraints, called ALESQP. In short, ALESQP is an augmented Lagrangian method that penalizes inequality constraints and solves equality-constrained nonlinear optimization subproblems at every iteration. The subproblems are solved using a matrix-free trust-region sequential quadratic programming (SQP) method that takes advantage of iterative, i.e., inexact linear … Read more

    Weak notions of nondegeneracy in nonlinear semidefinite programming

  • Roberto Andreani
  • Gabriel Haeser
  • Leonardo M. Mito
  • Héctor Ramírez
    • Categories Constrained Nonlinear Optimization, Linear, Cone and Semidefinite Programming, Semi-definite Programming Tags , ,

    The constraint nondegeneracy condition is one of the most relevant and useful constraint qualifications in nonlinear semidefinite programming. It can be characterized in terms of any fixed orthonormal basis of the, let us say, $\ell$-dimensional kernel of the constraint matrix, by the linear independence of a set of $\ell(\ell+1)/2$ derivative vectors. We show that this … Read more

    A Distributed and Secure Algorithm for Computing Dominant SVD Based on Projection Splitting

  • Xin Liu
  • Lei Wang
  • Yin Zhang
    • Categories Constrained Nonlinear Optimization, Parallel Algorithms Tags , , ,

    In this paper, we propose and study a distributed and secure algorithm for computing dominant (or truncated) singular value decompositions (SVD) of large and distributed data matrices. We consider the scenario where each node privately holds a subset of columns and only exchanges “safe” information with other nodes in a collaborative effort to calculate a … Read more

    Multipliers Correction Methods for Optimization Problems over the Stiefel Manifold

  • Bin Gao
  • Xin Liu
  • Lei Wang
    • Categories Constrained Nonlinear Optimization Tags , , ,

    We propose a class of multipliers correction methods to minimize a differentiable function over the Stiefel manifold. The proposed methods combine a function value reduction step with a proximal correction step. The former one searches along an arbitrary descent direction in the Euclidean space instead of a vector in the tangent space of the Stiefel … Read more

    Homogeneous polynomials and spurious local minima on the unit sphere

  • Jean-Bernard Lasserre
    • Categories Constrained Nonlinear Optimization, Global Optimization Theory

    We consider forms on the Euclidean unit sphere. We obtain obtain a simple and complete characterization of all points that satisfies the standard second-order necessary condition of optimality. It is stated solely in terms of the value of (i) f, (ii) the norm of its gradient, and (iii) the first two smallest eigenvalues of its … Read more