Global Optimization

An Adaptive Proximal ADMM for Nonconvex Linearly-Constrained Composite Programs

  • Leandro Farias Maia
  • David H. Gutman
  • Renato D.C. Monteiro
  • Gilson Silva
    • Categories Convex and Nonsmooth Optimization, Global Optimization Theory, Nonlinear Optimization Tags , , , ,

    This paper develops an adaptive Proximal Alternating Direction Method of Multipliers (P-ADMM) for solving linearly-constrained, weakly convex, composite optimization problems. This method is adaptive to all problem parameters, including smoothness and weak convexity constants. It is assumed that the smooth component of the objective is weakly convex and possibly nonseparable, while the non-smooth component is … Read more

    Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks

  • Anirbit Mukherjee
    • Categories Data Science Algorithms, Global Optimization Theory, Nonlinear Optimization

    In this work, we instantiate a regularized form of the gradient clipping algorithm and prove that it can converge to the global minima of deep neural network loss functions provided that the net is of sufficient width. We present empirical evidence that our theoretically founded regularized gradient clipping algorithm is also competitive with the state-of-the-art … Read more

    Globally Convergent Derivative-Free Methods in Nonconvex Optimization with and without Noise

  • Dat Tran
    • Categories Approximation Algorithms, Global Optimization Applications, Unconstrained Optimization

    This paper addresses the study of nonconvex derivative-free optimization problems, where only information of either smooth objective functions or their noisy approximations is available. General derivative-free methods are proposed for minimizing differentiable (not necessarily convex) functions with globally Lipschitz continuous gradients, where the accuracy of approximate gradients is interacting with stepsizes and exact gradient values. … Read more

    BattOpt: Optimal Facility Planning for Electric Vehicle Battery Recycling

  • Matthew Brun
  • Xu Andy Sun
    • Categories Energy, Global Optimization Applications, Stochastic Programming Tags , , ,

    The electric vehicle (EV) battery supply chain will face challenges in sourcing scarce, expensive minerals required for manufacturing and in disposing of hazardous retired batteries. Integrating recycling technology into the supply chain has the potential to alleviate these issues; however, players in the battery market must design investment plans for recycling facilities. In this paper, … Read more

    MUSE-BB: A Decomposition Algorithm for Nonconvex Two-Stage Problems using Strong Multisection Branching

  • Marco Langiu
  • Manuel Dahmen
  • D. Bongartz
  • Alexander Mitsos
    • Categories Global Optimization, Parallel Algorithms, Stochastic Programming Tags , , , ,

    \(\) We present MUSE-BB, a branch-and-bound (B&B) based decomposition algorithm for the deterministic global solution of nonconvex two-stage stochastic programming problems. In contrast to three recent decomposition algorithms, which solve this type of problem in a projected form by nesting an inner B&B in an outer B&B on the first-stage variables, we branch on all … Read more

    Nonconvex optimization problems involving the Euclidean norm: Challenges, progress, and opportunities

  • Anatoliy Kuznetsov
  • Nikolaos Sahinidis
    • Categories Global Optimization, Optimization Software Benchmark Tags , , ,

    The field of global optimization has advanced significantly over the past three decades. Yet, the solution of even small instances of many nonconvex optimization problems involving the Euclidean norm to global optimality remains beyond the reach of modern global optimization methods. These problems include numerous well-known and high-impact open research questions from a diverse collection … Read more

    Exploiting Sign Symmetries in Minimizing Sums of Rational Functions

  • Jie Wang
  • Feng Guo
    • Categories Constrained Nonlinear Optimization, Global Optimization Applications, Semi-definite Programming Tags , , , ,

    This paper is devoted to the problem of minimizing a sum of rational functions over a basic semialgebraic set. We provide a hierarchy of sum of squares (SOS) relaxations that is dual to the generalized moment problem approach due to Bugarin, Henrion, and Lasserre. The investigation of the dual SOS aspect offers two benefits: 1) … Read more

    Spatial branch-and-bound for nonconvex separable piecewise linear optimization

  • Thomas Hübner
  • Akshay Gupte
  • Steffen Rebennack
    • Categories (Mixed) Integer Linear Programming, Global Optimization Tags , , , ,

    Nonconvex separable piecewise linear functions (PLFs) frequently appear in applications and to approximate nonlinearitites. The standard practice to formulate nonconvex PLFs is from the perspective of discrete optimisation, using special ordered sets and mixed integer linear programs (MILPs). In contrast, we take the viewpoint of global continuous optimization and present a spatial branch-and-bound algorithm (sBB) … Read more

    Strengthening Lasserre’s Hierarchy in Real and Complex Polynomial Optimization

  • Jie Wang
    • Categories Constrained Nonlinear Optimization, Global Optimization Theory, Semi-definite Programming Tags , , , , ,

    We establish a connection between multiplication operators and shift operators. Moreover, we derive positive semidefinite conditions of finite rank moment sequences and use these conditions to strengthen Lasserre’s hierarchy for real and complex polynomial optimization. Integration of the strengthening technique with sparsity is considered. Extensive numerical experiments show that our strengthening technique can significantly improve … Read more