nonconvex optimization

A Sound Local Regret Methodology for Online Nonconvex Composite Optimization

  • Nadav Hallak
    • Categories Applications - OR and Management Sciences, Constrained Nonlinear Optimization, Nonlinear Optimization Tags , , ,

    Online nonconvex optimization addresses dynamic and complex decision-making problems arising in real-world decision-making tasks where the optimizer’s objective evolves with the intricate and changing nature of the underlying system. This paper studies an online nonconvex composite optimization model with limited first-order access, encompassing a wide range of practical scenarios. We define local regret using a … Read more

    An Augmented Lagrangian Approach to Bi-Level Optimization via an Equilibrium Constrained Problem

  • Nadav Hallak
    • Categories Bilevel Optimization, Constrained Nonlinear Optimization, Nonlinear Optimization Tags , , ,

    Optimization problems involving equilibrium constraints capture diverse optimization settings such as bi-level optimization, min-max problems and games, and the minimization over non-linear constraints. This paper introduces an Augmented Lagrangian approach with Hessian-vector product approximation to address an equilibrium constrained nonconvex nonsmooth optimization problem. The underlying model in particular captures various settings of bi-level optimization problems, … Read more

    A proximal-perturbed Bregman ADMM for solving nonsmooth and nonconvex optimization problems

  • Jianchao Bai
    • Categories Nonsmooth Optimization Tags , , ,

    In this paper, we focus on a linearly constrained composite minimization problem whose objective function is possibly nonsmooth and nonconvex. Unlike the traditional construction of augmented Lagrangian function, we provide a proximal-perturbed augmented Lagrangian and then develop a new Bregman Alternating Direction Method of Multipliers (ADMM). Under mild assumptions, we show that the novel augmented … Read more

    An adaptive relaxation-refinement scheme for multi-objective mixed-integer nonconvex optimization

  • Gabriele Eichfelder
  • Moritz Link
  • Stefan Volkwein
  • Leo Warnow
    • Categories (Mixed) Integer Nonlinear Programming, Multi-Criteria Optimization Tags , , , ,

    In this work, we present an algorithm for computing an enclosure for multi-objective mixed-integer nonconvex optimization problems. In contrast to existing solvers for this type of problem, this algorithm is not based on a branch-and-bound scheme but rather relies on a relax-and-refine approach. While this is an established technique in single-objective optimization, several adaptions to … Read more

    Unifying nonlinearly constrained nonconvex optimization

  • Charlie Vanaret
  • Sven Leyffer
    • Categories Constrained Nonlinear Optimization, Optimization Software Benchmark Tags , , , , , , , , ,

    Derivative-based iterative methods for nonlinearly constrained non-convex optimization usually share common algorithmic components, such as strategies for computing a descent direction and mechanisms that promote global convergence. Based on this observation, we introduce an abstract framework based on four common ingredients that describes most derivative-based iterative methods and unifies their workflows. We then present Uno, … Read more

    Distributionally Robust Optimization with Decision-Dependent Polyhedral Ambiguity

  • Hamed Rahimian
  • Sanjay Mehrotra
    • Categories Stochastic Programming Tags , , ,

    We consider a two-stage stochastic program with continuous recourse, where the distribution of the random parameters depends on the decisions. Assuming a finite sample space, we study a distributionally robust approach to this problem, where the decision-dependent distributional ambiguity is modeled with a polyhedral ambiguity set. We consider cases where the recourse function and the … Read more

    A Stochastic Objective-Function-Free Adaptive Regularization Method with Optimal Complexity

  • Serge Gratton
  • Sadok Jerad
  • Philippe L. Toint
    • Categories Data Science Algorithms, Nonlinear Optimization Tags , , , ,

    A fully stochastic second-order adaptive-regularization method for unconstrained nonconvex optimization is presented which never computes the objective-function value, but yet achieves the optimal $\mathcal{O}(\epsilon^{-3/2})$ complexity bound for finding first-order critical points. The method is noise-tolerant and the inexactness conditions required for convergence depend on the history of past steps. Applications to cases where derivative evaluation … Read more

    A four-operator splitting algorithm for nonconvex and nonsmooth optimization

  • Jan Harold Alcantara
  • Ching-pei Lee
  • Akiko Takeda
    • Categories Nonlinear Optimization, Nonsmooth Optimization Tags , , ,

    In this work, we address a class of nonconvex nonsmooth optimization problems where the objective function is the sum of two smooth functions (one of which is proximable) and two nonsmooth functions (one proper, closed and proximable, and the other continuous and weakly concave). We introduce a new splitting algorithm that extends the Davis-Yin splitting … Read more

    Understanding the Douglas-Rachford splitting method through the lenses of Moreau-type envelopes

  • Felipe Atenas
    • Categories Convex and Nonsmooth Optimization, Generalized Convexity/Monoticity, Nonsmooth Optimization Tags , , , ,

    We analyze the Douglas-Rachford splitting method for weakly convex optimization problems, by the token of the Douglas-Rachford envelope, a merit function akin to the Moreau envelope. First, we use epi-convergence techniques to show that this artifact approximates the original objective function via epigraphs. Secondly, we present how global convergence and local linear convergence rates for … Read more

    A Proximal-Gradient Method for Constrained Optimization

  • Daniel P. Robinson
  • Yutong Dai
  • Xiaoyi Qu
    • Categories Nonlinear Optimization, Optimization in Data Science Tags , , , , ,

    We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be viewed as an extension of the well-known proximal-gradient method that is applicable when constraints are not present. To account for nonlinear … Read more