Nonsmooth Optimization

Subdifferentials and SNC property of scalarization functionals with uniform level sets and applications

  • Christiane Tammer
  • Bao Q. Truong
    • Categories Constrained Nonlinear Optimization, Multi-Criteria Optimization, Nonsmooth Optimization

    This paper deals with necessary conditions for minimal solutions of constrained and unconstrained optimization problems with respect to general domination sets by using a well-known nonlinear scalarization functional with uniform level sets (called Gerstewitz’ functional in the literature). The primary objective of this work is to establish revised formulas for basic and singular subdifferentials of … Read more

    Active-set Newton methods and partial smoothness

  • Adrian Lewis
  • Calvin Wylie
    • Categories Complementarity and Variational Inequalities, Constrained Nonlinear Optimization, Nonsmooth Optimization Tags , ,

    Diverse optimization algorithms correctly identify, in finite time, intrinsic constraints that must be active at optimality. Analogous behavior extends beyond optimization to systems involving partly smooth operators, and in particular to variational inequalities over partly smooth sets. As in classical nonlinear programming, such active-set structure underlies the design of accelerated local algorithms of Newton type. … Read more

    Generalized subdifferentials of spectral functions over Euclidean Jordan algebras

  • Bruno F. Lourenço
  • Akiko Takeda
    • Categories Nonlinear Optimization, Nonsmooth Optimization Tags , , , ,

    This paper is devoted to the study of generalized subdifferentials of spectral functions over Euclidean Jordan algebras. Spectral functions appear often in optimization problems playing the role of “regularizer”, “barrier”, “penalty function” and many others. We provide formulae for the regular, approximate and horizon subdifferentials of spectral functions. In addition, under local lower semicontinuity, we … Read more

    Fast Robust Methods for Singular State-Space Models

  • Aleksandr Y. Aravkin
  • James V. Burke
  • Sarah Webster
  • Jonathan Jonker
  • Gianluigi Pillonetto
    • Categories Control Applications, Nonsmooth Optimization, Statistics Tags , ,

    State-space models are used in a wide range of time series analysis applications. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent advances use a broad range of optimization formulations to allow outlier-robust estimation, as well as constraints to capture prior information. Here we … Read more

    Local minimizers of semi-algebraic functions

  • Tiên-So'n Pham
    • Categories Nonsmooth Optimization, Unconstrained Optimization Tags , , , , , ,

    Consider a semi-algebraic function $f\colon\mathbb{R}^n \to {\mathbb{R}},$ which is continuous around a point $\bar{x} \in \mathbb{R}^n.$ Using the so–called {\em tangency variety} of $f$ at $\bar{x},$ we first provide necessary and sufficient conditions for $\bar{x}$ to be a local minimizer of $f,$ and then in the case where $\bar{x}$ is an isolated local minimizer of … Read more

    Weak convergence of an extended splitting method for monotone inclusions

  • Yunda Dong
    • Categories Nonsmooth Optimization

    In this article, we consider the problem of finding zeros of two-operator monotone inclusions in real Hilbert spaces, and the second operator has been linearly composed. We suggest an extended splitting method: At each iteration, it mainly solves one resolvent for each operator, respectively. For these two resolvents, the involved two scaling factors can be … Read more

    Partial smoothness of the numerical radius at matrices whose fields of values are disks

  • Adrian Lewis
  • Michael L. Overton
    • Categories Nonsmooth Optimization Tags

    Solutions to optimization problems involving the numerical radius often belong to a special class: the set of matrices having field of values a disk centered at the origin. After illustrating this phenomenon with some examples, we illuminate it by studying matrices around which this set of “disk matrices” is a manifold with respect to which … Read more

    A Comparison of Nonsmooth, Nonconvex, Constrained Optimization Solvers for the Design of Time-Delay Compensators

  • Vyacheslav Kungurtsev
  • Tim Mitchell
  • Tomas Vyhlidal
    • Categories Control Applications, Nonsmooth Optimization, Optimization Software Benchmark

    We present a detailed set of performance comparisons of two state-of-the-art solvers for the application of designing time-delay compensators, an important problem in the field of robust control. Formulating such robust control mechanics as constrained optimization problems often involves objective and constraint functions that are both nonconvex and nonsmooth, both of which present significant challenges … Read more

    Basis Pursuit Denoise with Nonsmooth Constraints

  • Aleksandr Y. Aravkin
  • Robert Baraldi
  • Rajiv Kumar
    • Categories Basic Sciences Applications, Constrained Nonlinear Optimization, Nonsmooth Optimization Tags , , , ,

    Level-set optimization formulations with data-driven constraints minimize a regularization functional subject to matching observations to a given error level. These formulations are widely used, particularly for matrix completion and sparsity promotion in data interpolation and denoising. The misfit level is typically measured in the l2 norm, or other smooth metrics. In this paper, we present … Read more

    Parallelizing Subgradient Methods for the Lagrangian Dual in Stochastic Mixed-Integer Programming

  • Cong Han Lim
  • Jeff Linderoth
  • James R. Luedtke
  • Stephen Wright
    • Categories Nonsmooth Optimization, Stochastic Programming Tags , ,

    The dual decomposition of stochastic mixed-integer programs can be solved by the projected subgradient algorithm. We show how to make this algorithm more amenable to parallelization in a master-worker model by describing two approaches, which can be combined in a natural way. The first approach partitions the scenarios into batches, and makes separate use of … Read more