Manifold Sampling for L1 Nonconvex Optimization

We present a new algorithm, called manifold sampling, for the unconstrained minimization of a nonsmooth composite function $h\circ F$ when $h$ has known structure. In particular, by classifying points in the domain of the nonsmooth function $h$ into manifolds, we adapt search directions within a trust-region framework based on knowledge of manifolds intersecting the current … Read more

On Cournot-Nash-Walras equilibria and their computation

This paper considers a model of Cournot-Nash-Walras (CNW) equilibrium where the Cournot-Nash concept is used to capture equilibrium of an oligopolistic market with non-cooperative players/ rms who share a certain amount of a so-called rare resource needed for their production, and the Walras equilibrium determines the price of that rare resource. We prove the existence of … Read more

Quantitative recovery conditions for tree-based compressed sensing

As shown in [9, 1], signals whose wavelet coefficients exhibit a rooted tree structure can be recovered — using specially-adapted compressed sensing algorithms — from just $n=\mathcal{O}(k)$ measurements, where $k$ is the sparsity of the signal. Motivated by these results, we introduce a simplified proportional-dimensional asymptotic framework which enables the quantitative evaluation of recovery guarantees … Read more

New Computational Guarantees for Solving Convex Optimization Problems with First Order Methods, via a Function Growth Condition Measure

Motivated by recent work of Renegar, we present new computational methods and associated computational guarantees for solving convex optimization problems using first-order methods. Our problem of interest is the general convex optimization problem f^* = \min_{x \in Q} f(x), where we presume knowledge of a strict lower bound f_slb < f^*. [Indeed, f_slb is naturally ... Read more

Variational Analysis and Applications to Group Dynamics

In this paper, we establish a new version of Ekeland’s variational principle in a new setting of cone pseudo-quasimetric spaces. In constrast to metric spaces, we do not require that each forward Cauchy sequence is forward convergent and that each forward convergent sequence has the unique forward limit. The motivation of this paper comes from … Read more

Local monotonicity and full stability for parametric variational systems

The paper introduces and characterizes new notions of Lipschitzian and H\”olderian full stability of solutions to general parametric variational systems described via partial subdifferential of prox-regular functions acting in finite-dimensional and Hilbert spaces. These notions, postulated certain quantitative properties of single-valued localizations of solution maps, are closely related to local strong maximal monotonicity of associated … Read more

On the Convergence of Multi-Block Alternating Direction Method of Multipliers and Block Coordinate Descent Method

The paper answers several open questions of the alternating direction method of multipliers (ADMM) and the block coordinate descent (BCD) method that are now wildly used to solve large scale convex optimization problems in many fields. For ADMM, it is still lack of theoretical understanding of the algorithm when the objective function is not separable … Read more

Semidefinite approximations of the polynomial abscissa

Given a univariate polynomial, its abscissa is the maximum real part of its roots. The abscissa arises naturally when controlling linear differential equations. As a function of the polynomial coefficients, the abscissa is H\”older continuous, and not locally Lipschitz in general, which is a source of numerical difficulties for designing and optimizing control laws. In … Read more

A DERIVATIVE-FREE APPROACH TO CONSTRAINED MULTIOBJECTIVE NONSMOOTH OPTIMIZATION

In this work, we consider multiobjective optimization problems with both bound constraints on the variables and general nonlinear constraints, where objective and constraint function values can only be obtained by querying a black box. We define a linesearch-based solution method, and we show that it converges to a set of Pareto stationary points. To this … Read more

Variational analysis of spectral functions simplified

Spectral functions of symmetric matrices — those depending on matrices only through their eigenvalues — appear often in optimization. A cornerstone variational analytic tool for studying such functions is a formula relating their subdifferentials to the subdifferentials of their diagonal restrictions. This paper presents a new, short, and revealing derivation of this result. We then … Read more