A Proximal Method for Identifying Active Manifolds

The minimization of an objective function over a constraint set can often be simplified if the “active manifold” of the constraints set can be correctly identified. In this work we present a simple subproblem, which can be used inside of any (convergent) optimization algorithm, that will identify the active manifold of a “prox-regular partly smooth” … Read more

Benchmark of Some Nonsmooth Optimization Solvers for Computing Nonconvex Proximal Points

The major focus of this work is to compare several methods for computing the proximal point of a nonconvex function via numerical testing. To do this, we introduce two techniques for randomly generating challenging nonconvex test functions, as well as two very specific test functions which should be of future interest to Nonconvex Optimization Benchmarking. … Read more

Numerical Experiments with universal barrier functions for cones of Chebyshev systems

Based on previous explicit computations of universal barrier functions, we describe numerical experiments for solving certain classes of convex optimization problems. The comparison is given of the performance of the classical affine-scaling algorithm with similar algorithm based upon the universal barrier function Citation To appear in “Computational Optimization and Applications” Article Download View Numerical Experiments … Read more

Smooth minimization of two-stage stochastic linear programs

This note presents an application of the smooth optimization technique of Nesterov for solving two-stage stochastic linear programs. It is shown that the original O(1/e) bound of Nesterov on the number of main iterations required to obtain an e-optimal solution is retained. Citation Technical Report, School of Industrial & Systems Engineering, Georgia Institute of Technology, … Read more

Generating and Measuring Instances of Hard Semidefinite Programs, SDP

Linear Programming, LP, problems with finite optimal value have a zero duality gap and a primal-dual strictly complementary optimal solution pair. On the other hand, there exists Semidefinite Programming, SDP, problems which have a nonzero duality gap (different primal and dual optimal values; not both infinite). The duality gap is assured to be zero if … Read more

Exact regularization of linear programs

We show that linear programs (LPs) admit regularizations that either contract the original (primal) solution set or leave it unchanged. Any regularization function that is convex and has compact level sets is allowed–differentiability is not required. This is an extension of the result first described by Mangasarian and Meyer (SIAM J. Control Optim., 17(6), pp. … Read more

Steplength Selection in Interior-Point Methods for Quadratic Programming

We present a new strategy for choosing primal and dual steplengths in a primal-dual interior-point algorithm for convex quadratic programming. Current implementations often scale steps equally to avoid increases in dual infeasibility between iterations. We propose that this method can be too conservative, while safeguarding an unequally-scaled steplength approach will often require fewer steps toward … Read more

Prox-Regularity and Stability of the Proximal Mapping

Fundamental insights into the properties of a function come from the study of its Moreau envelopes and Proximal point mappings. In this paper we examine the stability of these two objects under several types of perturbations. In the simplest case, we consider tilt-perturbations, i.e. perturbations which correspond to adding a linear term to the objective … Read more

Stationarity and Regularity of Real-Valued Functions

Different stationarity and regularity concepts for extended real-valued functions on metric spaces are considered in the paper. The properties are characterized in terms of certain local constants. A classification scheme for stationarity/regularity constants and corresponding concepts is proposed. The relations between different constants are established. Citation University of Ballarat, School of Information Technology and Mathematical … Read more

A conic interior point decomposition approach for large scale semidefinite programming

We describe a conic interior point decomposition approach for solving a large scale semidefinite programs (SDP) whose primal feasible set is bounded. The idea is to solve such an SDP using existing primal-dual interior point methods, in an iterative fashion between a {\em master problem} and a {\em subproblem}. In our case, the master problem … Read more