l_1 Trend Filtering

The problem of estimating underlying trends in time series data arises in a variety of disciplines. In this paper we propose a variation on Hodrick-Prescott (H-P) filtering, a widely used method for trend estimation. The proposed l_1 trend filtering method substitutes a sum of absolute values (i.e., l_1-norm) for the sum of squares used in … Read more

Stochastic Approximation approach to Stochastic Programming

In this paper we consider optimization problems where the objective function is given in a form of the expectation. A basic difficulty of solving such stochastic optimization problems is that the involved multidimensional integrals (expectations) cannot be computed with high accuracy. The aim of this paper is to compare two computational approaches based on Monte … Read more

SDLS: a Matlab package for solving conic least-squares problems

This document is an introduction to the Matlab package SDLS (Semi-Definite Least-Squares) for solving least-squares problems over convex symmetric cones. The package is shortly presented through the addressed problem, a sketch of the implemented algorithm, the syntax and calling sequences, a simple numerical example and some more advanced features. The implemented method consists in solving … Read more

Gradient methods for minimizing composite objective function

In this paper we analyze several new methods for solving optimization problems with the objective function formed as a sum of two convex terms: one is smooth and given by a black-box oracle, and another is general but simple and its structure is known. Despite to the bad properties of the sum, such problems, both … Read more

Gradient methods for minimizing composite objective function

In this paper we analyze several new methods for solving optimization problems with the objective function formed as a sum of two convex terms: one is smooth and given by a black-box oracle, and another is general but simple and its structure is known. Despite to the bad properties of the sum, such problems, both … Read more

A New Class of Self-Concordant Barriers from Separable Spectral Functions

Given a separable strongly self-concordant function f:Rn -> R, we show the associated spectral function F(X)= (foL)(X) is also strongly self-concordant function. In addition, there is a universal constant O such that, if f(x) is separable self-concordant barrier then O^2F(X) is a self-concordant barrier. We estimate that for the universal constant we have O

The extremal volume ellipsoids of convex bodies, their symmetry properties, and their determination in some special cases

A convex body K has associated with it a unique circumscribed ellipsoid CE(K) with minimum volume, and a unique inscribed ellipsoid IE(K) with maximum volume. We first give a unified, modern exposition of the basic theory of these extremal ellipsoids using the semi-infinite programming approach pioneered by Fritz John in his seminal 1948 paper. We … Read more

Local convergence for alternating and averaged nonconvex projections

The idea of a finite collection of closed sets having “strongly regular intersection” at a given point is crucial in variational analysis. We show that this central theoretical tool also has striking algorithmic consequences. Specifically, we consider the case of two sets, one of which we assume to be suitably “regular” (special cases being convex … Read more

Semidefinite Programming for Gradient and Hessian Computation in Maximum Entropy Estimation

We consider the classical problem of estimating a density on $[0,1]$ via some maximum entropy criterion. For solving this convex optimization problem with algorithms using first-order or second-order methods, at each iteration one has to compute (or at least approximate) moments of some measure with a density on $[0,1]$, to obtain gradient and Hessian data. … Read more

Nonparametric Estimation via Convex Programming

In the paper, we focus primarily on the problem of recovering a linear form g’*x of unknown “signal” x known to belong to a given convex compact set X in R^n from N independent realizations of a random variable taking values in a finite set, the distribution p of the variable being affinely parameterized by … Read more