We propose a fast algorithm for solving the l1-regularized least squares problem for recovering sparse solutions to an undetermined system of linear equations Ax = b. The algorithm is divided into two stages that are performed repeatedly. In the first stage a first-order iterative method called “shrinkage” yields an estimate of the subset of components … Read more
In this paper a new algorithm to locally minimize nonsmooth, nonconvex functions is developed. We introduce the notion of secants and quasisecants for nonsmooth functions. The quasisecants are applied to find descent directions of locally Lipschitz functions. We design a minimization algorithm which uses quasisecants to find descent directions. We prove that this algorithm converges … Read more
The paper presents a general classiffication scheme of necessary and sufficient criteria for the error bound property incorporating the existing conditions. Several derivative-like objects both from the primal as well as from the dual space are used to characterize the error bound property of extended-real-valued functions on a Banach space. CitationPublished in Set-Valued and Variational … Read more
We propose a Generating Search Set method for solving the oblique l_1 Procrustes problem. Implementative details, algorithmic choices and theoretical properties of the method are discussed. The results of some numerical experiments are reported. Citationin Applied and Industrial Mathematics in Italy III – Proceedings of the 9th Conference SIMAI, De Bernardis et. Al. (eds), Series … Read more
A simple unified framework is presented for the study of strong efficient solutions, weak efficient solutions, positive proper efficient solutions, Henig global proper efficient solutions, Henig proper efficient solutions, super efficient solutions, Benson proper efficient solutions, Hartley proper efficient solutions, Hurwicz proper efficient solutions and Borwein proper efficient solutions of set-valued optimization problem with/or without … Read more
Identification of active constraints in constrained optimization is of interest from both practical and theoretical viewpoints, as it holds the promise of reducing an inequality-constrained problem to an equality-constrained problem, in a neighborhood of a solution. We study this issue in the more general setting of composite nonsmooth minimization, in which the objective is a … Read more
In this paper we propose and analyze a variant of the level method [4], which is an algorithm for minimizing nonsmooth convex functions. The main work per iteration is spent on 1) minimizing a piecewise-linear model of the objective function and on 2) projecting onto the intersection of the feasible region and a polyhedron arising … Read more
In this paper we develop and analyze an efficient algorithm which solves seven related optimization problems simultaneously, in relative scale. Each iteration of our method is very cheap, with main work spent on matrix-vector multiplication. We prove that if a certain sequence generated by the algorithm remains bounded, then the method must terminate in $O(1/\delta)$ … Read more
In this paper we consider, for the first time, approximate Henig proper minimizers and approximate super minimizers of a set-valued map F with values in a partially ordered vector space and formulate two versions of the Ekeland variational principle for these points involving coderivatives in the senses of Ioffe, Clarke and Mordukhovich. As applications we … Read more
We investigate the BFGS algorithm with an inexact line search when applied to nonsmooth functions, not necessarily convex. We define a suitable line search and show that it generates a sequence of nested intervals containing points satisfying the Armijo and weak Wolfe conditions, assuming only absolute continuity. We also prove that the line search terminates … Read more