We propose a proximal-type algorithm for nonsmooth and nonconvex optimization problems with composite constraints. The constraint is defined by the composition of a locally upper-\(C^2\) outer function with a locally Lipschitz continuous inner mapping. The method is based on an improvement function that balances objective decrease and constraint satisfaction, and on a surrogate model obtained … Read more
We study decentralized minimization of an average of strongly convex, smooth local objectives over an intersection of agent-private closed convex sets, where each agent knows only its own objective and its own set and agents communicate over a gossip network. We show that the complexity is controlled by a single geometric scalar, which we call … Read more
This work considers the design of first-order convex optimization algorithms and convergence proofs. In particular, we consider nonsmooth Lipschitz and smooth problems accessed through a subgradient or gradient oracle, respectively. For the general class of fixed-step first-order methods, prior work on Performance Estimation Problems (PEPs) has shown that structured, tight convergence proofs typically exist. Under … Read more
In nonsmooth optimization, identifiable sets describe the local region eventually reached by sequences converging to a prescribed critical point. When such a set is a \(C^2\) manifold on which the objective restricts to a \(C^2\) function, it is called an identifiable manifold. Their appeal lies in what they enable: many first-order methods identify these manifolds … Read more
The cosine measure of a set of vectors in \(\mathbb{R}^n\) measures how well the set covers all directions in \(\mathbb{R}^n\). It identifies the direction furthest, in angle, from the set. It is used in the convergence theory of various optimization algorithms, but also highlights interesting geometric properties of sets. For example, the cosine measure of … Read more
This work introduces a proximal stochastic subgradient method for minimizing the sum of an expected cost, whose integrand is potentially nonsmooth and nonconvex, and a lower semicontinuous, prox-bounded function. We target a broad class of integrands obeying a nonsmooth, localized variant of the descent lemma in the decision variable, a structural assumption that simultaneously covers … Read more
We consider the design of optimal fixed-step first-order methods for $M$-Lipschitz convex optimization given $\|x_0-x_\star\|\leq D$. Prior works have identified several distinct fixed-step methods, parameterized by a matrix of stepsizes $W$, with the (information-theoretic) minimax optimal rate $MD/\sqrt{N+1}$ of objective gap convergence. We provide a complete characterization of every optimal fixed-step method. Moreover, we show … Read more
Parameter estimation in nonlinear dynamical systems from observational data is a fundamental inverse problem with applications in many disciplines such as epidemiology, systems biology, climate science, and related fields. In practice, this is further complicated by the fact that observational data are often noisy, sparse, and available only for a subset of the state variables. … Read more
In this paper, we propose and analyze a globally convergent regularized Newton method with positive definite regularization for solving nonsmooth optimization problems. Our approach leverages the coderivative-generated second-order subdifferential (generalized Hessian) and replaces the identity matrix in traditional algorithms with a general positive-definite symmetric matrix to regularize the generalized Hessian. By appropriately selecting the regularization … Read more
Assortment optimization selects a subset of items to maximize expected revenue under a discrete choice model and is widely used in revenue management and online platforms. Its combinatorial nature creates a practical tension among generality, scalability, and provable guarantees: model-specific algorithms can be strong when their structural assumptions hold, but are hard to adapt across … Read more