In nonsmooth optimization, identifiable sets describe the local region eventually reached by sequences converging to a prescribed critical point. When such a set is a \(C^2\) manifold on which the objective restricts to a \(C^2\) function, it is called an identifiable manifold. Their appeal lies in what they enable: many first-order methods identify these manifolds … Read more
The cosine measure of a set of vectors in \(\mathbb{R}^n\) measures how well the set covers all directions in \(\mathbb{R}^n\). It identifies the direction furthest, in angle, from the set. It is used in the convergence theory of various optimization algorithms, but also highlights interesting geometric properties of sets. For example, the cosine measure of … Read more
This work introduces a proximal stochastic subgradient method for minimizing the sum of an expected cost, whose integrand is potentially nonsmooth and nonconvex, and a lower semicontinuous, prox-bounded function. We target a broad class of integrands obeying a nonsmooth, localized variant of the descent lemma in the decision variable, a structural assumption that simultaneously covers … Read more
We consider the design of optimal fixed-step first-order methods for $M$-Lipschitz convex optimization given $\|x_0-x_\star\|\leq D$. Prior works have identified several distinct fixed-step methods, parameterized by a matrix of stepsizes $W$, with the (information-theoretic) minimax optimal rate $MD/\sqrt{N+1}$ of objective gap convergence. We provide a complete characterization of every optimal fixed-step method. Moreover, we show … Read more
Parameter estimation in nonlinear dynamical systems from observational data is a fundamental inverse problem with applications in many disciplines such as epidemiology, systems biology, climate science, and related fields. In practice, this is further complicated by the fact that observational data are often noisy, sparse, and available only for a subset of the state variables. … Read more
In this paper, we propose and analyze a globally convergent regularized Newton method with positive definite regularization for solving nonsmooth optimization problems. Our approach leverages the coderivative-generated second-order subdifferential (generalized Hessian) and replaces the identity matrix in traditional algorithms with a general positive-definite symmetric matrix to regularize the generalized Hessian. By appropriately selecting the regularization … Read more
Assortment optimization selects a subset of items to maximize expected revenue under a discrete choice model and is widely used in revenue management and online platforms. Its combinatorial nature creates a practical tension among generality, scalability, and provable guarantees: model-specific algorithms can be strong when their structural assumptions hold, but are hard to adapt across … Read more
We consider a general class of “inexactly smooth” convex functions, providing a universal model capturing as special cases $L$-smooth, $M$-Lipschitz, and H\”older smooth functions, and any combination thereof. Such functions possess a calculus closely following that of smooth functions. Our main results provide inexactly smooth functions with interpolation theorems that are necessary and sufficient … Read more
Covering properties build the foundation of stability and sensitivity analysis of solutions to a generalized equation and more specific optimization-related stationarity and equilibrium problems. It has been well-understood that metric regularity of the mapping defining the generalized equation is a key to furnish Lipschitzian stability of the solution of interest. With this work, we want … Read more
We propose and analyze a stochastic direct-search method for unconstrained zeroth-order minimization of locally Lipschitz, possibly nonsmooth, objectives. The method combines random polling directions with a stochastic extrapolating line search based on a sufficient-decrease test of order \(p\). Under conditional accuracy assumptions on the stochastic estimates, which can be verified for mean-zero finite-higher-moment oracle noise … Read more