Inexact Newton methods with matrix approximation by sampling for nonlinear least-squares and systems

We develop and analyze stochastic inexact Gauss-Newton methods for nonlinear least-squares problems and inexact Newton methods for nonlinear systems of equations. Random models are formed using suitable sampling strategies for the matrices involved in the deterministic models. The analysis of the expected number of iterations needed in the worst case to achieve a desired level … Read more

Sufficient Conditions for Lipschitzian Error Bounds for Complementarity Systems

We are concerned with Lipschitzian error bounds and Lipschitzian stability properties for solutions of a complementarity system. For this purpose, we deal with a nonsmooth slack-variable reformulation of the complementarity system, and study conditions under which the reformulation serves as a local error bound for the solution set of the complementarity system. We also discuss … Read more

Bilevel Hyperparameter Optimization for Nonlinear Support Vector Machines

While the problem of tuning the hyperparameters of a support vector machine (SVM) via cross-validation is easily understood as a bilevel optimization problem, so far, the corresponding literature has mainly focused on the linear-kernel case. In this paper, we establish a theoretical framework for the development of bilevel optimization-based methods for tuning the hyperparameters of … Read more

A real moment-HSOS hierarchy for complex polynomial optimization with real coefficients

This paper proposes a real moment-HSOS hierarchy for complex polynomial optimization problems with real coefficients. We show that this hierarchy provides the same sequence of lower bounds as the complex analogue, yet is much cheaper to solve. In addition, we prove that global optimality is achieved when the ranks of the moment matrix and certain … Read more

Superlinear convergence of an interior point algorithm on linear semi-definite feasibility problems with application to linear matrix inequalities

In the literature, superlinear convergence of implementable polynomial-time interior point algorithms using known search directions, namely, the HKM direction, its dual and the NT direction, to solve semi-definite programs (SDPs) can be shown by (i) assuming that the given SDP is nondegenerate and modifying these algorithms [10], or (ii) considering special classes of SDPs, such … Read more

Convex envelopes of bounded monomials on two-variable cones

\(\) We consider an \(n\)-variate monomial function that is restricted both in value by lower and upper bounds and in domain by two homogeneous linear inequalities. Such functions are building blocks of several problems found in practical applications, and that fall under the class of Mixed Integer Nonlinear Optimization. We show that the upper envelope … Read more

Information Complexity of Mixed-integer Convex Optimization

We investigate the information complexity of mixed-integer convex optimization under different types of oracles. We establish new lower bounds for the standard first-order oracle, improving upon the previous best known lower bound. This leaves only a lower order linear term (in the dimension) as the gap between the lower and upper bounds. This is derived … Read more

The Terminator: An Integration of Inner and Outer Approximations for Solving Regular and Distributionally Robust Chance Constrained Programs via Variable Fixing

We present a novel approach aimed at enhancing the efficacy of solving both regular and distributionally robust chance constrained programs using an empirical reference distribution. In general, these programs can be reformulated as mixed-integer programs (MIPs) by introducing binary variables for each scenario, indicating whether a scenario should be satisfied. While existing methods have predominantly … Read more

AI Hilbert: A New Paradigm for Scientific Discovery by Unifying Data and Background Knowledge

The discovery of scientific formulae that parsimoniously explain natural phenomena and align with existing background theory is a key goal in science. Historically, scientists have derived natural laws by manipulating equations based on existing knowledge, forming new equations, and verifying them experimentally. In recent years, data-driven scientific discovery has emerged as a viable competitor in settings with … Read more

Learning the Follower’s Objective Function in Sequential Bilevel Games

We consider bilevel optimization problems in which the leader has no or only partial knowledge about the objective function of the follower. The studied setting is a sequential one in which the bilevel game is played repeatedly. This allows the leader to learn the objective function of the follower over time. We focus on two … Read more