A Progressive Batching L-BFGS Method for Machine Learning

The standard L-BFGS method relies on gradient approximations that are not dominated by noise, so that search directions are descent directions, the line search is reliable, and quasi-Newton updating yields useful quadratic models of the objective function. All of this appears to call for a full batch approach, but since small batch sizes give rise … Read more

Extensions of Yuan’s Lemma to fourth-order tensor system with applications

Yuan’s lemma is a basic proposition on homogeneous quadratic function system. In this paper, we extend Yuan’s lemma to 4th-order tensor system. We first give two gen- eralized definitions of positive semidefinite of 4th-order tensor, and based on them, two extensions of Yuan’s lemma are proposed. We illustrate the difference between our ex- tensions and … Read more

On classes of set optimization problems which are reducible to vector optimization problems and its impact on numerical test instances

Set optimization with the set approach has recently gained increasing interest due to its practical relevance. In this problem class one studies optimization problems with a set-valued objective map and defines optimality based on a direct comparison of the images of the objective function, which are sets here. Meanwhile, in the literature a wide range … Read more

Exact Semidefinite Formulations for a Class of (Random and Non-Random) Nonconvex Quadratic Programs

We study a class of quadratically constrained quadratic programs (QCQPs), called {\em diagonal QCQPs\/}, which contain no off-diagonal terms $x_j x_k$ for $j \ne k$, and we provide a sufficient condition on the problem data guaranteeing that the basic Shor semidefinite relaxation is exact. Our condition complements and refines those already present in the literature … Read more

Optimal linearized symmetric ADMM for separable convex programming

Due to its wide applications and simple implementations, the Alternating Direction Method of Multipliers (ADMM) has been extensively investigated by researchers from different areas. In this paper, we focus on a linearized symmetric ADMM (LSADMM) for solving the multi- block separable convex minimization model. This LSADMM partitions the data into two group variables and updates … Read more

FINITE ELEMENT MODEL UPDATING FOR STRUCTURAL APPLICATIONS

A novel method for performing model updating on finite element models is presented. The approach is particularly tailored to modal analyses of buildings, by which the lowest frequencies, obtained by using sensors and system identification approaches, need to be matched to the numerical ones predicted by the model. This is done by optimizing some unknown … Read more

Combinatorial Integral Approximation for Mixed-Integer PDE-Constrained Optimization Problems

We apply the basic principles underlying combinatorial integral approximation methods for mixed-integer optimal control with ordinary differential equations in general, and the sum-up rounding algorithm specifically, to optimization problems with partial differential equation (PDE) constraints. By doing so, we identify two possible generalizations that are applicable to problems involving PDE constraints with mesh-dependent integer variables, … Read more

Regional Complexity Analysis of Algorithms for Nonconvex Smooth Optimization

A strategy is proposed for characterizing the worst-case performance of algorithms for solving nonconvex smooth optimization problems. Contemporary analyses characterize worst-case performance by providing, under certain assumptions on an objective function, an upper bound on the number of iterations (or function or derivative evaluations) required until a pth-order stationarity condition is approximately satisfied. This arguably … Read more

A structured quasi-Newton algorithm for optimizing with incomplete Hessian information

We present a structured quasi-Newton algorithm for unconstrained optimization problems that have unavailable second-order derivatives or Hessian terms. We provide a formal derivation of the well-known BFGS secant update formula that approximates only the missing Hessian terms, and we propose a line-search quasi-Newton algorithm based on a modification of Wolfe conditions that converges to first-order … Read more

A Decision Tool based on a Multi-Objective Methodology for designing High-Pressure Thermal Treatments in Food Industry

In this work, we propose a methodology for designing High-Pressure Thermal processes for food treatment. This approach is based on a multi-objective preference-based evolutionary optimization algorithm, called WASF-GA, combined with a decision strategy which provides the food engineer with the best treatment in accordance with some quality requirements. The resulting method is compared to a … Read more