A Wide Interval for Efficient Self-Scaling Quasi-Newton Algorithms

This paper uses certain conditions for the global and superlinear convergence of the two-parameter self-scaling Broyden family of quasi-Newton algorithms for unconstraiend optimization to derive a wide interval for self-scaling updates. Numerical testing shows that such algorithms not only accelerate the convergence of the (unscaled) methods from the so-called convex class, but increase their chances … Read more

Optimization of A Fed-batch Fermentation Process Control Competition Problem Using NEOS

An optimal control solution to a fed-batch fermentation process, responding to a competition call, was developed using NEOS Server. Substantial improvement to the nominal performance achieved in the paper demonstrates the ability of the NEOS Server and the APPS algorithm. CitationProceedings of Inst. of Mechanical Engineers , Part-I (UK). To appear. (Accepted May 2003).ArticleDownload View … Read more

Gradient Projection Methods for Quadratic Programs and Applications in Training Support Vector Machines

Gradient projection methods based on the Barzilai-Borwein spectral steplength choices are considered for quadratic programming problems with simple constraints. Well known nonmonotone spectral projected gradient methods and variable projection methods are discussed. For both approaches the behavior of different combinations of the two spectral steplengths is investigated. A nw adaptive stplength alternating rule is proposed, … Read more

Sharpening the Karush-John optimality conditions

A refined version of the Karush-John first order optimality conditions is presented which reduces the number of constraints for which a constraint qualification is needed. This version is a generalization both of the Karush-John conditions and of the first order optimality conditions for concave constraints. ArticleDownload View PDF

Finding the projection of a point onto the intersection of convex sets via projections onto halfspaces

We present a modification of Dykstra’s algorithm which allows us to avoid projections onto general convex sets. Instead, we calculate projections onto either a halfspace or onto the intersection of two halfspaces. Convergence of the algorithm is established and special choices of the halfspaces are proposed. The option to project onto halfspaces instead of general … Read more

Genetic Algorithm for Solving Convex Quadratic Bilevel Programming Problem

This paper presents a genetic algorithm method for solving convex quadratic bilevel programming problem. Bilevel programming problems arise when one optimization problem, the upper problem, is constrained by another optimization, the lower problem. In this paper, the bilevel convex quadratic problem is transformed into a single level problem by applying Kuhn-Tucker conditions, and then an … Read more

An Interior Point Method for Mathematical Programs with Complementarity Constraints (MPCCs)

Interior point methods for nonlinear programs (NLPs) are adapted for solution of mathematical programs with complementarity constraints (MPCCs). The constraints of the MPCC are suitably relaxed so as to guarantee a strictly feasible interior for the inequality constraints. The standard primal-dual algorithm has been adapted with a modified step calculation. The algorithm is shown to … Read more

A Starting-Point Strategy for Nonlinear Interior Methods

This paper presents a strategy for choosing the initial point, slacks and multipliers in interior methods for nonlinear programming. It consists of first computing a Newton-like step to estimate the magnitude of these three variables and then shifting the slacks and multipliers so that they are sufficiently positive. The new strategy has the option of … Read more

Global optimization of rational functions: a semidefinite programming approach

We consider the problem of global minimization of rational functions on $\LR^n$ (unconstrained case), and on an open, connected, semi-algebraic subset of $\LR^n$, or the (partial) closure of such a set (constrained case). We show that in the univariate case ($n=1$), these problems have exact reformulations as semidefinite programming (SDP) problems, by using reformulations introduced … Read more

Characterizations of error bounds for lower semicontinuous functions on metric spaces

By using a variational method based on Ekeland’s principle, we give characterizations of the existence of so-called global and local error bounds, for lower semicontinuous functions defined on complete metric spaces. We thus provide a systematic and synthetic approach to the subject, emphasizing the special case of convex functions defined on arbitrary Banach spaces, and … Read more