A Particle Swarm Pattern Search Method for Bound Constrained Nonlinear Optimization

In this paper we develop, analyze, and test a new algorithm for the global minimization of a function subject to simple bounds without the use of derivatives. The underlying algorithm is a pattern search method, more specifically a coordinate search method, which guarantees convergence to stationary points from arbitrary starting points. In the optional search … Read more

Geometry of Sample Sets in Derivative Free Optimization. Part II: Polynomial Regression and Underdetermined Interpolation

In the recent years, there has been a considerable amount of work in the development of numerical methods for derivative free optimization problems. Some of this work relies on the management of the geometry of sets of sampling points for function evaluation and model building. In this paper, we continue the work developed in [Conn, … Read more

A generating set search method exploiting curvature and sparsity

Generating Set Search method are one of the few alternatives for optimising high fidelity functions with numerical noise. These methods are usually only efficient when the number of variables is relatively small. This paper presents a modification to an existing Generating Set Search method, which makes it aware of the sparsity structure of the Hessian. … Read more

Using Sampling and Simplex Derivatives in Pattern Search Methods

Pattern search methods can be made more efficient if past function evaluations are appropriately reused. In this paper we will introduce a number of ways of reusing previous evaluations of the objective function based on the computation of simplex derivatives (e.g., simplex gradients) to improve the efficiency of a pattern search iteration. At each iteration … Read more

Local Optimization Method with Global Multidimensional

This paper presents a new method for solving global optimization problems. We use a local technique based on the notion of discrete gradients for finding a cone of descent directions and then we use a global cutting angle algorithm for finding global minimum within the intersection of the cone and the feasible region. We present … Read more

Error Estimates and Poisedness in Multivariate Polynomial Interpolation

We show how to derive error estimates between a function and its interpolating polynomial and between their corresponding derivatives. The derivation is based on a new definition of well-poisedness for the interpolation set, directly connecting the accuracy of the error estimates with the geometry of the points in the set. This definition is equivalent to … Read more

Pattern search algorithms for mixed variable programming

Many engineering optimization problems involve a special kind of discrete variable that {\em can} be represented by a number, but this representation has no significance. Such variables arise when a decision involves some situation like a choice from an unordered list of categories. This has two implications: The standard approach of solving problems with continuous … Read more