Complexity results and active-set identification of a derivative-free method for bound-constrained problems

In this paper, we analyze a derivative-free line search method designed for bound-constrained problems. Our analysis demonstrates that this method exhibits a worst-case complexity comparable to other derivative-free methods for unconstrained and linearly constrained problems. In particular, when minimizing a function with $n$ variables, we prove that at most ${\cal O}(n\epsilon^{-2})$ iterations are needed to drive a criticality measure below a predefined threshold $\epsilon$, requiring at most ${\cal O}(n^2\epsilon^{-2})$ function evaluations.
We also show that the total number of iterations where the criticality measure is not below $\epsilon$ is upper bounded by ${\cal O}(n^2\epsilon^{-2})$.
Moreover, we investigate the method capability to identify active constraints at the final solutions. We show that, after a finite number of iterations, all the active constraints satisfying the strict complementarity condition are correctly identified.

Article

Download

View PDF