A Minimax Theorem with Applications to Machine Learning, Signal Processing, and Finance

This paper concerns a fractional function of the form $x^Ta/\sqrt{x^TBx}$, where $B$ is positive definite. We consider the game of choosing $x$ from a convex set, to maximize the function, and choosing $(a,B)$ from a convex set, to minimize it. We prove the existence of a saddle point and describe an efficient method, based on convex optimization, for computing it. We describe applications in machine learning (robust Fisher linear discriminant analysis), signal processing (robust beamforming, robust matched filtering), and finance (robust portfolio selection). In these applications, $x$ corresponds to some design variables to be chosen, and the pair $(a,B)$ corresponds to the statistical model, which is uncertain.

Citation

Technical report, Stanford University, 10/07

Article

Download

View PDF