As part of Performance World, we describe an automation server (PAVER: http://www.gamsworld.org/performance/paver) to help facilitate reproducible performance analysis of benchmarking data for optimization software. Although PAVER does not solve optimization problems, it automates the task of performance data analysis and visualization, taking into account various performance metrics. These include not only robustness and efficiency, but also quality of solution. This paper discusses the tools and the performance metrics used, as well as the design of the server. We give illustrative examples of performance data analysis using an instance of the COPS test case for nonlinear programming.