A Distributed Quasi-Newton Algorithm for Empirical Risk Minimization with Nonsmooth Regularization

  • Stephen Wright
  • Cong Han Lim
  • Ching-pei Lee
    • Categories Data-Mining, Nonlinear Optimization, Parallel Algorithms Tags , , , , , , ,

    We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this problem either do not work well in the distributed setting or work only for specific regularizers. Our algorithm uses successive quadratic approximations, and we describe how to … Read more

    Inexact Successive Quadratic Approximation for Regularized Optimization

  • Stephen Wright
  • Ching-pei Lee
    • Categories Nonlinear Optimization, Nonsmooth Optimization Tags , , , , , ,

    Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration complexity focus on the special case of proximal gradient method, or accelerated variants thereof. There have been only a few studies of … Read more

    On an Elliptical Trust-Region Procedure for Ill-Posed Nonlinear Least-Squares Problems

  • Stefania Bellavia
  • Elisa Riccietti
    • Categories Nonlinear Systems and Least-Squares Tags , , , ,

    In this paper we address the stable numerical solution of ill-posed nonlinear least-squares problems with small residual. We propose an elliptical trust-region reformulation of a Levenberg-Marquardt procedure. Thanks to an appropriate choice of the trust-region radius, the proposed procedure guarantees an automatic choice of the free regularization parameters that, together with a suitable stopping criterion, … Read more

    A Trust Region Algorithm for Heterogeneous Multiobjective Optimization

  • Gabriele Eichfelder
  • Jana Thomann
    • Categories Multi-Criteria Optimization Tags , , , ,

    This paper presents a new trust region method for multiobjective heterogeneous optimization problems. One of the objective functions is an expensive black-box function, for example given by a time-consuming simulation. For this function derivative information cannot be used and the computation of function values involves high computational effort. The other objective functions are given analytically … Read more

    Exact and heuristic algorithms for finding envy-free allocations in food rescue pickup and delivery logistics

  • Khaled Almi'ani
  • Divya J Nair
  • David Rey
    • Categories Branch and Cut Algorithms, Production and Logistics, Transportation Tags , , ,

    Food rescue organizations collect and re-distribute surplus perishable food for hunger relief. We propose novel approaches to address this humanitarian logistics challenge and find envy-free allocations of the rescued food together with least travel cost routes. We show that this food rescue and delivery problem is NP-hard and we present a cutting-plane algorithm based on … Read more

    Can cut generating functions be good and efficient?

  • Amitabh Basu
  • Sriram Sankaranarayanan
    • Categories Cutting Plane Approaches, Integer Programming, Polyhedra Tags , ,

    Making cut generating functions (CGFs) computationally viable is a central question in modern integer programming research. One would like to nd CGFs that are simultaneously good, i.e., there are good guarantees for the cutting planes they generate, and ecient, meaning that the values of the CGFs can be computed cheaply (with procedures that have some … Read more

    Bounds in multi-horizon stochastic programs

  • Elisabetta Allevi
  • Francesca Maggioni
  • Asgeir Tomasgard
    • Categories Applications - OR and Management Sciences, Stochastic Programming

    In this paper, we present bounds for multi-horizon stochastic optimization problems, a class of problems introduced in [16] relevant in many industry-life applications tipically involving strategic and operational decisions on two different time scales. After providing three general mathematical formulations of a multi-horizon stochastic program, we extend the definition of the traditional Expected Value problem … Read more

    A Branch-and-Bound based Algorithm for Nonconvex Multiobjective Optimization

  • Gabriele Eichfelder
  • Julia Niebling
    • Categories Global Optimization, Multi-Criteria Optimization, Nonlinear Optimization Tags , , , ,

    A new branch-and-bound based algorithm for smooth nonconvex multiobjective optimization problems with convex constraints is presented. The algorithm computes an $(\varepsilon,\delta)$-approximation of all globally optimal solutions. We introduce the algorithm which uses selection rules, discarding and termination tests. The discarding tests are the most important aspect, as they examine in different ways whether a box … Read more

    A Simple Nearly-Optimal Restart Scheme For Speeding-Up First-Order Methods

  • Benjamin Grimmer
  • James Renegar
    • Categories Convex Optimization, Nonsmooth Optimization Tags , ,

    We present a simple scheme for restarting first-order methods for convex optimization problems. Restarts are made based only on achieving specified decreases in objective values, the specified amounts being the same for all optimization problems. Unlike existing restart schemes, the scheme makes no attempt to learn parameter values characterizing the structure of an optimization problem, … Read more

    Radar Waveform Optimization for Joint Radar Communications Performance

  • Daniel W. Bliss
  • Hans D Mittelmann
  • Alex R. Chiriyath
  • Shankarachary Ragi
    • Categories Applications - Science and Engineering Tags , , , ,

    We develop and present a radar waveform design method that optimizes the spectral shape of the radar waveform so that joint performance of a cooperative radar-communications system is maximized. The continuous water-filling (WF) spectralmask shaping method presented in this paper is based the previously derived spectral-mask shaping technique. However, the method presented in this paper … Read more