Gradient Tracking Methods

Adaptive Consensus: A network pruning approach for decentralized optimization

  • Suhail Mohmad Shah
  • Albert S. Berahas
  • Raghu Bollapragada
    • Categories Convex Optimization, Network Optimization, Nonlinear Optimization Tags , ,

    We consider network-based decentralized optimization problems, where each node in the network possesses a local function and the objective is to collectively attain a consensus solution that minimizes the sum of all the local functions. A major challenge in decentralized optimization is the reliance on communication which remains a considerable bottleneck in many applications. To … Read more

    Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization

  • Albert S. Berahas
  • Raghu Bollapragada
  • Shagun Gupta
    • Categories Convex Optimization, Nonlinear Optimization, Optimization in Data Science Tags , , , ,

    Gradient tracking methods have emerged as one of the most popular approaches for solving decentralized optimization problems over networks. In this setting, each node in the network has a portion of the global objective function, and the goal is to collectively optimize this function. At every iteration, gradient tracking methods perform two operations (steps): (1) … Read more