Abhinav Kumar

Scaling Up Exact Neural Network Compression by ReLU Stability

  • Abhinav Kumar
  • Srikumar Ramalingam
  • Thiago Serra
    • Categories (Mixed) Integer Linear Programming, Applications - Science and Engineering, Combinatorial Optimization

    We can compress a neural network while exactly preserving its underlying functionality with respect to a given input domain if some of its neurons are stable. However, current approaches to determine the stability of neurons in networks with Rectified Linear Unit (ReLU) activations require solving or finding a good approximation to multiple discrete optimization problems. … Read more

    Lossless Compression of Deep Neural Networks

  • Abhinav Kumar
  • Srikumar Ramalingam
  • Thiago Serra
    • Categories (Mixed) Integer Linear Programming, Applications - Science and Engineering

    Deep neural networks have been successful in many predictive modeling tasks, such as image and language recognition, where large neural networks are often used to obtain good accuracy. Consequently, it is challenging to deploy these networks under limited computational resources, such as in mobile devices. In this work, we introduce an algorithm that removes units … Read more