Optimization in Data Science

Optimal counterfactual explanations for k-Nearest Neighbors using Mathematical Optimization and Constraint Programming

  • Thibaut Vidal
  • Ricardo Fukasawa
  • Louis-Martin Rousseau
  • Claudio Contardo
    • Categories Applications - Science and Engineering, Data Science Algorithms Tags , , , ,

    \(\) Within the topic of explainable AI, counterfactual explanations to classifiers have received significant recent attention. We study counterfactual explanations that try to explain why a data point received an undesirable classification by providing the closest data point that would have received a desirable one. Within the context of one the simplest and most popular … Read more

    It’s All in the Mix: Wasserstein Machine Learning with Mixed Features

  • Mohammad Reza Belbasi
  • Aras Selvi
  • Wolfram Wiesemann
    • Categories Optimization in Data Science, Robust Optimization Tags , , ,

    Citation Belbasi R., Selvi A., Wiesemann W. (December 2023) It’s all in the mix: Wasserstein machine learning with mixed features. Preprint. Article Download View It's All in the Mix: Wasserstein Machine Learning with Mixed Features

    Accelerated Gradient Dynamics on Riemannian Manifolds: Faster Rate and Trajectory Convergence

  • Tejas Natu
  • Camille Castera
  • Jalal Fadili
  • Peter Ochs
    • Categories Convex Optimization, Optimization in Data Science Tags , , ,

    In order to minimize a differentiable geodesically convex function, we study a second-order dynamical system on Riemannian manifolds with an asymptotically vanishing damping term of the form \(\alpha/t\). For positive values of \(\alpha\), convergence rates for the objective values and convergence of trajectory is derived. We emphasize the crucial role of the curvature of the … Read more

    The limitation of neural nets for approximation and optimization

  • Tommaso Giovannelli
  • Oumaima Sohab
  • Luis Nunes Vicente
    • Categories Global Optimization, Nonlinear Optimization, Optimization in Data Science Tags , , ,

    We are interested in assessing the use of neural networks as surrogate models to approximate and minimize objective functions in optimization problems. While neural networks are widely used for machine learning tasks such as classification and regression, their application in solving optimization problems has been limited. Our study begins by determining the best activation function … Read more

    A Single-Loop Algorithm for Decentralized Bilevel Optimization

  • Youran Dong
  • Shiqian Ma
  • Junfeng Yang
  • Chao Yin
    • Categories Nonlinear Optimization, Optimization in Data Science Tags ,

    Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for solving decentralized bilevel optimization with a strongly convex lower-level problem. Our approach is a fully single-loop method that approximates the hypergradient using … Read more

    Mean–variance portfolio optimization with shrinkage estimation for recommender systems

  • Yuichi Takano
    • Categories Integer Programming, Optimization in Data Science Tags , , , ,

    This paper is concerned with a mean-variance portfolio optimization model with cardinality constraint for generating high-quality lists of recommendations. It is usually difficult to accurately estimate the rating covariance matrix required for mean-variance portfolio optimization because of a shortage of observed user ratings. To improve the accuracy of covariance matrix estimation, we apply shrinkage estimation … Read more

    Analysis of a Class of Minimization Problems Lacking Lower Semicontinuity

  • Shaoning Han
  • Ying Cui
  • Jong-Shi Pang
    • Categories Nonlinear Optimization, Nonsmooth Optimization, Optimization in Data Science Tags , , ,

    The minimization of non-lower semicontinuous functions is a difficult topic that has been minimally studied. Among such functions is a Heaviside composite function that is the composition of a Heaviside function with a possibly nonsmooth multivariate function. Unifying a statistical estimation problem with hierarchical selection of variables and a sample average approximation of composite chance … Read more

    An Integer Programming Approach To Subspace Clustering With Missing Data

  • Akhilesh Soni
  • Jeff Linderoth
  • James R. Luedtke
  • Daniel Pimentel-Alarcon
    • Categories Data Science Algorithms, Integer Programming Tags , ,

    In the Subspace Clustering with Missing Data (SCMD) problem, we are given a collection of n partially observed d-dimensional vectors. The data points are assumed to be concentrated near a union of low-dimensional subspaces. The goal of SCMD is to cluster the vectors according to their subspace membership and recover the underlying basis, which can … Read more

    Conjecturing-Based Discovery of Patterns in Data

  • J. Paul Brooks
  • David Edwards
  • C. E. Larson
  • Nico Van Cleemput
    • Categories Applications - OR and Management Sciences, Data Science Algorithms, Optimization in Data Science Tags , , , ,

    We propose the use of a conjecturing machine that suggests feature relationships in the form of bounds involving nonlinear terms for numerical features and boolean expressions for categorical features. The proposed Conjecturing framework recovers known nonlinear and boolean relationships among features from data. In both settings, true underlying relationships are revealed. We then compare the … Read more

    Learning the Follower’s Objective Function in Sequential Bilevel Games

  • Ioana Molan
  • Martin Schmidt
  • Johannes Thürauf
    • Categories Data Science Algorithms, Other Topics

    We consider bilevel optimization problems in which the leader has no or only partial knowledge about the objective function of the follower. The studied setting is a sequential one in which the bilevel game is played repeatedly. This allows the leader to learn the objective function of the follower over time. We focus on two … Read more