Complexity of normalized stochastic first-order methods with momentum under heavy-tailed noise

  • Chuan He
  • Zhaosong Lu
  • Defeng Sun
  • Zhanwang Deng
    • Categories Nonlinear Optimization, Optimization in Data Science, Unconstrained Optimization Tags , , ,

    In this paper, we propose practical normalized stochastic first-order methods with Polyak momentum, multi-extrapolated momentum, and recursive momentum for solving unconstrained optimization problems. These methods employ dynamically updated algorithmic parameters and do not require explicit knowledge of problem-dependent quantities such as the Lipschitz constant or noise bound. We establish first-order oracle complexity results for finding … Read more

    First-order methods for stochastic and finite-sum convex optimization with deterministic constraints

  • Zhaosong Lu
  • Yifeng Xiao
    • Categories Constrained Nonlinear Optimization, Convex Optimization, Stochastic Programming Tags , , , , , ,

    In this paper, we study a class of stochastic and finite-sum convex optimization problems with deterministic constraints. Existing methods typically aim to find an \(\epsilon\)-expectedly feasible stochastic optimal solution, in which the expected constraint violation and expected optimality gap are both within a prescribed tolerance ϵ. However, in many practical applications, constraints must be nearly … Read more

    Random-Restart Best-Response Dynamics for Large-Scale Integer Programming Games and Their Applications

  • Hyunwoo Lee
  • Robert Hildebrand
  • Wenbo Cai
  • I. Esra Buyuktahtakin Toy
    • Categories (Mixed) Integer Linear Programming, Applications - OR and Management Sciences, Game Theory Tags , , ,

    This paper presents scalable algorithms for computing pure Nash equilibria (PNEs) in large-scale integer programming games (IPGs), where existing exact methods typically handle only small numbers of players. Motivated by a county-level aquatic invasive species (AIS) prevention problem with 84 decision makers, we develop and analyze random-restart best-response dynamics (RR-BRD), a randomized search framework for … Read more

    A Variational Analysis Approach for Bilevel Hyperparameter Optimization with Sparse Regularization

  • David Villacís
  • Pedro Pérez-Aros
  • Emilio Vilches
    • Categories Bilevel Optimization, Nonsmooth Optimization, Optimization in Data Science Tags , , ,

    We study a bilevel optimization framework for hyperparameter learning in variational models, with a focus on sparse regression and classification tasks. In particular, we consider a weighted elastic-net regularizer, where feature-wise regularization parameters are learned through a bilevel formulation. A key novelty of our approach is the use of a Forward-Backward (FB) reformulation of the … Read more

    Lipschitz Stability for a Class of Parametric Optimization Problems with Polyhedral Feasible Set Mapping

  • Diethard Klatte
    • Categories Complementarity and Variational Inequalities, Nonlinear Optimization, Nonsmooth Optimization Tags , , , , ,

    This paper is devoted to the Lipschitz analysis of the solution sets and optimal values for a class of parametric optimization problems involving a polyhedral feasible set mapping and a quadratic objective function with arametric linear part. Recall that a multifunction is said to be polyhedral if its graph is the union of finitely many polyhedral … Read more

    Novel closed-loop controllers for fractional linear quadratic tracking systems

  • Malmir Iman
    • Categories Applications - Science and Engineering, Approximation Algorithms, Systems governed by Differential Equations Optimization Tags , , , , ,

    A new method for finding closed-loop optimal controllers of fractional tracking quadratic optimal control problems is introduced. The optimality conditions for the fractional optimal control problem are obtained. Illustrative examples are presented to show the applicability and capabilities of the method. ArticleDownload View PDF

    Identifying Regions Vulnerable to Obstetric Unit Closures using Facility Location Modeling with Patient Behavior

  • Meghan Meredith
  • Lauren Steimle
    • Categories Applications - OR and Management Sciences Tags , , , ,

    Limited geographic access to obstetric care prevents some pregnant people from receiving timely and risk-appropriate services. This challenge is especially acute in rural areas, where rural residents often travel far distances to obstetric care. Furthermore, obstetric access is worsening due to the growing number of closures of rural hospitals’ obstetric units, often due to financial … Read more

    Efficient QUIC-Based Damped Inexact Iterative Reweighting for Sparse Inverse Covariance Estimation with Nonconvex Partly Smooth Regularization

  • Xiangyu Yang
    • Categories Constrained Nonlinear Optimization, Nonsmooth Optimization, Semi-definite Programming Tags , , ,

    In this paper, we study sparse inverse covariance matrix estimation incorporating partly smooth nonconvex regularizers. To solve the resulting regularized log-determinant problem, we develop DIIR-QUIC—a novel Damped Inexact Iteratively Reweighted algorithm based on QUadratic approximate Inverse Covariance (QUIC) method. Our approach generalizes the classic iteratively reweighted \(\ell_1\) scheme through damped fixed-point updates. A key novelty … Read more

    Clean Electricity Transition under Technology Cost and Efficiency Uncertainty for Distributed Energy Systems: A Multi-Stage Stochastic Programming Framework

  • Ahmet Emir Şener
  • Burak Kocuk
  • Tuğçe Yüksel
    • Categories Energy, Stochastic Programming Tags , , ,

    The decarbonization of energy systems is an essential component of global climate mitigation, yet such transitions involve substantial capital requirements, ongoing technological progress, and the operational complexities of renewable integration. This study presents a dynamic strategic planning framework that applies multi-stage stochastic programming to guide clean electricity transitions for distributed energy systems. The model jointly … Read more

    Toward Decision-Oriented Prognostics: An Integrated Estimate-Optimize Framework for Predictive Maintenance

  • Zhuojun Xie
  • Adam Abdin
  • Yiping Fang
    • Categories Optimization in Data Science, Stochastic Programming Tags , , , ,

    Recent research increasingly integrates machine learning (ML) into predictive maintenance (PdM) to reduce operational and maintenance costs in data-rich operational settings. However, uncertainty due to model misspecification continues to limit widespread industrial adoption. This paper investigates a PdM framework in which sensor-driven prognostics inform decision-making under economic trade-offs within a finite decision space. We investigate … Read more