Convex and Nonsmooth Optimization

Bregman Regularized Proximal Point Methods for Computing Projected Solutions of Quasi-equilibrium Problems

  • Richard Osward
    • Categories Convex and Nonsmooth Optimization, Convex Optimization, Nonlinear Optimization Tags , , ,

    In this paper, we propose two Bregman regularized proximal point methods that provide flexibility to compute projected solutions for quasi-equilibrium problems. Each method has one Bregman projection onto the feasible set and the regularized equilibrium problem. Under standard assumptions, we prove that the methods are well-defined and that the sequences they generate converge to a … Read more

    Normal cones and subdifferentials at infinity for convex analysis and optimization

  • Thanh-Hung Pham
    • Categories Convex Optimization Tags , , ,

    Motivated by recent developments, this paper further investigates normal cones and subdifferentials at infinity within the framework of convex analysis. We establish fundamental properties of these constructions and derive basic calculus rules. The obtained results extend and refine existing concepts in variational analysis and nonsmooth optimization, providing new insights into the asymptotic structure of functions … Read more

    Preconditioned Proximal Gradient Methods with Conjugate Momentum: A Subspace Perspective

  • Jian Chen
  • Xinmin Yang
    • Categories Constrained Nonlinear Optimization, Convex Optimization, Nonsmooth Optimization Tags , , ,

    In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned proximal subproblem admits a closed-form solution through its dual formulation. However, such a structure-driven preconditioner may be poorly aligned with the local curvature … Read more

    Strong convergence, perturbation resilience and superiorization of Generalized Modular String-Averaging with infinitely many input operators

  • Kay Barshad
  • Yair Censor
    • Categories Constrained Nonlinear Optimization, Convex Optimization Tags , , , , , , , , ,

    We study the strong convergence and bounded perturbation resilience of iterative algorithms based on the Generalized Modular String-Averaging (GMSA) procedure for infinite sequences of input operators under a general admissible control. These methods address a variety of feasibility-seeking problems in real Hilbert spaces, including the common fixed point problem and the convex feasibility problem. In … Read more

    On the Complexity of Subgradient Methods for Trilevel Hierarchical Generalized Variational Inequalities

  • Lorenzo Lampariello
  • Simone Sagratella
  • Valerio Giuseppe Sasso
    • Categories Convex Optimization, Nonlinear Optimization, Nonsmooth Optimization Tags , , , ,

    We study generalized variational inequalities with a three-level hierarchical structure. This setting extends nested GVI models beyond the bilevel case, for which $\mathcal{O}(\delta^{-4})$ complexity bounds are known for any prescribed positive tolerance $\delta$, to a fully three-level hierarchical structure. We analyze a projected averaged subgradient method combined with a Tikhonov-like regularization scheme. Under compactness, maximal … Read more

    A Modified Projected Gradient Algorithm for Solving Quasiconvex Programming with Applications

  • Pham Thi Hoai
    • Categories Constrained Nonlinear Optimization, Convex Optimization, Nonlinear Optimization Tags , , , ,

    In this manuscript, we introduce a novel projected gradient algorithm for solving quasiconvex optimization problems over closed convex sets. The key innovation of our new algorithm is an adaptive, parameter-free stepsize rule that requires no line search and avoids estimating constants, such as Lipschitz modulus. Unlike recent self-adaptive approach given in [17] which typically produce … Read more

    Copositive and completely positive cones over symmetric cones of rank at least 5

  • Mitsuhiro Nishijima
    • Categories Convex and Nonsmooth Optimization, Linear, Cone and Semidefinite Programming Tags , , , ,

    We focus on copositive and completely positive cones over symmetric cones of rank at least $5$, and in particular investigate whether these cones are spectrahedral shadows. We extend known results for nonnegative orthants of dimension at least $5$ to general symmetric cones of rank at least $5$. Specifically, we prove that when the rank of … Read more

    Lower Bounds for Linear Minimization Oracle Methods Optimizing over Strongly Convex Sets

  • Benjamin Grimmer
  • nliu15
    • Categories Convex Optimization Tags , , ,

    We consider the oracle complexity of constrained convex optimization given access to a Linear Minimization Oracle (LMO) for the constraint set and a gradient oracle for the $L$-smooth, strongly convex objective. This model includes Frank-Wolfe methods and their many variants. Over the problem class of strongly convex constraint sets $S$, our main result proves that … Read more

    Improved Analysis of Restarted Accelerated Gradient and Augmented Lagrangian Methods via Inexact Proximal Point Frameworks

  • Matthew X. Burns
  • Jiaming Liang
    • Categories Constrained Nonlinear Optimization, Convex and Nonsmooth Optimization, Convex Optimization Tags , , , ,

    This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity in both the convex and strongly convex settings. For linearly constrained problems, we introduce inexact augmented Lagrangian methods, including a basic method and an outer-accelerated … Read more

    Convex analysis for composite functions without K-convexity

  • Juan Pablo Vielma
    • Categories Convex Optimization, Generalized Convexity/Monoticity

    Composite functions have been studied for over 40 years and appear in a wide range of optimization problems. Convex analysis of these functions focuses on (i) conditions for convexity of the function based on properties of its components, (ii) formulas for the convex conjugate of the function based on those of its components and (iii) … Read more