On the convergence of decomposition methods for multi-stage stochastic convex programs

We prove the almost-sure convergence of a class of sampling-based nested decomposition algorithms for multistage stochastic convex programs in which the stage costs are general convex functions of the decisions, and uncertainty is modelled by a scenario tree. As special cases, our results imply the almost-sure convergence of SDDP, CUPPS and DOASA when applied to … Read more

Risk-Averse Control of Undiscounted Transient Markov Models

We use Markov risk measures to formulate a risk-averse version of the undiscounted total cost problem for a transient controlled Markov process. We derive risk-averse dynamic programming equations and we show that a randomized policy may be strictly better than deterministic policies, when risk measures are employed. We illustrate the results on an optimal stopping … Read more

A Dynamic Programming Heuristic for the Quadratic Knapsack Problem

It is well known that the standard (linear) knapsack problem can be solved exactly by dynamic programming in O(nc) time, where n is the number of items and c is the capacity of the knapsack. The quadratic knapsack problem, on the other hand, is NP-hard in the strong sense, which makes it unlikely that it … Read more

Time consistency of dynamic risk measures

In this paper we discuss time consistency of risk averse multistage stochastic programming problems. We show, in a framework of finite scenario trees, that composition of law invariant coherent risk measures can be law invariant only for the expectation or max-risk measures. CitationPreprintArticleDownload View PDF

Risk neutral and risk averse Stochastic Dual Dynamic Programming method

In this paper we discuss risk neutral and risk averse approaches to multistage (linear) stochastic programming problems based on the Stochastic Dual Dynamic Programming (SDDP) method. We give a general description of the algorithm and present computational studies related to planning of the Brazilian interconnected power system. Citation ArticleDownload View PDF

Optimizing Trading Decisions for Hydro Storage Systems using Approximate Dual Dynamic Programming

We propose a new approach to optimize operations of hydro storage systems with multiple connected reservoirs which participate in wholesale electricity markets. Our formulation integrates short-term intraday with long-term interday decisions. The intraday problem considers bidding decisions as well as storage operation during the day and is formulated as a stochastic program. The interday problem … Read more

On the Geometry of Acceptability Functionals

Abstract In this paper we discuss continuity properties of acceptability functionals or risk measures. The dependence of the random variable is investigated first. The main contribution and focus of this paper is to study how acceptability functionals vary whenever the underlying probability measure is perturbed. Abstract It turns out that the Wasserstein distance provides a … Read more

Time-inconsistent multistage stochastic programs: martingale bounds

Abstract. It is well known that multistage programs, which maximize expectation or expected utility, allow a dynamic programming formulation, and that other objectives destroy the dynamic programming character of the problem. This paper considers a risk measure at the final stage of a multistage stochastic program. Although these problems are not time consistent, it is … Read more

Optimal Toll Design: A Lower Bound Framework for the Asymmetric Traveling Salesman Problem

We propose a framework of lower bounds for the asymmetric traveling salesman problem (TSP) based on approximating the dynamic programming formulation with diff erent basis vector sets. We discuss how several well-known TSP lower bounds correspond to intuitive basis vector choices and give an economic interpretation wherein the salesman must pay tolls as he travels between … Read more

Managing Operational and Financing Decisions to Meet Consumption Targets

We study dynamic operational decision problems where risky cash flows are being resolved over a finite planning horizon. Financing decisions via lending and borrowing are available to smooth out consumptions over time with the goal of achieving some prescribed consumption targets. Our target-oriented decision criterion is based on the aggregation of Aumann and Serrano (2008) … Read more