robust Markov decision processes

A data-driven robust approach to a problem of optimal replacement in maintenance

  • Sina Shahri Majarshin
  • Ahmadreza Marandi
  • Geert-Jan van Houtum
    • Categories Applications - OR and Management Sciences, Robust Optimization, Statistics Tags , , ,

    Maintenance strategies are pivotal in ensuring the reliability and performance of critical components within industrial machines and systems. However, accurately determining the optimal replacement time for such components under stress and deterioration remains a complex task due to inherent uncertainties and variability in operating conditions. In this paper, we propose a comprehensive approach based on … Read more

    An MILP-Based Solution Scheme for Factored and Robust Factored Markov Decision Processes

  • Huikang Liu
  • Wolfram Wiesemann
  • Man-Chung Yue
    • Categories (Mixed) Integer Linear Programming, Robust Optimization Tags ,

    Factored Markov decision processes (MDPs) are a prominent paradigm within the artificial intelligence community for modeling and solving large-scale MDPs whose rewards and dynamics decompose into smaller, loosely interacting components. Through the use of dynamic Bayesian networks and context-specific independence, factored MDPs can achieve an exponential reduction in the state space of an MDP and … Read more