Finite State Approximations for Robust Markov Decision Processes
We give a finite state approximation scheme to countable state controlled robust/risk-averse Markov chains, where there is uncertainty in the transition probability. A convergence theorem along with the corresponding rate for this approximation is established. An approximation to the stationary optimal policy is also given. Our results show a fundamental difference between the finite state … Read more