F. Ourique

Multi-partition time aggregation for Markov Chains

2017

Motivated by Markov decision processes, this paper introduces a form of embedding for Markov chains which is based on the partition of the state space into a manageable number of subsets, with the aim of …