Simos Gerasimou

Accelerating Policy Synthesis in Large-Scale MDPs via Hierarchical Adaptive Refinement

2026 · Proceedings of the ACM on software engineering.

Software-intensive systems, such as software product lines and robotics, utilise Markov decision processes (MDPs) to capture uncertainty and analyse sequential decision-making problems. Despite the usefulness of conventional policy synthesis methods, they fail to scale to …