Prakash Panangaden

A Canonical Form for Weighted Automata and Applications to Approximate Minimization

2015

We study the problem of constructing approximations to a weighted automaton. Weighted finite automata (WFA) are closely related to the theory of rational series. A rational series is a function from strings to real numbers …

Policy Gradient Methods in the Presence of Symmetries and State Abstractions

2023 · arXiv (Cornell University)

Reinforcement learning (RL) on high-dimensional and complex problems relies on abstraction for improved efficiency and generalization. In this paper, we study abstraction in the continuous-control setting, and extend the definition of Markov decision process (MDP) …