Nicolas Le Roux

A functional mirror ascent view of policy gradient methods with function approximation.

2021 · arXiv (Cornell University)

We use functional mirror ascent to propose a general framework (referred to as FMA-PG) for designing policy gradient methods. The functional perspective distinguishes between a policy's functional representation (what are its sufficient statistics) and its …