Vikram Krishnamurthy

Computing monotone policies for Markov decision processes: a nearly-isotonic penalty approach

2017 · arXiv (Cornell University)

This paper discusses algorithms for solving Markov decision processes (MDPs) that have monotone optimal policies. We propose a two-stage alternating convex optimization scheme that can accelerate the search for an optimal policy by exploiting the …

Controlling Transaction Rate in Tangle Ledger: A Principal Agent Problem Approach

2022 · arXiv (Cornell University)

Tangle is a distributed ledger technology that stores data as a directed acyclic graph (DAG). Unlike blockchain, Tangle does not require dedicated miners for its operation; this makes Tangle suitable for Internet of Things (IoT) …