Xun Zhou

Deep Incremental RNN for Learning Sequential Data: A Lyapunov Stable Dynamical System

2021

With the recent advances in mobile sensing technologies, large amounts of sequential data are collected, such as vehicle GPS records, stock prices, sensor data from air quality detectors. Recurrent neural networks (RNNs) have been studied …

Regret of exploratory policy improvement and $q$-learning

2024 · arXiv (Cornell University)

We study the convergence of $q$-learning and related algorithms introduced by Jia and Zhou (J. Mach. Learn. Res., 24 (2023), 161) for controlled diffusion processes. Under suitable conditions on the growth and regularity of the …

Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoning

2025 · arXiv (Cornell University)

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped Transformers possess remarkable length generalization …