Qinghua Zhou

RWKV: Reinventing RNNs for the Transformer Era

2023 · arXiv (Cornell University)

Transformers have revolutionized almost all natural language processing (NLP) tasks but suffer from memory and computational complexity that scales quadratically with sequence length. In contrast, recurrent neural networks (RNNs) exhibit linear scaling in memory and …

StepProof: Step-by-step verification of natural language mathematical proofs

2025 · arXiv (Cornell University)

Interactive theorem provers (ITPs) are powerful tools for the formal verification of mathematical proofs down to the axiom level. However, their lack of a natural language interface remains a significant limitation. Recent advancements in large …