Lav R. Varshney

Skip-Sliding Window Codes

2017 · arXiv (Cornell University)

Constrained coding is used widely in digital communication and storage systems. In this paper, we study a generalized sliding window constraint called the skip-sliding window. A skip-sliding window (SSW) code is defined in terms of …

Limits of Fault-Tolerance on Resource-Constrained Quantum Circuits for Classical Problems

2023 · arXiv (Cornell University)

Existing lower bounds on redundancy in fault-tolerant quantum circuits are applicable when both the input and the intended output are quantum states. These bounds may not necessarily hold, however, when the input and the intended …

Reliable Quantum Memories with Unreliable Components

2024 · arXiv (Cornell University)

Quantum memory systems are vital in quantum information processing for dependable storage and retrieval of quantum states. Inspired by classical reliability theories that synthesize reliable computing systems from unreliable components, we formalize the problem of …

An Information Theory of Compute-Optimal Size Scaling, Emergence, and Plateaus in Language Models

2024 · arXiv (Cornell University)

Recent empirical studies show three phenomena with increasing size of language models: compute-optimal size scaling, emergent capabilities, and performance plateauing. We present a simple unified mathematical framework to explain all of these language model scaling …

CTRL: A Conditional Transformer Language Model for Controllable Generation

2019 · arXiv (Cornell University)

Large-scale language models show promising text generation capabilities, but users cannot easily control particular aspects of the generated text. We release CTRL, a 1.63 billion-parameter conditional transformer language model, trained to condition on control codes …