John Hurwitz

Neural Normalized Compression Distance and the Disconnect Between Compression and Classification

2024 · arXiv (Cornell University)

It is generally well understood that predictive classification and compression are intrinsically related concepts in information theory. Indeed, many deep learning methods are explained as learning a kind of compression, and that better compression leads …