Yizhou Huang

Fractal Hash Transformer: Efficient Long-Sequence Modeling with Recurrent Parameter Sharing and Differentiable Hash Routing

2026 · Open MIND

The Transformer, with its global self-attention mechanism, has become a foundational architecture for natural language processing and general sequence modeling. However, the quadratic time and space complexity of standard self-attention poses significant computational and memory …