Shufan Li

Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data

2024 · arXiv (Cornell University)

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs …