Rogier van Dalen

Benchmarking Rotary Position Embeddings for Automatic Speech Recognition

2025 · arXiv (Cornell University)

Self-attention relies on positional embeddings to encode input order. Relative Position (RelPos) embeddings are widely used in Automatic Speech Recognition (ASR). However, RelPos has quadratic time complexity to input length and is often incompatible with …