S K Somasundaram

Combining Data Mining and Visualization: UMAP on ROPE

2024

This research explores data mining techniques for time-series data, focusing on enhancing the performance and interpretability of transformer models through Rotary positioning embedding (RoPE) and probabilistic sparse attention (ProbSparse). RoPE incorporates positional data into the …