Xin Cheng

RWKV: Reinventing RNNs for the Transformer Era

2023 · arXiv (Cornell University)

Transformers have revolutionized almost all natural language processing (NLP) tasks but suffer from memory and computational complexity that scales quadratically with sequence length. In contrast, recurrent neural networks (RNNs) exhibit linear scaling in memory and …

Partial-Label Regression

2023 · Proceedings of the AAAI Conference on Artificial Intelligence

Partial-label learning is a popular weakly supervised learning setting that allows each training example to be annotated with a set of candidate labels. Previous studies on partial-label learning only focused on the classification setting where …

Research on the application scenarios and supporting technologies of digital technology in the power industry

2023

At present, digital technology has become an inevitable trend in the development of the power industry. However, there is a lack of research on the impact of digital technology on the power industry from the …