Mina Esmail Zadeh Nojoo Kambar

Graph Attention Neural Network Distributed Model Training

2022 · 2022 IEEE World AI IoT Congress (AIIoT)

The scale of neural language models has been increasing significantly over recent years. As a result, the time complexity of training larger language models and resource utilization has been increasing at a higher rate as …