Jongho Kim

A Latency Processing Unit: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference

2024 · IEEE Micro

The explosive arrival of OpenAI’s ChatGPT has fueled the globalization of large language models (LLMs), which consist of billions of pretrained parameters that embody the aspects of syntax and semantics. HyperAccel introduces a latency processing …