Taeho Hwang

Building an Inference Server Platform for Large Language Models Using Dataflow PIM Platform

2024

Processing-in-Memory (PIM) has garnered attention as a platform for large language model inference due to its ability to perform computations within memory, leveraging the internal bandwidth of memory components. In data center environments, to execute …