Kuntai Du

Do Large Language Models Need a Content Delivery Network?

2024 · arXiv (Cornell University)

As the use of large language models (LLMs) expands rapidly, so does the range of knowledge needed to supplement various LLM queries. Thus, enabling flexible and efficient injection of new knowledge in LLM inference is …