Derek Jacoby

No such thing as a “free launch”? Systematic benchmarking of containers

2017

Docker containers have recently become an extremely popular means of building robust, modular systems. Essentially, many architectures leverage lightweight virtualization to manage micro-services. Surprisingly however, there are very few studies revealing the overheads, such as …

Human Latency Conversational Turns for Spoken Avatar Systems

2024 · arXiv (Cornell University)

A problem with many current Large Language Model (LLM) driven spoken dialogues is the response time. Some efforts such as Groq address this issue by lightning fast processing of the LLM, but we know from …