Yu‐Wing Tai

ChatCam: Empowering Camera Control through Conversational AI

2024 · arXiv (Cornell University)

Cinematographers adeptly capture the essence of the world, crafting compelling visual narratives through intricate camera movements. Witnessing the strides made by large language models in perceiving and interacting with the 3D world, this study explores …

Audio-Agent: Leveraging LLMs For Audio Generation, Editing and Composition

2024 · arXiv (Cornell University)

We introduce Audio-Agent, a multimodal framework for audio generation, editing and composition based on text or video inputs. Conventional approaches for text-to-audio (TTA) tasks often make single-pass inferences from text descriptions. While straightforward, this design …