Zhuofan Zong

Exploring the Role of Large Language Models in Prompt Encoding for Diffusion Models

2024 · arXiv (Cornell University)

Large language models (LLMs) based on decoder-only transformers have demonstrated superior text understanding capabilities compared to CLIP and T5-series models. However, the paradigm for utilizing current advanced LLMs in text-to-image diffusion models remains to be …