Thanushon Sivakaran

Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification

2025 · arXiv (Cornell University)

Although large language models (LLMs) have demonstrated remarkable capabilities in recent years, the potential of information theory (IT) to enhance LLM development remains underexplored. This paper introduces the information theoretic principle of Conditional Mutual Information …