Veselin Raychev

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging

2024 · arXiv (Cornell University)

As open-weight large language models (LLMs) achieve ever more impressive performances across a wide range of tasks in English, practitioners aim to adapt these models to different languages. However, such language adaptation is often accompanied …

PHOG: probabilistic model for code

2016 · International Conference on Machine Learning

We introduce a new generative model for code called probabilistic higher order grammar (PHOG). PHOG generalizes probabilistic context free grammars (PCFGs) by allowing conditioning of a production rule beyond the parent non-terminal, thus capturing rich …