Khashayar Khosravi

Multiclass Classification, Information, Divergence, and Surrogate Risk

2016 · arXiv (Cornell University)

We provide a unifying view of statistical information measures, multi-way Bayesian hypothesis testing, loss functions for multi-class classification problems, and multi-distribution $f$-divergences, elaborating equivalence results between all of these objects, and extending existing results for …

Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling

2016 · arXiv (Cornell University)

Recurrent neural networks have been very successful at predicting sequences of words in tasks such as language modeling. However, all such models are based on the conventional classification framework, where the model is trained against …