Michael W. Mahoney
4 papers in the PaperMetrix corpus
Papers by this author
-
Inefficiency of K-FAC for Large Batch Size Training
2019 · arXiv (Cornell University)
In stochastic optimization, using large batch sizes during training can leverage parallel resources to produce faster wall-clock training times per training epoch. However, for both training loss and testing error, recent results analyzing large batch …
-
Multiplicative noise and heavy tails in stochastic optimization
2020 · arXiv (Cornell University)
Although stochastic optimization is central to modern machine learning, the precise mechanisms underlying its success, and in particular, the precise role of the stochasticity, still remain unclear. Modelling stochastic optimization algorithms as discrete random recurrence …
-
Noise-response Analysis for Rapid Detection of Backdoors in Deep Neural Networks.
2020 · arXiv (Cornell University)
The pervasiveness of deep neural networks (DNNs) in technology, matched with the ubiquity of cloud-based training and transfer learning, is giving rise to a new frontier for cybersecurity whereby `structural malware' is manifest as compromised …
-
A Statistical Framework for Ranking LLM-Based Chatbots
2024 · arXiv (Cornell University)
Large language models (LLMs) have transformed natural language processing, with frameworks like Chatbot Arena providing pioneering platforms for evaluating these models. By facilitating millions of pairwise comparisons based on human judgments, Chatbot Arena has become …