Zhihao Jia

Optimizing Mixture of Experts using Dynamic Recompilations

2022 · arXiv (Cornell University)

The Mixture of Experts architecture allows for outrageously large neural networks by scaling model parameter size independently from computational demand (FLOPs). However, current DNN frameworks cannot effectively support the dynamic data flow in Mixture of …

BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphs

2022 · arXiv (Cornell University)

Detecting which nodes in graphs are outliers is a relatively new machine learning task with numerous applications. Despite the proliferation of algorithms developed in recent years for this task, there has been no standard comprehensive …

Quarl: A Learning-Based Quantum Circuit Optimizer

2023 · arXiv (Cornell University)

Optimizing quantum circuits is challenging due to the very large search space of functionally equivalent circuits and the necessity of applying transformations that temporarily decrease performance to achieve a final performance improvement. This paper presents …