Yiren Zhao

Architectural Backdoors in Neural Networks

2022 · arXiv (Cornell University)

Machine learning is vulnerable to adversarial manipulation. Previous literature has demonstrated that at the training stage attackers can manipulate data and data sampling procedures to control model behaviour. A common attack goal is to plant …

Wide Attention Is The Way Forward For Transformers?

2022 · arXiv (Cornell University)

The Transformer is an extremely powerful and prominent deep learning architecture. In this work, we challenge the commonly held belief in deep learning that going deeper is better, and show an alternative design approach that …