Kartik Goyal

A Continuous Relaxation of Beam Search for End-to-End Training of Neural Sequence Models

2018 · Proceedings of the AAAI Conference on Artificial Intelligence

Beam search is a desirable choice of test-time decoding algorithm for neural sequence models because it potentially avoids search errors made by simpler greedy methods. However, typical cross entropy training procedures for these models do …

Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks

2022

The wide adoption and application of Masked language models (MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities. Prior attempts at measuring leakage of MLMs via membership …