H. Howie Huang

Prompts have evil twins

2023 · arXiv (Cornell University)

We discover that many natural-language prompts can be replaced by corresponding prompts that are unintelligible to humans but that provably elicit similar behavior in language models. We call these prompts "evil twins" because they are …