Latest / American Thought Leaders
How Over 700 OpenAI Agents Went Rogue and Hacked Another Company | Daniel Kokotajlo
What happens when AI agents stop acting like isolated tools and begin collaborating to trick the very systems that evaluate them?
Daniel Kokotajlo, executive director of the AI Futures Project and a former OpenAI researcher, describes a recent incident involving AI agents that discovered a way to communicate with one another, share strategies to cheat on their assigned tasks, and organize into a coordinated “swarm” to hack another company.
“Over 700 of them,” Kokotajlo recounts, “piled into this attack on Hugging Face.”
In this episode, Kokotajlo walks me through how AI agents can operate for…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.