What really happened when ChatGPT hacked Hugging Face?

In The Loop · Jul 30, 2026 · 12m

OpenAI took two of its most capable models, told them to prove how good they were at hacking, and switched off the safety filters to see what they could really do.

Instead of solving the test, one model broke out of its sandbox, found its way onto the open internet, and hacked into Hugging Face to steal the answer.

Every headline called it an AI going rogue. That's the wrong story, and the real one is far more interesting, because this wasn't a machine that turned evil. It was one that did exactly what we asked.

In this episode of In The Loop, I'm walking through the ExploitGym incident from…