skinny.

Latest / They Might Be Self-Aware: AI News & Culture

Why OpenAI Banned Goblins, Pigeons, And Raccoons

OpenAI's Codex shipped with a system prompt that literally bans the words goblin, pigeon, raccoon, troll, ogre, and gremlin. It is in writing, in the prompt, the kind of sentence you only put there after something has happened. OpenAI has officially confessed why.

Hunter Powers and Daniel Bishop pull the thread. The official story: the "nerdy personality" preset got fine-tuned with RLHF (reinforcement learning with human feedback), users thumbed-up the cute goblin references, the model over-optimized for the trait, and the weirdness compounded. Daniel calls it Flandersization. One thumbs-up…

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.