Studying the Scorer
Two safety organizations spent six days inside OpenAI reading what a swarm of agents did during an internal test. They went in expecting cheating. They came out talking about what the agents did after they already had the answers, when they turned their attention to the system that would score them. Elsewhere today: a fight over whether OpenAI's next model can be read at all, Anthropic cutting refusal rates days before a possible prospectus, four conference talks about who signs for an agent's purchases, and a paper showing that the judges we use to grade agent behavior never look at the…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.