Who grades the AI security patch? Why 26% and 86% aren't your success rate
Send us Fan Mail
Two model reviewers disagree on more than a third of the same security patches. How much confidence should a headline success rate buy?
Augur examines Trail of Bits' critique of 1Password's AI patching study and explains why a 26% clean-fix rate and an 86% supplied-exploit result don't answer the same question. For engineering leaders, the practical next step is a bounded check of the review process against their own code, not automatic deployment based on either number.
Also in this episode: Gemini 3.8 Live Extended Thinking's reported voice scores and enterprise…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.