The number nobody optimized for
Claude Opus 4.8 landed overnight with a math score that leapt and a business-ops score that fell — and reading the release honestly means distrusting the chart. Lenar and Damra work through the gap between the number that moved and the number that matters, then chase it into agent budgets, the protocol wars, local-inference tooling, Mistral's on-prem bet, and the power grid.
A scrape of 100+ Opus 4.8 evals shows USAMO 2026 jumping 69%→97% while Vending-Bench 2 nearly halved — a retune that helped some distributions and hurt others.
"AI benchmarks are useless" argues the record scores ride on…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.