Ep 201: Self-scaling coding benchmarks just arrived, with difficulty now set by the agents…

Models & Agents — Video Edition · Oct 12, 2026 · 11m

Models & Agents Self-scaling coding benchmarks just arrived, with difficulty now set by the agents themselves rather than fixed tasks. What You Need to Know: SWE-Duel pits coding agents against each other in mirrored Red-Blue turns on real repositories, generating fresh tasks and oracles at evaluation time so leakage is impossible. GPT-5.5 with Codex CLI led as the strongest solver while Claude Opus 4.8 with mini-swe-agent led as task author. Builders should watch how this changes agent evaluation away from saturating static suites. Top Story SWE-Duel creates a self-scaling arena where two…