How AI Models Are Really Judged, with Peter Gostev (Arena / LMArena)
Peter Gostev is head of AI capabilities at Arena (LMArena), the community-based platform where millions of real people vote in blind tests to rank AI models, born out of research at UC Berkeley. Before Arena, Peter was Head of AI at Moonpig and built a large following sharing hands-on explorations of what the latest models can actually do. He joins Georgie Healy from London for a genuinely nerdy, insider look at how models are judged and where the frontier is heading.
In this episode, Peter explains the difference between static benchmarks and human judgment, and why a model can pass every…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.