Humanity's Last Exam
Standardized tests are getting torched like marshmallows at a bonfire, and AI's top students are flunking the new final. In this episode, Emily unpacks Humanity’s Last Exam, a brutal, brain-bending test designed to humble even the cockiest language model. Forget multiple choice; we’re talking diagrams, logic puzzles, and cross-disciplinary chaos that left most AIs confidently clueless. Hear how this monster exam aims to reset the curve, why benchmark saturation is a real buzzkill, and what it says about how far AI has to go before it stops giving you medical advice with the swagger of a drunk…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.