#089 - Changing How LLMs Scale - The AI Token Breakthrough with Subquadratic CTO Alex Whedon
Graeme Scott sits down with Alex Whedon, Co-Founder and CTO of Subquadratic and former Head of Generative AI at Tribe AI, for one of the most first-principles conversations GAEA Talks has recorded.
The entire AI industry, Alex argues, is downstream from a single algorithm - the transformer - and its two fundamental flaws are quietly capping what AI can do. He breaks down quadratic compute scaling in plain terms (10x the input, 100x the compute), the memory wall where context can cost more than the model itself, and how Subquadratic's linear-scaling architecture claims to cut compute by up to…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.