Latest / The MAD Podcast: How AI Gets Built — with Matt Turck
Who Feeds the GPUs? Inside AI's Hidden $30B Layer | Renen Hallak, VAST Data
Everyone talks about GPUs. Almost nobody talks about the layer that feeds them. Renen Hallak is the founder & CEO of VAST Data — the $30 billion company powering xAI and some of the world's biggest AI clouds — and he sits in the hidden layer of the AI stack.
In this episode, we cover what an AI factory actually is, why every company will eventually own its own AI, the architecture bet behind VAST (DASE, explained simply), KV caches and agent memory, and DataEnclave — VAST's brand-new confidential AI announcement with NVIDIA that lets leading models run on the world's most sensitive data…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.