#116 Robin: How Much AI Can Your Hardware Actually Run? From $5 Chips to 8× H100s
Got something to say to this podcast? Send a voicemail, and you might hear yourself on the next episode!
You don’t need a monster GPU to run AI locally. A tiny microcontroller can already handle basic models, while a Raspberry Pi, laptop, home server, or GPU can take you all the way to speech, vision, coding, image generation, and video.
The key is understanding just two things: how much memory you have, and how fast your hardware can move that memory.
We’ll talk about:
From ESP32 to Raspberry Pi: What tiny devices can actually run, and where microcontrollers hit their limits.
Why 8GB Isn’t…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.