Latest / The Practical AI Digest
Mixture of Experts at the Edge: Running 30B Parameter Models on Your Laptop
A 30B parameter model runs on a MacBook because only 3B parameters fire per token. Mixture of Experts splits memory cost from compute cost, and that changes everything about where AI can run.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.