The Age of Inference: Etched Startup Proves the Next AI Hotspot

In the Loop AI · Jul 7, 2026 · 27m · transcript

Inference is becoming more important than pre-training in AI chips, including how pre-fill and decode work and why more compute is shifting toward serving models.

Today we walk through Etched’s ASIC system for transformer inference, its claims around efficiency and throughput, and the tradeoff between specialization and general-purpose GPUs like NVIDIA’s.

We also look at custom chip efforts from companies like OpenAI, Google, and Amazon, and argues that inference demand may keep growing as AI agents and long-running workloads expand.

------

🌌 LIMITLESS HQ ⬇️

EMAIL US: info@limitless.fm…