Inside the AI Bottleneck: Data Movement, Chiplets, and System Scaling

Tech Threads: Weaving the Intelligent Future · Mar 27, 2026 · 54m

For the last decade AI has been driven by one thing, more compute: bigger models, more accelerators, higher throughput.

But as NVIDIA’s Jensen Huang recently highlighted at GTC, the industry is hitting a different kind of wall, one that hasn’t received nearly as much attention.

The real constraint is no longer just compute. It’s data movement.

To its credit, Nvidia has pushed this frontier with innovations like NVLink Fusion, and continued investment in connectivity AI dataflow architectures. But the challenge is bigger than any one company.

As AI systems scale to hundreds - and even…