Latest / Catalyst with Shayle Kann
Will inference move to the edge?
Today virtually all AI compute takes place in centralized data centers, driving the demand for massive power infrastructure.
But as workloads shift from training to inference, and AI applications become more latency-sensitive (autonomous vehicles, anyone?), there‘s another pathway: migrating a portion of inference from centralized computing to the edge. Instead of a gigawatt-scale data center in a remote location, we might see a fleet of smaller data centers clustered around an urban core. Some inference might even shift to our devices.
So how likely is a shift like this, and what would need…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.